distal-attribute
distal-attribute
distal-attribute
distal-attribute

EOutOfMemory when inporting large CSV

Thomas posted 3 years ago in Import/Export
Hi,
I keep getting an error when trying to import a rather large CSV with REPLACE.
Sometimes it works - but most of the times not.

date/time         : 2013-10-23, 22:58:53, 36ms
computer name     : XXX
user name         : Thomas XXX
registered owner  : Thomas XXX
operating system  : Windows 7 x64 Service Pack 1 build 7601
system language   : German
system up time    : 1 hour 44 minutes
program up time   : 41 seconds
processors        : 4x Intel(R) Core(TM) i5-2320 CPU @ 3.00GHz
physical memory   : 5927/8143 MB (free/total)
free disk space   : (C:) 240,56 GB
display mode      : 1440x900, 32 bit
process id        : $1730
allocated memory  : 49,27 MB
executable        : heidisql.exe
exec. date/time   : 2013-10-03 07:24
version           : 8.1.0.4545
compiled with     : Delphi XE
madExcept version : 3.0m beta 1
callstack crc     : $2b691daa, $282f8ce7, $282f8ce7
exception number  : 1
exception class   : EOutOfMemory
exception message : Out of memory.
main thread ($1734):
004075eb heidisql.exe System    549  +0 @NewUnicodeString
00407817 heidisql.exe System    549  +0 @UStrFromPWCharLen
004808af heidisql.exe SysUtils          TEncoding.GetString
00480864 heidisql.exe SysUtils          TEncoding.GetString
0068308c heidisql.exe helpers  1420 +33 ReadTextfileChunk
00683213 heidisql.exe helpers  1430  +3 ReadTextfile
0079f11a heidisql.exe loaddata  533 +16 Tloaddataform.ClientParse
0079d82f heidisql.exe loaddata  304 +23 Tloaddataform.btnImportClick
004e9cfb heidisql.exe Controls          TControl.Click
005208ea heidisql.exe StdCtrls          TCustomButton.Click
005213d8 heidisql.exe StdCtrls          TCustomButton.CNCommand
004e9790 heidisql.exe Controls          TControl.WndProc
004ee054 heidisql.exe Controls          TWinControl.WndProc
005205b4 heidisql.exe StdCtrls          TButtonControl.WndProc
004e93b4 heidisql.exe Controls          TControl.Perform
004ee1a7 heidisql.exe Controls          DoControlMsg
004eec03 heidisql.exe Controls          TWinControl.WMCommand
00572990 heidisql.exe Forms             TCustomForm.WMCommand
004e9790 heidisql.exe Controls          TControl.WndProc
004ee054 heidisql.exe Controls          TWinControl.WndProc
0056f894 heidisql.exe Forms             TCustomForm.WndProc
004ed6f4 heidisql.exe Controls          TWinControl.MainWndProc
004abc88 heidisql.exe Classes           StdWndProc
753b0d48 USER32.dll                     CallWindowProcW
006826e0 heidisql.exe helpers  1102  +1 CallOld
00682828 heidisql.exe helpers  1149 +44 SizeGripWndProc
753a96c0 USER32.dll                     SendMessageW
753b0d48 USER32.dll                     CallWindowProcW
004ee154 heidisql.exe Controls          TWinControl.DefaultHandler
004ea14c heidisql.exe Controls          TControl.WMLButtonUp
004e9790 heidisql.exe Controls          TControl.WndProc
004ee054 heidisql.exe Controls          TWinControl.WndProc
005205b4 heidisql.exe StdCtrls          TButtonControl.WndProc
004ed6f4 heidisql.exe Controls          TWinControl.MainWndProc
004abc88 heidisql.exe Classes           StdWndProc
753a7885 USER32.dll                     DispatchMessageW
00578863 heidisql.exe Forms             TApplication.ProcessMessage
005788a6 heidisql.exe Forms             TApplication.HandleMessage
00574205 heidisql.exe Forms             TCustomForm.ShowModal
007ef6bc heidisql.exe Main     1954  +1 TMainForm.actImportCSVExecute
004ab5e3 heidisql.exe Classes           TBasicAction.Execute
004d7f7d heidisql.exe ActnList          TContainedAction.Execute
004d8d38 heidisql.exe ActnList          TCustomAction.Execute
004ab4a7 heidisql.exe Classes           TBasicActionLink.Execute
005097e0 heidisql.exe Menus             TMenuItem.Click
0050acf3 heidisql.exe Menus             TMenu.DispatchCommand
00572983 heidisql.exe Forms             TCustomForm.WMCommand
004e9790 heidisql.exe Controls          TControl.WndProc
004ee054 heidisql.exe Controls          TWinControl.WndProc
0056f894 heidisql.exe Forms             TCustomForm.WndProc
004ed6f4 heidisql.exe Controls          TWinControl.MainWndProc
004abc88 heidisql.exe Classes           StdWndProc
753a7885 USER32.dll                     DispatchMessageW
00578863 heidisql.exe Forms             TApplication.ProcessMessage
005788a6 heidisql.exe Forms             TApplication.HandleMessage
00578bd1 heidisql.exe Forms             TApplication.Run
00823c17 heidisql.exe heidisql   76 +24 initialization
769f3368 kernel32.dll                   BaseThreadInitThunk


Any help is highly welcomesmile

Thanks in advance

Thomas
ansgar posted 3 years ago
You should try using the "server" method for parsing.
ansgar posted 2 years ago
A 64bit version potentially helps here. I am currently weighing up the pros and cons of serving a 64bit version of HeidiSQL, and I need some user input. See here.
Thomas posted 2 years ago
The server method did not work at all, but it runs perfectly on the 64bit version in client method.

THANK YOU VERY MUCH !!


Thomas

Please login to leave a reply, or register at first.