[CSVUtil] Add partial-load please

[CSVUtil] Add partial-load please

  
Forge Component
(13)
Published on 24 Sep by Wei Zhu
13 votes
Published on 24 Sep by Wei Zhu
Hi,

I have large csv-files, could you implement partial-load functionality?

so I can loop through the csv by, say 10000 lines?
which will not kill the memory :)

Hi

I had add following parametes to LoadCSV2RecordList action
  - StartIndex: Start row index of data (Default value: 0)
  - MaxNum: Maximum # of row to load (Default value : -1)
Thanks for the update.

However, I am still experiencing some issues.

problem is the csv which is 2Gb of size.
(which is extracted from a zip first)
this will be loaded into memory in total, because I need to pass it as binary data.
as you can understand this is not very funny for my machine...

Hi Wei,

The component is stopping the upload after 149 rows, any idea?
There is any 149 default value some where?

Many thanks
It is now working perfectly!

Thanks
I added folllowing parameter to LoadCSV2RecordList action.
  - CSVFile: File path of CSV (also set CSV to empty binary data)

Regards


Hi Wei,

I've still problems with the component. I have four files that are really similar each other.Two imports are working fine, the others two instead there are no way to upload them. There is any way to understand where the problem is coming from? Maybe something like a debuger? The only output that I have is the LoadCSVRecordList.IsSuccess, but it is now helping me a lot...

Thanks

err, you also have the debuginfo output.


Hi Statler & Waldorf and the amazing flappy tweedles!,

Where can i find it?

Thanks

Hi,

fixed.

Thanks
Hi,

I'm trying to load a simple file with this layout.

Nr1;Nr2;Nr3
0;1234;4567

After import the values are
Nr1=1234
Nr2=4567

Looks like the first value is skipped? Anyone got an idea what went wrong?

--- edit
When i add a column in the csv like:
Nr1;Nr2;Nr3
0;1234;4567,8912

Then Nr1=1234, Nr2=4567, Nr3=8912

Very strange....

thanks!
Please check the DebugInfo output parameter  of LoadCSV2RecordList.
It contain the information of attributes. (e.g. 
Field:ssEmployeeName...)
LoadCSV2RecordList will set the attribute with CSV data one by one.