36
Views
11
Comments
[CSVUtil] Add partial-load please
Question
csvutil
Service icon
Forge asset by Wei Zhu
Hi,

I have large csv-files, could you implement partial-load functionality?

so I can loop through the csv by, say 10000 lines?
which will not kill the memory :)

2021-06-21 12-37-59
Wei Zhu
Hi

I had add following parametes to LoadCSV2RecordList action
  - StartIndex: Start row index of data (Default value: 0)
  - MaxNum: Maximum # of row to load (Default value : -1)
2016-04-21 20-09-55
J.
 
MVP
Thanks for the update.

However, I am still experiencing some issues.

problem is the csv which is 2Gb of size.
(which is extracted from a zip first)
this will be loaded into memory in total, because I need to pass it as binary data.
as you can understand this is not very funny for my machine...

2021-06-21 09-08-42
Simone
Hi Wei,

The component is stopping the upload after 149 rows, any idea?
There is any 149 default value some where?

Many thanks
2021-06-21 09-08-42
Simone
It is now working perfectly!

Thanks
2021-06-21 12-37-59
Wei Zhu
I added folllowing parameter to LoadCSV2RecordList action.
  - CSVFile: File path of CSV (also set CSV to empty binary data)

Regards


2021-06-21 09-08-42
Simone
Hi Wei,

I've still problems with the component. I have four files that are really similar each other.Two imports are working fine, the others two instead there are no way to upload them. There is any way to understand where the problem is coming from? Maybe something like a debuger? The only output that I have is the LoadCSVRecordList.IsSuccess, but it is now helping me a lot...

Thanks

2016-04-21 20-09-55
J.
 
MVP
err, you also have the debuginfo output.


2021-06-21 09-08-42
Simone
2021-06-21 09-08-42
Simone
Hi,

fixed.

Thanks
UserImage.jpg
steven h
Hi,

I'm trying to load a simple file with this layout.

Nr1;Nr2;Nr3
0;1234;4567

After import the values are
Nr1=1234
Nr2=4567

Looks like the first value is skipped? Anyone got an idea what went wrong?

--- edit
When i add a column in the csv like:
Nr1;Nr2;Nr3
0;1234;4567,8912

Then Nr1=1234, Nr2=4567, Nr3=8912

Very strange....

thanks!
2021-06-21 12-37-59
Wei Zhu
Please check the DebugInfo output parameter  of LoadCSV2RecordList.
It contain the information of attributes. (e.g. 
Field:ssEmployeeName...)
LoadCSV2RecordList will set the attribute with CSV data one by one.




Community GuidelinesBe kind and respectful, give credit to the original source of content, and search for duplicates before posting.