Hi guys, I try to validate the data in excel file column by column and row by row to avoid duplication before I save them into database, the excel file have 100 000 records with 20 columns, then I try to show the validation result to user in UI. But it keeps trigger the Timeout response even I am extending the server request timeout to 60 second.
But If I use a timer to run it then it will not be able to show the validation results immediately, if there are no changes for the data in the giant excel file and current database records.
Anyone has suggestion any solution or best practices for me to build it?
Hi,1.Instead of validating all 100,000 rows at once, split the data into smaller batches (e.g., 5,000–10,000 rows per batch).2.Use a loop with asynchronous processing to validate one batch at a time, updating the UI incrementally.3.Use a Timer to perform the validation.4.Store validation results in a temporary table.Thanks,Sahana
Hi @Ewan ,
Instead of validating all the 100,000 rows, try the batch processing and use timer as the best practice.
Thanks,
Jithu
You can write your custom c# extension.
https://www.outsystems.com/forums/discussion/66087/how-to-validate-imported-excel-fields/