31
Views
5
Comments
Data Extraction : Entity's data to Parquet file.

Is there any way to convert the entity's data to a Parquet file? 

Also wanted to check a way to automatically identify the newly created table and create the parquet file of the data.


Expectation - Every entity's data should be extracted into a parquet file and posted to S3. Every new table created should automatically be a part of this data extraction.

2022-01-13 11-06-04
Neha Sheikh
Champion

Hello Divya,

Converting entity data to parquet file , I don't know if we can do this directly.

A work around can be, you can download the data and create your own code in .NET for converting that to parquet file.

Then you can use this forge component to upload and download the parquet file. 


2019-09-13 11-11-15
Divya Nayak

Hello Neha,  Thanks for your quick response.

You are correct we don't have a direct way to get it converted.  
I am on my way to creating .net code.  

2023-02-09 12-36-42
Damian Fonville

Hi, you could try to create an extension with the nuget package https://www.nuget.org/packages/Parquet.Net 

Possible you have to set the target framework to 4.8 in the extension 

2019-09-13 11-11-15
Divya Nayak

Hello Damian, Thanks for your quick response.

Yup, I am on my way to create the extension. I will include this nugget package.

UserImage.jpg
Sam Riggleman

@Divya Nayak I'm looking to similarly upload Outsystems data to a parquet file for analytics purposes, did you succeed?

Community GuidelinesBe kind and respectful, give credit to the original source of content, and search for duplicates before posting.