This component provides a robust and efficient solution for integrating your OutSystems applications with Google Cloud BigQuery. It streamlines the process of performing large-scale, batch data loads using a cost-effective method that leverages Google Cloud Storage and BigQuery's free-tier loading capabilities.
The core functionality allows you to upload JSON array files to a specified Google Cloud Storage Bucket. The component then automatically processes these files in bulk, creating the necessary datasets and tables in BigQuery on the fly if they don't already exist.
In addition to its powerful data loading features, the component also provides essential service actions to interact with your BigQuery project, including executing queries, listing datasets, and managing tables.
Automated Batch Loading: Process large JSON files from Google Cloud Storage and load them into BigQuery efficiently.
Automatic Schema Detection: Automatically creates datasets and tables in BigQuery based on your file structure, simplifying setup.
Cost-Effective: Utilizes BigQuery's free batch loading jobs, making it ideal for large-scale data ingestion without incurring high costs.
Direct Query Execution: Run simple or complex SQL queries directly against your BigQuery data from OutSystems.
Full Data Management: Includes actions to list your existing datasets and tables.
Storage Bucket Control: Provides functionalities to list, download, and delete files from your designated Google Cloud Storage bucket.
To ensure a smooth and user-friendly experience, the component comes bundled with a comprehensive management application that allows you to:
Configure & Authenticate: Easily set up your Google Cloud Project ID, Service Account credentials, and bucket details.
Test End-to-End: Send test JSON files to a specified dataset and table to verify the entire process.
Monitor Jobs: Track the status of active and processed files with a detailed monitoring dashboard.
Manage Storage: Directly view and manage the files within your connected Google Cloud Storage bucket.
Explore Data: List all available datasets and tables within your project and execute queries directly from the app.
This component is the perfect accelerator for any OutSystems project requiring powerful, scalable, and manageable integration with Google BigQuery.