Loading Data
Setup
Loading data to your infrastructure
Snowplow uses components like rdb-loader and bigquery-loader to load data and maintain and evolve table schemas.
While we decided to fork and maintain loading companents that migrated to Snowplow License we must recognize today that any decent database is perfectly capable of ingesting JSON and Parquet files. Long-term we see no reason to maintain these components.
Check out our data loading instructions using AWS Data Firehose.
Resources:
- AWS Firehose JSON to S3
- Google Cloud Pub-Sub to BigQuery
- Snowflake Snowpipe