You can't use this until you register with us!




Description

Read data from files on S3 and store it in a Snowflake database.


Purchasing Options



Available Actions

Load

Read data from flat files in an S3 bucket and store it in a table in a Snowflake database.


Variables

Load Options
metadata required

Select the Shared Config that contains the source and destination information, the load options and the column definitions for the data that will be loaded.

path_date_suffix

Optionally specify a Jinja pattern to add to the end of the path in the Task Configuration to limit the subfolders examined when looking for files to load.

s3_path_date_lookback

Amount of time to generate filter paths for, if a filter pattern is specified.


Source Options
aws_connection required

Select the AWS keys with access to S3 bucket with the files that will be loaded.


Destination Options
target_db required

Snowflake database where the data will be loaded.

destination_schema required

Schema of the table in the Snowflake database where the data will be loaded.

destination_table required

Name of the table in the Snowflake database where the data will be loaded.

snowflake_skip_errors

Enable to continue processing when an error is encountered.