You can't use this until you register with us!




Description

Execute a SQL Script against a BigQuery database and store the results in an S3 Bucket.


Purchasing Options



Available Actions

Download Data with Datetime Parameters

Export data from a BigQuery Data Warehouse to an S3 Bucket using an SQL Query and date range parameters specified.


Variables

Source Parameters
target_db required

Credentials to use to access the BigQuery Cloud Data Warehouse.

sql_steps required

SQL Query to run.

user_params

Parameters to use in your SQL Query, if any. Refer to slide out help for more information.


Range Parameters
range_start_point required

Datetime stamp where the processing of your sequentially sorted data should begin. This field will automatically be updated after each increment is processed.

range_data_offset

Fixed amount to adjust the Next Run Start Point.

range_end_point

Datetime stamp where the processing of your sequentially sorted data should end. Leave this field blank to process all records with a Datetime stamp after the starting point.

range_end_point_query

SQL Query to use to determine the end point of the data to process. Leave this field blank to process all records with a Datetime stamp after the starting point.

process_increment required

This Task will process your data in increments. Set a value in this field to determine the size of each increment.


Destination Parameters
aws_config required

Select the AWS Access Keys to use to access the S3 bucket where the data will be stored.

s3_bucket_config required

Select the Shared Config that contains information about the S3 Bucket where the data will be stored.

s3_folder_path

Path from the starting folder in the S3 Bucket Configuration to the folder where the data will be stored.

file_name required

Name for the file containing the downloaded data.

append_date

Enable to append the creation date to the file name.

allow_overwrite

Enable to allow an existing file with the same name in the Target Folder to be overwritten.


File Parameters
format_type required

Format applied to the downloaded data.

delimiter

For Delimited format, character used to separate columns. Default is tab.

escape

Character used to initiate character escape sequences. Default is backslash.

null_as

String used to indicate a null value. Default is nothing.

add_quotes

For Delimited format, wrap strings in quotes. Recommended for source data containing double quotes or the delimiter character.


Download Data with Integer Parameters

Export data from a BigQuery Data Warehouse to an S3 Bucket using an SQL Query and integer range parameters specified.


Variables

Source Parameters
target_db required

Credentials to use to access the BigQuery Cloud Data Warehouse.

sql_steps required

SQL Query to run. Statements are separated by a semicolon.

user_params

Parameters to use in your SQL Query, if any. Refer to slide out help for more information.


Range Parameters
range_start_point required

Integer where the processing of your sequentially sorted data should begin. This field will automatically be updated after each increment is processed.

range_end_point_query required

SQL Query to use to determine the end point of the data to process.

process_increment required

This Task will process your data in increments. Set a value in this field to determine the size of each increment.


Destination Parameters
aws_config required

Select the AWS Access Keys to use to access the S3 bucket where the data will be stored.

s3_bucket_config required

Select the Shared Config that contains information about the S3 Bucket where the data will be stored.

s3_folder_path

Path from the starting folder in the S3 Bucket Configuration to the folder where the data will be stored.

file_name required

Name for the file containing the downloaded data.

append_date

Enable to append the creation date to the file name.

allow_overwrite

Enable to allow an existing file with the same name in the Target Folder to be overwritten.


File Parameters
format_type required

Format applied to the downloaded data.

delimiter

For Delimited format, character used to separate columns. Default is tab.

escape

Character used to initiate character escape sequences. Default is backslash.

null_as

String used to indicate a null value. Default is nothing.

add_quotes

For Delimited format, wrap strings in quotes. Recommended for source data containing double quotes or the delimiter character.