Execute a SQL Script against a BigQuery database and store the results in an S3 Bucket.
Export data from a BigQuery Data Warehouse to an S3 Bucket using an SQL Query and date range parameters specified.
Variables
Credentials to use to access the BigQuery Cloud Data Warehouse.
SQL Query to run.
Parameters to use in your SQL Query, if any. Refer to slide out help for more information.
Datetime stamp where the processing of your sequentially sorted data should begin. This field will automatically be updated after each increment is processed.
Fixed amount to adjust the Next Run Start Point.
Datetime stamp where the processing of your sequentially sorted data should end. Leave this field blank to process all records with a Datetime stamp after the starting point.
SQL Query to use to determine the end point of the data to process. Leave this field blank to process all records with a Datetime stamp after the starting point.
This Task will process your data in increments. Set a value in this field to determine the size of each increment.
Select the AWS Access Keys to use to access the S3 bucket where the data will be stored.
Select the Shared Config that contains information about the S3 Bucket where the data will be stored.
Path from the starting folder in the S3 Bucket Configuration to the folder where the data will be stored.
Name for the file containing the downloaded data.
Enable to append the creation date to the file name.
Enable to allow an existing file with the same name in the Target Folder to be overwritten.
Format applied to the downloaded data.
For Delimited format, character used to separate columns. Default is tab.
Character used to initiate character escape sequences. Default is backslash.
String used to indicate a null value. Default is nothing.
For Delimited format, wrap strings in quotes. Recommended for source data containing double quotes or the delimiter character.
Export data from a BigQuery Data Warehouse to an S3 Bucket using an SQL Query and integer range parameters specified.
Variables
Credentials to use to access the BigQuery Cloud Data Warehouse.
SQL Query to run. Statements are separated by a semicolon.
Parameters to use in your SQL Query, if any. Refer to slide out help for more information.
Integer where the processing of your sequentially sorted data should begin. This field will automatically be updated after each increment is processed.
SQL Query to use to determine the end point of the data to process.
This Task will process your data in increments. Set a value in this field to determine the size of each increment.
Select the AWS Access Keys to use to access the S3 bucket where the data will be stored.
Select the Shared Config that contains information about the S3 Bucket where the data will be stored.
Path from the starting folder in the S3 Bucket Configuration to the folder where the data will be stored.
Name for the file containing the downloaded data.
Enable to append the creation date to the file name.
Enable to allow an existing file with the same name in the Target Folder to be overwritten.
Format applied to the downloaded data.
For Delimited format, character used to separate columns. Default is tab.
Character used to initiate character escape sequences. Default is backslash.
String used to indicate a null value. Default is nothing.
For Delimited format, wrap strings in quotes. Recommended for source data containing double quotes or the delimiter character.