You can't use this until you register with us!

Description

Read data from a PostgreSQL database and load it into a BigQuery database.

Purchasing Options

PostgreSQL to BigQuery Loader - $99.99 / month

Available Actions

Run SQL Query with Date Parameters

Execute an SQL Query on a datetime bounded range of data in a PostgreSQL database and store the results in a table in a BigQuery database.

Variables

Source Parameters
source_db required

Select the PostgreSQL database where the query will be executed to find data to load.

sql_query required

SQL Query to run. Only one SQL step is allowed.

user_params

Parameters to use in your SQL Query, if any. Refer to slide out help for more information.


Destination Parameters
big_query_connection required

Credentials to use to access the BigQuery Cloud Data Warehouse.

project_id required

Specify the unique identifier of the Google Cloud project that contains the dataset where the data will be loaded.

dataset required

Specify the name of the dataset that contains the table where the data will be loaded.

bigquery_table required

Specify the name of the table where the data will be loaded.

region

Optionally specify the region where the dataset is located.

create_dataset_if_not_exists

Enable to create the specified dataset if it does not exist.

load_params required

Select the Shared Config that contains the load options and the column definitions for the data that will be loaded.


Range Parameters
range_start_point required

Datetime stamp where the processing of your sequentially sorted data should begin. This field will automatically be updated after each increment is processed.

end_point_query

SQL Query to use to determine the end point of the data to process.

buffer

Fixed amount to adjust the Next Run Start Point.

increment required

This Task will process your data in increments. Set a value in this field to determine the size of each increment.


Run SQL Query with Integer Parameters

Execute an SQL Query on an integer bounded range of data in a PostgreSQL database and store the results in a table in a BigQuery database.

Variables

Source Parameters
source_db required

Select the PostgreSQL database where the query will be executed to find data to load.

sql_query required

SQL Query to run. Only one SQL step is allowed.

user_params

Parameters to use in your SQL Query, if any. Refer to slide out help for more information.


Destination Parameters
big_query_connection required

Credentials to use to access the BigQuery Cloud Data Warehouse.

project_id required

Specify the unique identifier of the Google Cloud project that contains the dataset where the data will be loaded.

dataset required

Specify the name of the dataset that contains the table where the data will be loaded.

bigquery_table required

Specify the name of the table where the data will be loaded.

region

Optionally specify the region where the dataset is located.

create_dataset_if_not_exists

Enable to create the specified dataset if it does not exist.

load_params required

Select the Shared Config that contains the load options and the column definitions for the data that will be loaded.


Range Parameters
range_start_point required

Integer where the processing of your sequentially sorted data should begin. This field will automatically be updated after each increment is processed.

end_point_query

SQL Query to use to determine the end point of the data to process.

increment required

This Task will process your data in increments. Set a value in this field to determine the size of each increment.