You can't use this until you register with us!




Description

Read data from a DynamoDB database and store it in an S3 bucket.


Purchasing Options



Available Actions

Download Data

Read the specified attributes from records and store it in JSON format in files on S3.


Variables

Source Parameters
ddb_aws_connection required

AWS Access Keys to use to access the DynamoDB database.

table_name required

Name of the DynamoDB table where the data exists.

pointer required

Date and time where the download should begin. Only data created or updated after this date will be downloaded. This field will automatically be updated after each download file is created.

pointer_key required

Item attribute that holds a datetime value and can be used with Next Run Start Point to identify new items to process.

projection_expression required

List of item attributes to download. Multiple attributes should be separated by commas. Attributes with the same name as a reserved word should be specified using a substitute word that begins with an octothorpe.

expression_attribute_names

Key Value JSON dictionary used to replace substitute words in the Projection Expression field with reserved words that can't be specified directly.


Destination Parameters
s3_aws_connection required

Select the AWS Access Keys to use to access the S3 bucket where the data will be stored.

s3_bucket_config required

Select the Shared Config that contains information about the S3 Bucket where the data will be stored.

s3_folder_path

Path from the starting folder in the S3 Bucket Configuration to the folder where the data will be stored.

add_processed_column

Add an attribute in each item recording the datetime (in UTC format) when it was downloaded.

allow_overwrite

Enable to allow an existing file with the same name in the Target Folder to be overwritten.


Download Stream Data

Read the specified attributes from a Dynamo DB stream and store it in JSON format in files on S3.


Variables

Source Parameters
ddb_aws_connection required

AWS Access Keys to use to access the DynamoDB database.

table_name required

Name of the table with the data to download.

stream_arn required

Amazon Resource Name for the stream with the data to download.

shard_tracking_config

Next run starting point for each shard. Stored as a key and value JSON dictionary.


Destination Parameters
s3_aws_connection required

Select the AWS Access Keys to use to access the S3 bucket where the data will be stored.

s3_bucket_config required

Select the Shared Config that contains information about the S3 Bucket where the data will be stored.

s3_folder_path

Path from the starting folder in the S3 Bucket Configuration to the folder where the data will be stored.

step_size

Specify the number of rows worth of data that each downloaded file should contain.

all_data

Include metadata in the data downloaded.

add_processed_column

Add an attribute in each item recording the datetime (in UTC format) when it was downloaded.

allow_overwrite

Enable to allow an existing file with the same name in the Target Folder to be overwritten.