S3 File Merger

Read content from multiple files and store it as one or more merged files.

Merge Files

Read the content from multiple files in one S3 bucket path and store it as one or more merged files in a different S3 bucket path.

Variables

Source Parameters

source_aws_token_connection required

Select the AWS Access Keys to use to access the S3 bucket containing the files to merge.

source_s3_bucket_config required

Select the Shared Config that contains information about the S3 Bucket containing the files to merge.

source_s3_path

Folder path from the Folder Path Prefix in the Source S3 Bucket Connection to the folder with files to merge.

last_modifed_age required

Files older than the number of days specified in this field will be included for potential merge, determined by the last modified date of the file.

delete_files_merged

If enabled, source files that were successfully merged will be deleted.

Destination Parameters

target_aws_token_connection required

Select the AWS Access Keys to use to access the S3 bucket where the merged files will be created.

target_s3_bucket_config required

Select the Shared Config that contains information about the S3 Bucket where the merged files will be created.

target_s3_path

Folder path from the Path Prefix in the Destination S3 Bucket Configuration to the folder where the merged files will be created.

merged_filename required

Select the way in which the merged file names should be created.

max_file_size required

Specify the maximum file size, in MB, of the newly created merged files.

allow_overwrite

If enabled, files in the merge destination with the same path and name will be overwritten.

Dynamic Parameters

user_params

Values specified will replace any {{ }} specified in other parameters on this task. Refer to slide out help for more information.

You can't use this until you register with us!