You can't use this until you register with us!




Description

Read content from multiple files and store it as one or more merged files.



Available Actions

Merge Files

Read the content from multiple files in one S3 bucket path and store it as one or more merged files in a different S3 bucket path.


Variables

Source Parameters
s3_bucket_connection required

Examine files in this S3 Bucket location for potential merging.

source_s3_path

Folder path from the Folder Path Prefix in the Source S3 Bucket Connection to the folder with files to merge.

merge_value required

Files older than the number of days specified in this field will be included for potential merge, determined by the last modified date of the file.

format required

Specify the format of the data in the source files. The resulting merged data will have the same format.

delete_files_merged

If enabled, source files that were successfully merged will be deleted.


Destination Parameters
target_s3_bucket_connection required

Merged files will be placed this S3 Bucket location.

target_s3_path

Folder path from the Folder Path Prefix in the Destination S3 Bucket Connection to the folder where the merged files will be created.

merged_filename required

Select the way in which the merged file names should be created.

max_file_size required

Specify the maximum file size, in MB, of the newly created merged files.

allow_overwrite

If enabled, files in the merge destination with the same path and name will be overwritten.