You can't use this until you register with us!




Description

Read data from files in an FTP server and store it in a MySQL database.


Purchasing Options



Available Actions

Load

Read data from files in an FTP server folder and store it in a table in a MySQL database.


Variables

Source Parameters
ftp_connection required

Credentials to use to access the FTP Server.

folder_path

Path to the folder containing files to load.

process_subfolders required

Enable to load files within subfolders under the Source Folder.

files_lookback

Number of load records to examine, from most recent and going backwards, when comparing to determine which files have not yet been loaded. If no value is specified, all load records will be examined.

process_increment required

Number of files to include in each load.


File format Parameters
format_type required

Format of the data in the files to load.

skip_rows

Number of rows to ignore at the beginning of files with delimited data format.

delimiter

Character used to separate data values in files with delimited data format.

quote_char

Specify the character used to enclose string data values in files with delimited data format.

null_value

Characters used to represent a null value in files with delimited data format.

escape_char

Character used to represent an escaped value in files with delimited data format.

line_terminator

Characters used to represent the end of a line in files with delimited data format.


Destination Parameters
mysql_connection required

MySQL database where the data from the files will be loaded.

target_table_name required

Table name, in schema.table format, where the data from the files will be stored.

source_file_column required

Column within the Target Table where the path to the file that was the source of the data will be stored.

fields_mapping required

Mapping between the source file columns or JSON paths and MySQL columns.