Patent attributes
A device automatically extracts a data file from an upstream source based on ingestion parameters. The data file is in a first format that is not readable by a downstream data analysis utility and includes a plurality of data records. Each record includes one or more entries. The ingestion parameters include a file identifier, validation criteria, transformation instructions, and storage instructions for the extracted data file. The device generates table(s) based on the extracted data file by, determining, based on the validation criteria, whether the record is permitted to be ingested. The device determines, based on the transformation instructions, a table in which to store each entry and a row and column of the determined table in which to store the entry. Entries are input into the determined tables, rows, and columns. The table(s) are stored in a second format that is readable by the downstream data analysis utility.
