Patent attributes
Provided is an architecture for creation and management of data pipelines. A user action designer tool renders a user interface on a user device and records user actions performed on the user interface. The user actions include selection of pipeline stages to be included in a data pipeline and selection of a technology for each pipeline stage. A pipeline definition for the data pipeline is generated based on the user actions. A user action script compiler generates a user action script based on the pipeline definition. An orchestrator communicates sections of the user action script to gentech script generators. Each gentech script generator generates a set of gentech scripts. Each set of gentech scripts is communicated to an interpreter for the technology selected for a corresponding pipeline stage. Each pipeline stage is executed by a corresponding technology based on technology-specific scripts generated by a corresponding technology-specific interpreter.
