Data Mechanics

Data Mechanic's platform automatically tunes the infrastructure parameters and the Spark configuration of periodic workloads and reacts to changes in the code and the data.

Data Mechanics platforms plugs into cloud infrastructure and watches over the logs produced by periodic Spark applications. They use the information to recommend parameters that would best improve application stability and performance. The scheduling logic reads these recommendations and propagates them into the infrastructure.

The platform helps to maintain performant and stable pipelines, alleviating the maintenance that would be necessary for dozens to thousands of jobs.