Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments
This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.
MLeap: Deploy ML Pipelines to Production
The Guardian’s image management system
The Guardian DotCom.