apache / spark

Apache Spark - A unified analytics engine for large-scale data processing

broadinstitute / cromwell

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments