seaweedfs / seaweedfs
Distributed file and object storage system that serves S3, POSIX file system, and Iceberg/Lance table access from one Go binary.
seaweedfs / seaweedfs
dmlc / xgboost
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
apache / ozone
Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
HariSekhon / DevOps-Bash-tools
1200+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
apache / calcite
Apache Calcite
apache / nutch
Apache Nutch is an extensible and scalable web crawler
wgzhao / Addax
Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.
linkedin / venice
Venice, Derived Data Platform for Planet-Scale Workloads.
APIJSON / APIJSON
🏆 Real-Time no-code, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and Frontend(Client) can customize response JSONs 🏆 实时 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构
prestodb / presto
The official home of the Presto distributed SQL query engine for big data
apache / hadoop
Apache Hadoop
deeplearning4j / deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
apache / hive
Apache Hive
treeverse / lakeFS
lakeFS - Data version control for your data lake | Git for data
apache / ignite
Apache Ignite
RayXBuilds / Movie_Recommend
历史学习项目：Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。
apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
apache / ambari
Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.
apache / atlas
Apache Atlas - Open Metadata Management and Governance capabilities across the Hadoop platform and beyond
apache / drill
Apache Drill is a distributed MPP query layer for self describing data
elastic / elasticsearch-hadoop
:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop
apache / carbondata
High performance data store solution
apache / orc
Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
Esri / geometry-api-java
The Esri Geometry API for Java enables developers to write custom applications for analysis of spatial data. This API is used in the Esri GIS Tools for Hadoop and other 3rd-party data processing solutions.
AbsaOSS / spline
Data Lineage Tracking And Visualization Solution
apache / tez
Apache Tez