llm-d / llm-d
State of the art inference performance with modern accelerators on Kubernetes
llm-d / llm-d
Sheltercosmo / Rilldex-RL-Studio
RL observability for LLM agents: behavior maps, native trainer metrics, rollout investigations, and Python/SQL analysis.
eugr / spark-vllm-docker
Docker configuration for running VLLM on dual DGX Sparks
llm-d / llm-d-router
llm-d Router: The intelligent entry point for inference requests
scadastrangelove / awesome-ai-security-tools
A curated list of public-source, research, and commercial tools for AI security and AI-assisted cybersecurity — autotriage, agent security, AI/ML supply chain, pentest agents, AI SAST, LLM-driven fuzzing, threat intelligence, SOC/SIEM triage, reverse engineering, LLM red-teaming, and more.
harshaneel / humanize
Best static AI text humanizer. Two research-grounded LLM-agnostic skills that make AI writing sound human and relatable. Nine levers, 50+ peer-reviewed sources, 2024-2026 detection literature.
chen-006 / meow-llm-detector
用于检测ai模型是否真实
chrisliu298 / awesome-on-policy-distillation
A curated collection of papers, technical reports, frameworks, and tools for on-policy distillation (OPD) of large language models
cracken-ai / blacksea
Blacksea is an active honeypot and canary-bait control system built to detect and drown LLM-driven attackers. Blacksea doesn't stop at watching LLM attacks. It exploits flaws in the attacker's LLM judgment to gain arbitrary code execution on their machines, collect intel passive defenses can't reach, and make sure they don't come back.
rashakil-ds / Roadmap-Docs
Best Data Science, Data Analytics, AI, and SDE roadmaps. This repository is continually updated based on the top job postings on LinkedIn and Indeed in the data science and AI domain.
NVIDIA-NeMo / Curator
Scalable data pre processing and curation toolkit for LLMs
onllm-dev / onWatch
Track AI API quotas across Synthetic, Z.ai, Anthropic (Claude Code), Codex, GitHub Copilot & Antigravity in real time. Lightweight background daemon (<50MB RAM), SQLite storage, Material Design 3 dashboard. Zero telemetry.
Zipstack / unstract
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
lotus-data / lotus
Optimized Agentic and LLM Bulk Processing Over Your Data
intentee / paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
n0qword / mythic_ornn
LLM-driven generator for Mythic Agents, Payload-Type and C2 Profiles.
axem-solutions / shaide
Self-hosted, distributed, multi-model LLM inference
llm-d-incubation / llm-d-semantic-classifier
—
MiaAI-Lab / Qwen3.8-Flash-Next-Dual-DGX-Sparks
Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark
iDC-NEU / YiGraph
YiGraph is an LLM-driven agent for autonomous Graph Data Analytics based on Analytics-Augmented Generation. 易图（YiGraph）是一套基于 AAG（分析增强生成）框架构建的图分析智能体系统，致力于挖掘数据之间的关联关系，释放数据价值。
pyq623 / QuaNAG
Official implementation of QuaNAG: LLM-driven Memory-bounded Neural Architecture Generation via Quantization-branched Exploration
sd4494093 / hybrid-llm-domain-specific-rag
—
Sparrow-Co-Ltd / SecLLM-Dataset
Static-analysis-based dataset for training LLMs to detect, explain, and patch security vulnerabilities (Java, Korean/English annotations, verified patches).