📈 GH Trending Explorer 🎲 Surprise me

Search: safetensors · clear

lutzroeder / netron

Visualizer for neural network, deep learning and machine learning models

▲ ~21/7d ★ 34k JavaScript today
Jit-Roy / WeeLLM

WeeLLM runs large diffusion models with as little as 4 GB of VRAM, without any quantization. It dynamically determines how many layers can fit within the available VRAM and streams the text encoder and transformer layers to the GPU layer by layer, enabling inference on hardware with limited VRAM. It supports both safetensors and GGUF models.

▲ ~21/7d ★ 117 Python 4d ago
truespar / paddock

Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

▲ ~5/7d ★ 138 Rust 1d ago
mattn / tensai

A tiny neural-network framework in pure Go with AVX2 SIMD kernels (GOEXPERIMENT=simd)

▲ ~2/7d ★ 115 Go 15d ago
av / harbor

Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.

▲ ~0/7d ★ 3.2k Python 3d ago
cloudpayload / chatpin

Chatpin puts your AI’s chat template under inspection and lock. Compare it with the publisher’s original, flag suspicious conditional logic, and pin the version you trust so unexpected changes fail CI before deployment. Built for GGUF and safetensors workflows. Your model has a chat template. Give it a tamper alarm.

▲ ~0/7d ★ 58 Python 1mo ago
harshitkhandelwal208 / hk

Local LLMs that run lean, load instantly and keep getting smarter. A from-scratch runtime + model format in Zig: zero-copy mmap, CPU/CUDA/Vulkan engines, OpenAI-compatible server, 2:4 sparsity, Net2Net growth, in-file version history, self-learning loops.