MobiInfer runs 35B-A3B-class MoE models fully on-device on the Qualcomm Hexagon NPU, streaming experts from flash with lookahead scheduling (LES) and DSpark speculation.
A permissively licensed C and C++ Task Scheduler for creating parallel programs. Requires C++11 support.
Rythe is a data-oriented C++20 game engine built to make optimal use of modern hardware.