sohu-mptc / FlashRec

git clone https://github.com/sohu-mptc/FlashRec.git

FlashRec is a CUDA-graph engine for generative recommendation: wide beam search (3–5 SID steps, n=50–512+) over a trie-constrained catalog, in-process FP8 serving, and ranked beams on /v1/chat/completions.