Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Simple Linux Panel
NoSQL Redis and Memcache traffic generation and benchmarking tool.
A comprehensive, fast, pure-Python memcached client.
Rate limiting using various strategies and storage backends such as redis, memcached & mongodb