Pinned Loading

1. LMCache/LMCache LMCache/LMCache Public

   Making Long-Context LLM Inference 10x Faster and 10x Cheaper

   Python 286 32

2. KuntaiDu/dds KuntaiDu/dds Public

   Server-driven Video Streaming for Deep Learning Inference

   Python 84 32

3. LMCache/lmcache-vllm LMCache/lmcache-vllm Public

   The driver for LMCache core to run in vLLM

   Python 13 13

4. stanford-ppl/caravan-ai stanford-ppl/caravan-ai Public

   [OSDI '24] Caravan: Agent-Based Generative Data Labeling

   Python 2

5. KuntaiDu/AccMPEG KuntaiDu/AccMPEG Public

   Jupyter Notebook 28 6

6. myh264 myh264 Public

   [MLSys '22 artifact] an incremental x264 video encoder for video analytics

   C 7 4