Pinned Loading

1. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Cuda 1.5k 142

2. apache/tvm apache/tvm Public

   Open deep learning compiler stack for cpu, gpu and specialized accelerators

   Python 11.8k 3.5k

3. uwsampl/SparseTIR uwsampl/SparseTIR Public

   SparseTIR: Sparse Tensor Compiler for Deep Learning

   Python 131 14

4. mlc-ai/mlc-llm mlc-ai/mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 19.2k 1.6k

5. dmlc/dgl dmlc/dgl Public

   Python package built to ease deep learning on graph, on top of existing DL frameworks.

   Python 13.6k 3k

6. punica-ai/punica punica-ai/punica Public

   Serving multiple LoRA finetuned LLM as one

   Python 989 46