Back to AI Tools
LMDeploy
Open Sourceby InternLM / Shanghai AI Lab
4.5(0 ratings)
Best For
About LMDeploy
Open-source LLM serving toolkit by InternLM.
Toolkit for compressing & serving LLMs (KV quantization, blocked KV cache, batching, TP).
Tool Information
- License
- Open Source
- Type
- Cost
- Free (OSS)
- Released
- 2025
- Supported Languages
- Python, C/C++
Key Capabilities
Prompts for LMDeploy
Similar Tools
Works Well With
Curated combinations that pair nicely with LMDeploy for faster experimentation.
We're mapping complementary tools for this entry. Until then, explore similar tools above or check recommended stacks on challenge pages.