Back to AI Tools

LMDeploy

Open Source

by InternLM / Shanghai AI Lab

4.5(0 ratings)
Visit WebsiteGitHub

Best For

About LMDeploy

Open-source LLM serving toolkit by InternLM.

Toolkit for compressing & serving LLMs (KV quantization, blocked KV cache, batching, TP).

Tool Information

License
Open Source
Type
Cost
Free (OSS)
Released
2025
Supported Languages
Python, C/C++

Key Capabilities

Prompts for LMDeploy

Similar Tools