huihui-ai/Huihui-MiniCPM-V-4_5-abliterated Image-Text-to-Text • 9B • Updated Sep 8, 2025 • 2.11k • 32
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF Text Generation • 12B • Updated Jun 19 • 327k • 2.75k
view post Post 5363 smolagents now support vLLM! 🥳As one of the most popular local inference solutions, the community had been asking us to integrate vLLM: after a heavy refactoring of our LLM classes, we've just released smolagents 1.11.0, with a brand new VLLMModel class.Go try it and tell us what you think!https://github.com/huggingface/smolagents/blob/45b2c86857b7f7657daaa74e4d17d347e9e2c4a4/src/smolagents/models.py#L497 See translation 🤗 10 10 🔥 5 5 😎 4 4 👍 1 1 🚀 1 1 + Reply