Download
An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps. Built-in supports a wide range of open-source LLMs and model runtime, including Llama 2， StableLM, Falcon, Dolly, Flan-T5, ChatGLM, StarCoder, and more. Serve LLMs over RESTful API or gRPC with one command, query via WebUI, CLI, our Python/Javascript client, or any HTTP client.
Features
- Fine-tune, serve, deploy, and monitor any LLMs with ease
- State-of-the-art LLMs
- Flexible APIs
- Freedom To Build
- Streamline Deployment
- Bring your own LLM
Project Samples
License
Apache License V2.0Follow OpenLLM
Other Useful Business Software
PRTG Catches Network Issues Before They Cause Downtime
Reactive troubleshooting usually means hearing about a problem from frustrated users, not your monitoring tool. PRTG sets threshold-based alerts across devices, servers and applications, notifying your team by email, SMS or push the moment a metric crosses a set limit. That means catching a failing disk or overloaded server before it becomes an outage and getting time back from firefighting. Start a free trial and set your first alerts today.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of OpenLLM!
