OpenLLM is an open-source platform for running and deploying LLMs in production. It is built by BentoML
and provides an OpenAI-compatible API server with a web UI for model management.
Log in to view the POC file snapshot cached by Shenlong Bot
Log in to view