Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 15 additions & 1 deletion openhands/usage/llms/litellm-proxy.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -14,9 +14,23 @@ To use LiteLLM proxy with OpenHands, you need to:
* `Base URL` to your LiteLLM proxy URL (e.g. `https://your-litellm-proxy.com`)
* `API Key` to your LiteLLM proxy API key

Here's an example profile configured for a LiteLLM proxy model:

![LiteLLM proxy LLM profile configuration in OpenHands](./screenshots/litellm-proxy-profile-configuration.png)

## Supported Models

The supported models depend on your LiteLLM proxy configuration. OpenHands supports any model that your LiteLLM proxy
is configured to handle.

Refer to your LiteLLM proxy configuration for the list of available models and their names.
For the model names and providers LiteLLM can route, see the [LiteLLM model catalog](https://models.litellm.ai/).
Your OpenHands configuration should use the model name exposed by your LiteLLM proxy.

## Helpful LiteLLM Docs

For common next steps after setup, these LiteLLM docs are especially useful:

- [View supported providers and model names](https://models.litellm.ai/)
- [View usage and spend metrics](https://docs.litellm.ai/docs/proxy/metrics)
- [View proxy request logs in the LiteLLM UI](https://docs.litellm.ai/docs/proxy/ui_logs)
- [Debug proxy issues](https://docs.litellm.ai/docs/proxy/debugging)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading