Use the models on your own gateway

Choose a model, draft a response, or turn text into vectors while checking the limits available to your key.

What to Ask Leina to Do with LiteLLM

Copy a prompt, add your details, and send it to Leina in your connected team chat.

Ask available models to summarize notes or draft a reply.

List my available models, then use [model] to summarize these notes and draft a customer reply: [notes].

Create embeddings for text comparison or a downstream search workflow.

Use [embedding model] to generate vectors for these passages: [text].

Compare model capabilities and pricing, then inspect the key’s remaining budget.

Show the context limits and prices of my chat models, then report the spend and remaining budget for this key.

Get Started with LiteLLM

  1. Connect Your Account

    Connect a publicly reachable gateway with a LiteLLM key.

  2. Try a Task

    Tell Leina what you need in your team chat. Include the source, destination, and expected result.

    Set Up Leina in Your Chat →
  3. Check the Result

    Review the result and any changes in the connected app.

Supported LiteLLM Capabilities

Connect your LiteLLM gateway to use chat and message models, generate embeddings, compare model capabilities and prices, and inspect key spending.

Generate content and vectors

Call chat, message, and embedding models.

Inspect model access and budgets

Read model names, capabilities, pricing, and virtual-key spending.

View All 6 Actions
  • Create Chat Completion
  • Create Message
  • Create Embedding
  • List Models
  • Get Model Info
  • Get Key Info

Visit Provider Website ↗

Frequently Asked Questions

Can I use a master key?

Yes for inference and model queries. Use a virtual key to inspect its stored budget record.

Your AI employee for LiteLLM

Tell Leina what you need in your team chat. Include the source, destination, and expected result.