Open Ango HubContact iMerit

Adding and Managing LLMs

Currently, for all users, only OpenRouter API keys can be used to add LLMs to Ango Hub.

Paid iMerit customers may, by contacting us here, request the integration of their own private LLM for fine-tuning, chain-of-prompting, real-time training, moderation, and many other possible workflows.

LLMs may not be added or managed this way in private cloud and on-premise deployments of Ango Hub.

LLMs may still be part of projects in Ango Hub as plugins, but they may not be integrated with Ango Hub from the LLMs tab, and they may not be interacted with in LLM Chat-type assets.

Administrators can add large language models (LLMs) to their Ango Hub organizations. This allows users to interact with and prompt the LLM live through Ango Hub, on LLM Chat-type assets. Messages in conversations with these LLMs, then, can be individually annotated with the Message-type tool.

Adding a LLM

Navigate to the organization where you would like to add the LLM, and enter the Organization page.

Enter the LLMs tab. You will see a list of LLMs which have been added to the organization.

To add a new LLM, click on the Add LLM button. A dialog will appear.

Adding OpenRouter LLMs

Currently, this is the only option to add LLMs for non-paid iMerit customers.

Name: The name you wish your LLM to have. Provider: This must be OpenRouter unless iMerit specified otherwise. Model: You may pick from this list any one of the models available through OpenRouter, including Llama, ChatGPT, Claude, DeepSeek, and many others. API Secret: The API key from OpenRouter. Follow the instructions in the section below for information on how to obtain it. Streamable: If you enable this toggle, the answer from the LLM will come in streaming, rather than all at once. This allows the user to start reading the answer before it's fully formed, potentially improving TPT.

Obtaining the OpenRouter API Key

From your OpenRouter dashboard, click on your profile picture, then on "Keys":

Click on "Create Key". A new key will be created. Copy it and paste it into the "New LLM" dialog:

PreviousStage HistoryNextStorages

Last updated