Adding and Managing LLMs
Last updated
Last updated
Administrators can add large language models (LLMs) to their Ango Hub organizations. This allows users to interact with and prompt the LLM live through Ango Hub, on . Messages in conversations with these LLMs, then, can be individually annotated with the .
Navigate to the organization where you would like to add the LLM, and enter the Organization page.
Enter the LLMs tab. You will see a list of LLMs which have been added to the organization.
To add a new LLM, click on the Add LLM button. A dialog will appear.
From your OpenRouter dashboard, click on your profile picture, then on "Keys":
Click on "Create Key". A new key will be created. Copy it and paste it into the "New LLM" dialog:
Name: The name you wish your LLM to have. Provider: This must be OpenRouter unless iMerit specified otherwise. Model: You may pick from this list any one of the models available through OpenRouter, including Llama, ChatGPT, Claude, DeepSeek, and many others. API Secret: The API key from OpenRouter. Follow the instructions in the for information on how to obtain it. Streamable: If you enable this toggle, the answer from the LLM will come in streaming, rather than all at once. This allows the user to start reading the answer before it's fully formed, potentially improving TPT.
