LLM Chat Labeling Editor
Overview of the text labeling editor in Ango Hub
Last updated
Overview of the text labeling editor in Ango Hub
Last updated
This feature is currently in the alpha testing phase and not yet fully featured for general production projects.
For example, the following are a number of key features currently missing:
Importing existing conversations
Ability to integrate with your own LLM (the current alpha uses a test version of ChatGPT)
Regenerating answers
Editing messages
Embedding images in messages
and more.
Ango Hub provides a labeling editor with which users can have live conversations with LLMs, and with which existing LLM conversations can be annotated.
The LLM Chat Labeling Editor is opened when a user opens a LLM Chat-type asset. For more information on how to create and/or import such assets, please read this docs page.
This article will exclusively go over Ango Hub’s LLM Chat labeling interface. Features common to all labeling editors (audio, image, PDF, and text) are instead explained here.
As outlined in the docs page on creating LLM Chat-type assets, there are two possible types of LLM Chat assets: "pre-existing" and "live" conversations.
Pre-existing conversations are conversations which already happened outside of the Ango Hub platform and you import them to be annotated.
Live conversations start empty, and the annotator has a live conversation with your LLM directly from Ango Hub.
Once the LLM Chat-type assets have been created, if they are empty (of the "live" type), when the user enters the asset, they will be greeted with an empty message UI:
To prompt the LLM, enter your text in the text area labeled Enter prompt here... and hit Enter or the Send button. The LLM will receive your prompt and answer.
Regardless of whether the chat is a pre-existing one or a live one, from the Tools section on the left-hand side of the screen, select a Message-type tool. Then, click on the chat message you would like to classify. The classifications that have been nested under the Message-type tool will appear, and you will be able to answer them.
Click on Save or Submit when you are done.