Ango Hub Docs
Open Ango HubContact iMerit
  • Ango Hub Documentation
  • Video Guides
  • Changelog
  • FAQs & Troubleshooting
  • All Keyboard and Mouse Shortcuts
  • Core Concepts
    • Assets
    • Attachments
    • Batches
    • Benchmarks
    • Category Schema (Ontologies)
    • Frame Interpolation
    • Geofencing
    • Idle Time Detection & Time Tracking
    • Instructions
    • Issues
      • Issue Error Codes
    • Label Validation
    • Labeler Performance
    • Labeling
    • Labeling Queue
    • Multiple Classification
    • Notifications
    • Organizations
    • Projects
    • Requeuing
    • Reviewing
    • Review Queue
    • Skipping
    • Stage History
    • Tasks
    • Usage
    • User Roles
    • Workflow
      • Complete
      • Consensus
      • Hold
      • Label
      • Logic
      • Plugin
      • Review
      • Start
      • Webhook
  • Labeling
    • Managing Users in Projects
      • Profile Page
    • Managing the Project Ontology
    • Labeling Editor Interface
      • Audio Labeling Editor
      • Image Labeling Editor
      • Video Labeling Editor
      • DICOM Labeling Editor
      • Medical Labeling Editor
        • 3D Bounding Box
        • Fill Between Slices
        • Island Tools
        • Line (Tape Measure)
        • Smoothing
      • PDF Labeling Editor
      • Text (NER) Labeling Editor
      • LLM Chat Labeling Editor
      • Markdown Labeling Editor
      • 3D Multi-Sensor Fusion Labeling Editor
    • Labeling Classes
      • Tools
        • Bounding Box
        • Brush
        • Entity
        • Message
        • Nested Classifications
        • PCT
        • PDF Tool
        • Point
        • Polygon
        • Polyline
        • Rotated Bounding Box
        • Segmentation
        • Spline
        • Voxel Brush
      • Classification
        • Checkbox
        • Multiple Dropdown
        • Radio
        • Rank
        • Single Dropdown
        • Text
        • Tree Dropdown Tools (Single and Multiple Selection)
      • Relation
        • Single Relation
        • Group Relation
    • Magnetic Lasso
    • Performance & Compatibility Considerations
  • Data
    • Data in Ango Hub
      • Embedding Private Bucket Files in MD Assets
    • Importing Assets
      • Asset Builder
      • Bundled Assets
        • Importing Multiple Images as One Multi-Page Asset
        • Importing Multiple Single-Frame DICOM Files as One Multi-Page Asset
        • Importing multiple DICOM files to be annotated and displayed at once
        • Importing Multiple Single-Frame DICOM Files as a DICOM Series
        • Importing Multiple Markdown Files as One Multi-Page Asset
      • File Explorer
      • Supported Asset File Types & Codecs
      • Importing Cloud (Remote) Assets
      • Importing From Local Machine
      • Creating and Importing LLM Chat Assets
      • Importing Data in the 3D Multi-Sensor Fusion Labeling Tool
      • Bulk Importing Markdown/HTML Assets
      • Importing Attachments during Asset Import
      • Importing Annotations during Asset Import
      • contextData: Adding Extra Data to Assets
      • Importing Reference Images as Overlay
      • Importing Reference Medical Data During Asset Import
    • Importing and Exporting Annotations
      • Importing Annotations
        • Ango Import Format
        • Importing Brush Traces
        • Importing NRRD Annotations
      • Exporting Annotations
        • Ango Export Format
          • Asset
            • Task
              • Tools
              • Classifications
              • Relations
          • Stage History
    • Adding and Managing LLMs
    • Storages
      • Set up a storage integration with Azure
      • Set up a storage integration with AWS S3
      • Set up a storage integration with MinIO and S3-compatible custom storage services
      • Set up a storage integration with GCP (Google Cloud Platform)
      • Set up CORS
      • Validating Storage Integrations
    • Purging Data from Ango Hub
  • Plugins
    • Overview of Plugins in Ango Hub
      • Installing Plugins
      • Plugin Setting Presets
      • Monitoring Plugin Progress
    • First-Party Plugins
      • Ango Export Converter Plugins
      • Asset Converter Plugins
      • Ango to Mask Converter
      • Batch Assignment
      • ChatGPT
      • Column-Agnostic Markdown Generator
      • CSV Export for Classification
      • DALL-E
      • DALL-E (Model Plugin)
      • File Explorer Plugin
      • General Object Detector
      • General Object Segmenter
      • Markdown Generator
      • One-Click Segmentation
      • Open World Object Detection
      • Optical Character Recognition
      • TPT Export
      • YOLO | Instance Segmentation
      • YOLO | Pose Estimation
      • YOLO | Object Detection
      • YOLO | Image Classification
    • Plugin Developer Documentation
      • Export Plugins
      • Batch Model Plugins
      • Model Plugins
      • File Explorer Plugins
      • Markdown Generator Plugins
      • Plugin Logger
      • [WIP] Deploying your Plugin
      • Plugin 'Host' Information
  • SDK
    • SDK Documentation
      • Project Level SDK Functions
        • add_members_to_project
        • assign_batches
        • assign_task
        • create_attachment
        • create_batch
        • create_issue
        • create_label_set
        • create_project
        • delete_issue
        • export
        • exportV3
        • get_assets
        • get_batches
        • get_issues
        • get_metrics
        • get_project
        • get_project_performance
        • get_task
        • get_tasks
        • get_task_history
        • import_labels
        • list_projects
        • requeue_tasks
        • rerun_webhook
        • update_workflow_stages
        • upload_files
        • upload_files_cloud
        • upload_files_with_asset_builder
        • upload_chat_assets
      • Organization Level SDK Functions
        • create_storage
        • delete_organization_invites
        • delete_organization_members
        • delete_storage
        • get_organization_invites
        • get_organization_members
        • get_storages
        • invite_members_to_org
        • update_organization_members_role
    • SDK - Useful Snippets
    • SDK Changelog
  • API
    • API Documentation
  • How-To
    • Add Members
      • Add multiple users to a project
    • Annotate
      • Annotate 3D Point Cloud Files on Ango Hub
      • Perform targeted OCR on images
    • Export Data
      • Automatically send Ango Hub Webhook contents to Google Sheets, Email, Slack, and more with Zapier
      • Download a JSON of your project ontology
      • Download DICOM Segmentation Masks
      • Download your annotations in the COCO, KITTI, or YOLO format
      • Download your Segmentation Masks
      • Get your export as separate JSON files for each asset
    • Manage a Project
      • Get your API Key
      • Get your Organization ID
      • Mute your notifications
      • Open an asset provided the Asset ID
      • Pre-label assets
      • Share a filtered view of the Tasks table with others
      • Transfer project ontologies between projects
      • Transfer project workflows between projects
    • Perform Model Evaluation on Ango Hub
  • Troubleshooting
    • I get a "0 Tasks Labeled" alert when trying to pre-label tasks
    • I get a 'The data couldn't be loaded properly' error when opening certain assets
    • I get a "Unknown Classification" warning when opening a task
  • Feature Availability Status for projects of the 3D Multi-Sensor Fusion type
  • Comparison between QuickServe and Ango Hub
  • Changes from Ango Hub Legacy
  • Video V2 Breaking Changes and Transition
  • Data Access, Storage, and Security
  • Two-Factor Authentication
  • Single Sign-On (SSO) Support
  • Customer Support
  • Ango Hub Status Page
Powered by GitBook
On this page
  • Set Up Multiple Classifications
  • Answer Multiple Classifications
  • Importing Multiple Classifications
  • Importing Frame-Specific Multiple Classifications
  • Preventing Users from Deleting Multiple Classification Answers
  1. Core Concepts

Multiple Classification

PreviousLabeling QueueNextNotifications

Last updated 5 months ago

You can mark certain classification classes as being "Multiple". When you do so, those classifications can be answered more than once by annotators.

Set Up Multiple Classifications

From your project's dashboard, go to Settings -> Category Schema. From the Add Category dropdown, add a classification to your project. Click on it to expand it, and enable the Multiple toggle:

This classification will be marked as multiple, and annotators will be able to answer it more than once.

Answer Multiple Classifications

When labeling, if a classification has been marked as multiple, it will have a "+" sign next to it. Click on it to answer the classification more than once. You can click on the trash can next to a classification to remove it.

Importing Multiple Classifications

[
  {
    "data": "https://angohub-public-assets.s3.eu-central-1.amazonaws.com/6514e5c0-a3f1-4fd7-818f-8b1a2826107a.jpg",
    "classifications": [
      {
        "schemaId": "0e7e61deb89204036819943",
        "title": "Color",
        "answer": "Black"
      },
      {
        "schemaId": "0e7e61deb89204036819943",
        "title": "Color",
        "answer": "White"
      },
      {
        "schemaId": "0e7e61deb89204036819943",
        "title": "Color",
        "answer": "Red"
      }
    ]
  }
]

This import will provide this result:

Importing Frame-Specific Multiple Classifications

When you have a video, or an asset with multiple pages/frames, you may need to have frame-specific classifications, that is, a unique answer for each frame. You can combine frame-specific classifications and multiple classifications to have multiple, frame-specific classifications.

Here is a sample import for a video, with multiple frame-specific annotations:

[
  {
    "data": "https://angohub-public-assets.s3.eu-central-1.amazonaws.com/10c65b5f-702d-419c-83b9-bdc526008fb6.mp4",
    "classifications": [
      {
        "schemaId": "1331ff47f975d7d06e8e053",
        "objectId": "object_1",
        "tool": "radio",
        "title": "Multiple Radio",
        "answer": "1",
        "page": 1
      },
      {
        "schemaId": "1331ff47f975d7d06e8e053",
        "objectId": "object_2",
        "tool": "radio",
        "title": "Multiple Radio",
        "answer": "2",
        "page": 4
      },
      {
        "schemaId": "1331ff47f975d7d06e8e053",
        "objectId": "object_1",
        "tool": "radio",
        "title": "Multiple Radio",
        "answer": "2",
        "page": 20
      },
      {
        "schemaId": "1331ff47f975d7d06e8e053",
        "objectId": "object_2",
        "tool": "radio",
        "title": "Multiple Radio",
        "answer": "1",
        "page": 15
      }
    ]
  }
]

In the above example, we use object IDs to be able to edit different answers to the same classification.

We have only one classification class, called Multiple Radio.

On Page 1 the classification is answered once with the answer 1. On page 4, we add a new answer, and we answer with 2.

Then, on page 20, we change our first answer from 1 to 2. We are able to do this because we used the same object ID. Hub, then, knows not to add a new answer but to change the one that already exists.

On page 15, we do the same and this time change our second answer from 2 to 1.

From the import, it is not currently possible to remove/reset answers, as well as stopping interpolation of an answer.

What this means is that once you set an answer, if you do not change it until the end of the video, will remain the same for all frames until the end.

Preventing Users from Deleting Multiple Classification Answers

If you have imported pre-labels containing multiple classification answers, and you wish to prevent users from deleting them, you may lock the

Here is a sample for importing multiple classifications:

import