Ango Import Format

Overview of the Ango Hub Label Import Format

Ango Hub allows administrators and project managers to import existing annotations. In order to be imported to the platform, existing labels need to be converted to the Ango Hub Import Format. The following article will provide the format’s specifications, as well as examples of import files.

Common Properties

External ID

The external ID identifies assets in projects.

• When importing assets through the browser, the external ID is assigned automatically, and is equal to the asset's filename.

• When importing using the Cloud Import function, administrators and project managers must assign this ID manually to each asset. More on importing assets to Ango Hub here.

The assets must be imported to Ango Hub before the annotations.

It is not currently possible to bulk upload both assets and annotations with a single import file.

The external ID of each asset can be viewed from the Assets tab of your project, under the External ID column.

External IDs do not have to be unique. You can have more than one asset with the same external ID.

It is possible to import annotations referencing assets with only their external IDs, as in many exampled below. In this situation, all assets sharing the same external ID will be pre-labeled.

Warning for Video Pre-Annotations

When importing pre-annotations to a Video V2 asset, you must specify the file extension.

This means that if you are attempting to import the pre-annotations using only the externald field, then the asset's externalID must contain the file's correct extension. For example:

Copy

{
  "externalId": "H1412_1737445655000_1737448958000.mp4",
}

If you are using the "data" field, alone or together with the externalId field, then at least the data field must contain the full filename, including the file extension:

Copy

{
  "data": "H1412_1737445655000_1737448958000.mp4",
  "externalId": "H1412_1737445655000_1737448958000",
} 

Schema IDs

The Schema ID is a unique identifier for each labeling tool.

If you don't yet know the schema ID of the labeling tool you will use, instead of:

"schemaId": "my_schema_id"

you may use the tool's name (title) like so:

"title": "Name of My Tool"

This, however, is not recommended since Ango Hub will have to guess which tool you meant. If you have more than one tool with the same name, Ango Hub will pick one randomly.

To obtain each tool's schema ID, navigate to the Label Set section of the Settings. You will find it when expanding the details of each tool.

Create and save your project's label set before attempting to import labels.

Ensure the schema IDs in your import file match the ones in the Label Set section of your project's settings.

Nested classifications have their own, separate Schema IDs. They do not inherit the Schema ID of their parent class.

Object ID

By default, all objects (annotations) created on Ango Hub, either directly from the platform or by importing them, get assigned a random Object ID used to identify them uniquely.

You may, however, choose to assign a custom object ID to annotations you are importing. This is useful (and necessary) in a number of cases:

• In video annotations, the object ID allows you to move and track the same annotation between frames.

• In single and group relations, the Object ID is necessary to relate annotations to one another.

Assigning an object ID manually means that Ango Hub will not create one for the object in question.

Ango Hub will not check nor warn you if you import multiple, different annotations with the same object ID in the same asset or, in the case of videos, in the same frame.

Using the same object ID on more than one object in the same frame can cause unexpected behavior, and may break functionality such as relations.

Unless this is by design, such as tracking an annotation between video frames, always ensure your object IDs are unique to prevent unexpected behaviors.

To add an object ID to any object you are importing, simply add the following line to your object:

"objectId": "<YOUR_OBJECT_ID>"

For example, a PDF area object with a custom object ID would look like this:

{
    "title": "box2",
    "bounding-box": {
        "height": 1200,
        "width": 800,
        "x1": 98.2109375,
        "y1": 253.6640625,
        "x2": 342.2109375,
        "y2": 567.6640625,
        "pageNumber": 2,
        "text": "Second Text",
        "objectId": "1234567890"
    }
}

You can add custom Object IDs to all annotation types.

Lock

You can lock certain annotations so that annotators cannot edit them. To do so, simply add "lock":true as a property to an object. For example:

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                },
                "lock": true
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Lock is available for all annotation types, including classifications, except relations. We plan on supporting locking relations soon.

Metadata

• Add the description metadata to the tools

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                },
                "metadata": {
                    "description": "Sample Annotation"
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

• Add the description metadata to the classifications

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "97e1dfeffc6228423aa3007",
                "answer": "Green",
                "metadata": {
                    "description": "Sample annotation"
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "radio",
      "required": false,
      "schemaId": "97e1dfeffc6228423aa3007",
      "frameSpecific": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Green",
          "schemaId": "98a48fa4a08513e2ed49621"
        },
        {
          "value": "Red",
          "schemaId": "78a1bb2814b65e53bfd4756"
        },
        {
          "value": "Blue",
          "schemaId": "b83883a9fdab443ab824195"
        },
        {
          "value": "Yellow",
          "schemaId": "423f7c7021445479e1fb016"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Page

The "page" field is essential for determining which specific page of an asset the objects should be added to. This field is particularly important when working with assets that contain multiple frames or pages, such as videos, multi-image assets, and DICOM images.

[
    {
        "externalId": "example.tiff",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "page": 6,
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

All annotations on DICOM files, regardless of whether the DICOMs are single- or multi-frame, need the page property.

For single-frame DICOM annotations, the page property needs to be equal to 0. For example:

bbox_obj = {
    "schemaId": schema_id,
    "page": 0,
    "bounding-box": {
        "x": x,
        "y": y,
        "width": w,
        "height": h
    }
}

Tools

Bounding Box

x and y refer to the coordinates of the bounding box's top-left corner.

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                }
            },
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x": 56,
                    "y": 56,
                    "width": 67,
                    "height": 44
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Bounding Box with OCR Text

You may include OCR information such that, when imported, if in the category schema, the "Targeted OCR" toggle was enabled for the bounding box tool:

then you may add the "ocr" field to the bounding box to import, as pre-labels, the OCR contents. Here is an example JSON with the OCR field:

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                },
                "ocr": {
                    "text": "The Quick Brown Fox"
                }
            },
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x": 56,
                    "y": 56,
                    "width": 67,
                    "height": 44
                },
                "ocr": {
                    "text": "Jumps Over The Lazy Dog"
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Header",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": true,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

3D Bounding Box

[
    {
        "externalId": "example.nrrd",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "bounding-box": {
                    "x1": 50,
                    "y1": 75,
                    "z1": 100,
                    "x2": 200,
                    "y2": 250,
                    "z2": 300
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Lung",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Rotated Bounding Box

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "678717a10e50d6563edf230",
                "title": "Bottom",
                "rotated-bounding-box": {
                    "width": 100,
                    "height": 100,
                    "x": 200,
                    "y": 200,
                    "rotation": 45
                }
            },
            {
                "schemaId": "c9d96c7f6b863df8dc88790",
                "title": "Right",
                "rotated-bounding-box": {
                    "width": 100,
                    "height": 100,
                    "x": 200,
                    "y": 200,
                    "rotation": -45
                }
            },
            {
                "schemaId": "205ae9eb900f7ca929dd497",
                "title": "Top",
                "rotated-bounding-box": {
                    "width": 100,
                    "height": 100,
                    "x": 200,
                    "y": 200,
                    "rotation": -135
                }
            },
            {
                "schemaId": "23921c9aa563f1257253471",
                "title": "Left",
                "rotated-bounding-box": {
                    "width": 100,
                    "height": 100,
                    "x": 200,
                    "y": 200,
                    "rotation": 135
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Top",
      "tool": "rotated-bounding-box",
      "required": false,
      "schemaId": "205ae9eb900f7ca929dd497",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    },
    {
      "title": "Left",
      "tool": "rotated-bounding-box",
      "required": false,
      "schemaId": "23921c9aa563f1257253471",
      "classifications": [],
      "multiple": false,
      "color": "#03a9f4",
      "shortcutKey": "2"
    },
    {
      "title": "Bottom",
      "tool": "rotated-bounding-box",
      "required": false,
      "schemaId": "678717a10e50d6563edf230",
      "classifications": [],
      "multiple": false,
      "color": "#9c27b0",
      "shortcutKey": "3"
    },
    {
      "title": "Right",
      "tool": "rotated-bounding-box",
      "required": false,
      "schemaId": "c9d96c7f6b863df8dc88790",
      "classifications": [],
      "multiple": false,
      "color": "#673ab7",
      "shortcutKey": "4"
    }
  ],
  "classifications": [],
  "relations": []
}

3D Rotated Bounding Box

For NRRD assets in the Medical Labeling Editor, use x1, y1, z1, x2, y2, and z2 to define two opposite corners of the box in voxel coordinates. The rotationPlane determines the plane in which rotation is applied: AXIAL, CORONAL, or SAGITTAL.

[
    {
        "externalId": "example.nrrd",
        "objects": [
            {
                "objectId": "medical-rotated-box-1",
                "schemaId": "medical_rotated_bbox",
                "rotated-bounding-box": {
                    "x1": 48,
                    "y1": 64,
                    "z1": 96,
                    "x2": 112,
                    "y2": 144,
                    "z2": 128,
                    "rotation": 28,
                    "rotationPlane": "AXIAL",
                    "coordinates1": [-110.25, -92.5, -24.75],
                    "coordinates2": [-46.25, -12.5, 7.25],
                    "measurement": {
                        "width": {
                            "distance": 51.77,
                            "unit": "mm"
                        },
                        "height": {
                            "distance": 64.61,
                            "unit": "mm"
                        },
                        "depth": {
                            "distance": 32,
                            "unit": "mm"
                        }
                    }
                }
            }
        ]
    }
]

coordinates1, coordinates2, and measurement are optional. When provided, they should correspond to the NRRD volume's origin, orientation, and spacing.

For the complete asset-import workflow and the rotation-plane axis mapping, see How to Import Rotated Bounding Boxes into NRRD Assets.

Rotated Bounding Box Angles

Rotated Bounding Box Angles

Polygon

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "3db073f1a9deba207b65123",
                "polygon": [
                    [
                        118,
                        459
                    ],
                    [
                        299,
                        327
                    ],
                    [
                        479,
                        459
                    ],
                    [
                        411,
                        672
                    ],
                    [
                        187,
                        671
                    ]
                ]
            },
            {
                "schemaId": "3db073f1a9deba207b65123",
                "polygon": [
                    [
                        534,
                        345
                    ],
                    [
                        656,
                        678
                    ],
                    [
                        843,
                        675
                    ],
                    [
                        978,
                        234
                    ],
                    [
                        848,
                        345
                    ]
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "polygon",
      "required": false,
      "schemaId": "3db073f1a9deba207b65123",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Polyline

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "7e8475173033ca753606470",
                "polyline": [
                    [
                        128,
                        128
                    ],
                    [
                        128,
                        256
                    ],
                    [
                        256,
                        320
                    ]
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Line",
      "tool": "polyline",
      "required": false,
      "schemaId": "7e8475173033ca753606470",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

3D Polyline

[
    {
        "externalId": "example.nrrd",
        "objects": [
            {
                "schemaId": "7e8475173033ca753606470",
                "polyline": {
                    "x1": 150,
                    "y1": 100,
                    "z1": 200,
                    "x2": 300,
                    "y2": 200,
                    "z2": 400
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Line",
      "tool": "polyline",
      "required": false,
      "schemaId": "7e8475173033ca753606470",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Segmentation

Segmentations are composed of instances, zones, regions, and holes.

An instance may contain more than one zone. One zone contains exactly one region. A region can contain more than one hole.

Each of the points composing the segmentation is represented as an X/Y coordinate pair. For more information on how X/Y pairs work in the Ango Annotation Format, check out this section. For the way Ango Hub exports segmentation labels, check out this page.

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "2ff45d51337052241bcb680",
                "segmentation": {
                    "zones": [
                        {
                            "region": [
                                [
                                    64,
                                    64
                                ],
                                [
                                    64,
                                    156
                                ],
                                [
                                    156,
                                    156
                                ],
                                [
                                    156,
                                    64
                                ]
                            ],
                            "holes": []
                        },
                        {
                            "region": [
                                [
                                    64,
                                    256
                                ],
                                [
                                    64,
                                    360
                                ],
                                [
                                    256,
                                    360
                                ],
                                [
                                    320,
                                    256
                                ]
                            ],
                            "holes": [
                                [
                                    [
                                        100,
                                        270
                                    ],
                                    [
                                        140,
                                        270
                                    ],
                                    [
                                        140,
                                        320
                                    ]
                                ],
                                [
                                    [
                                        200,
                                        300
                                    ],
                                    [
                                        240,
                                        300
                                    ],
                                    [
                                        240,
                                        350
                                    ],
                                    [
                                        200,
                                        350
                                    ]
                                ]
                            ]
                        }
                    ]
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Sample",
      "tool": "segmentation",
      "required": false,
      "schemaId": "2ff45d51337052241bcb680",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Entity

Entity: Audio Labeling

The start and end properties refer to the seconds elapsed since the start of the audio file.

The optional selection property contains the text associated with the audio entity. The optional tier property assigns the entity to a tier using a zero-based index (0–4). If tier is omitted, the entity is added to the default tier.

[
    {
        "externalId": "example.mp3",
        "objects": [
            {
                "schemaId": "6ab93a0c0c3553e5b598887",
                "ner": {
                    "start": 2.18,
                    "end": 3.36,
                    "selection": "Sample text",
                    "tier": 0
                }
            },
            {
                "schemaId": "6ab93a0c0c3553e5b598887",
                "ner": {
                    "start": 6.7,
                    "end": 8.1,
                    "selection": "More sample text",
                    "tier": 1
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Sample Entity",
      "tool": "ner",
      "required": false,
      "schemaId": "6ab93a0c0c3553e5b598887",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

example.mp3

119KB

Open

Entity: Text Labeling

The start and end properties refer to the character indices of the entity.

The "selection" field is optional for text entities and it is required only to appear on export.

[
    {
        "externalId": "example.txt",
        "objects": [
            {
                "schemaId": "6ab93a0c0c3553e5b598887",
                "ner": {
                    "start": 6,
                    "end": 10,
                    "selection": "ipsum"
                }
            },
            {
                "schemaId": "6ab93a0c0c3553e5b598887",
                "ner": {
                    "start": 28,
                    "end": 38,
                    "selection": "consectetur"
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Sample Entity",
      "tool": "ner",
      "required": false,
      "schemaId": "6ab93a0c0c3553e5b598887",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

example.txt

445B

Open

Entity: Video Labeling

The start and end properties refer to the seconds elapsed since the start of the video file.

[
    {
        "externalId": "example.mp4",
        "objects": [
            {
                "schemaId": "6ab93a0c0c3553e5b598887",
                "ner": {
                    "start": 2.18,
                    "end": 3.36
                }
            },
            {
                "schemaId": "6ab93a0c0c3553e5b598887",
                "ner": {
                    "start": 6.7,
                    "end": 8.1
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Sample Entity",
      "tool": "ner",
      "required": false,
      "schemaId": "6ab93a0c0c3553e5b598887",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Point

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "63f2ca2a1e5404f14f14039",
                "point": [
                    64,
                    64
                ]
            },
            {
                "schemaId": "63f2ca2a1e5404f14f14039",
                "point": [
                    256,
                    64
                ]
            },
            {
                "schemaId": "63f2ca2a1e5404f14f14039",
                "point": [
                    64,
                    256
                ]
            },
            {
                "schemaId": "63f2ca2a1e5404f14f14039",
                "point": [
                    256,
                    256
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Point",
      "tool": "point",
      "required": false,
      "schemaId": "63f2ca2a1e5404f14f14039",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Circle

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "ec78ab1b08f55e9e2e97213",
                "circle": [
                    [
                        80,
                        200
                    ],
                    [
                        400,
                        250
                        
                    ],
                    [
                        250,
                        64
                    ]
                ]
            } 
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "schemaId": "ec78ab1b08f55e9e2e97213",
      "tool": "circle",
      "title": "Ball",
      "required": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

PDF

height and width refer to the dimensions of the relevant page of the pdf file.

[
    {
        "externalId": "example.pdf",
        "objects": [
            {
                "schemaId": "a95b7523d9d5e523aade085",
                "pdf": {
                    "height": 384,
                    "width": 384,
                    "x1": 64,
                    "y1": 64,
                    "x2": 128,
                    "y2": 128,
                    "pageNumber": 1,
                    "text": "sample text"
                }
            } 
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Paragraph",
      "tool": "pdf",
      "required": false,
      "schemaId": "a95b7523d9d5e523aade085",
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

example.pdf

PDF · 1KB

Open

Brush

Brush

For how to import brush traces with the brush tool, refer to the following page.

Medical Brush

For how to import brush traces with the medical brush tool, refer to the following page.

Message

Sample Message Asset

[
    {
        "externalId": "example-chat-asset",
        "messages": [
            {
                "id": "1",
                "content": "Content of message 1",
                "user": {
                    "role": "user",
                    "id": "100001",
                    "label": "Human"
                }
            },
            {
                "id": "2",
                "content": "Content of message 2",
                "user": {
                    "role": "assistant",
                    "id": "100002",
                    "label": "AI"
                }
            }
        ]
    }
]

[
    {
        "externalId": "example-chat-asset",
        "objects": [
            {
                "message": "1",
                "schemaId": "83e243f743bde31861ca899",
                "classifications": [
                    {
                        "schemaId": "92a2f5ed57edcd1ce440338",
                        "answer": "Positive"
                    }
                ]
            },
            {
                "message": "2",
                "schemaId": "83e243f743bde31861ca899",
                "classifications": [
                    {
                        "schemaId": "92a2f5ed57edcd1ce440338",
                        "answer": "Neutral"
                    }
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "schemaId": "83e243f743bde31861ca899",
      "tool": "message",
      "title": "Message",
      "required": false,
      "classifications": [
        {
          "schemaId": "92a2f5ed57edcd1ce440338",
          "tool": "radio",
          "title": "Sentiment",
          "required": false,
          "classifications": [],
          "multiple": false,
          "options": [
            {
              "value": "Positive",
              "schemaId": "34a4303c7d79aff4c657701"
            },
            {
              "value": "Neutral",
              "schemaId": "8e46bd25a1d89a2e99d3683"
            },
            {
              "value": "Negative",
              "schemaId": "504eb4a2f8f173ab11d2542"
            }
          ],
          "parentToolType": "message",
          "parentToolId": "83e243f743bde31861ca899",
          "shortcutKey": "2",
          "frameSpecific": false
        }
      ],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Angle

[
    {
        "externalId": "example.nrrd",
        "objects": [
            {
                "schemaId": "b59dd60048b2efbb63c4226",
                "angle": {
                    "vertex": [
                      64,
                      128,
                      0
                    ],
                    "p1": [
                      128,
                      128,
                      0
                    ],
                    "p2": [
                      128,
                      256,
                      0
                    ]
                }
            } 
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "schemaId": "b59dd60048b2efbb63c4226",
      "tool": "angle",
      "title": "Angle",
      "required": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Skeleton

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "b233269571ca360af279958",
                "skeleton": {
                    "nodes": [
                        {
                            "id": "2d0b31e36fc36ab7c8b8255",
                            "x": 237.701,
                            "y": 93.92,
                            "occluded": false
                        },
                        {
                            "id": "d241121647111766e19c743",
                            "x": 238.806,
                            "y": 151.379,
                            "occluded": false
                        },
                        {
                            "id": "6db8e6f91a9efc803f05004",
                            "x": 196.817,
                            "y": 192.815,
                            "occluded": false
                        },
                        {
                            "id": "d6df89cc9917e1641537667",
                            "x": 280.795,
                            "y": 193.92,
                            "occluded": false
                        }
                    ],
                    "edges": [
                        {
                            "id": "5abdfe2f38da9f859ea5275",
                            "from": "2d0b31e36fc36ab7c8b8255",
                            "to": "d241121647111766e19c743",
                            "occluded": false
                        },
                        {
                            "id": "99652b301b58111d86fb802",
                            "from": "d241121647111766e19c743",
                            "to": "6db8e6f91a9efc803f05004",
                            "occluded": false
                        },
                        {
                            "id": "78d167d96c6c1d9773d1651",
                            "from": "d241121647111766e19c743",
                            "to": "d6df89cc9917e1641537667",
                            "occluded": false
                        }
                    ]
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "schemaId": "b233269571ca360af279958",
      "tool": "skeleton",
      "title": "Skeleton",
      "required": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1",
      "skeletonData": {
        "nodes": [
          {
            "id": "2d0b31e36fc36ab7c8b8255",
            "name": "1",
            "x": 226,
            "y": 48
          },
          {
            "id": "d241121647111766e19c743",
            "name": "2",
            "x": 228,
            "y": 152
          },
          {
            "id": "6db8e6f91a9efc803f05004",
            "name": "3",
            "x": 152,
            "y": 227
          },
          {
            "id": "d6df89cc9917e1641537667",
            "name": "4",
            "x": 304,
            "y": 229
          }
        ],
        "edges": [
          {
            "id": "5abdfe2f38da9f859ea5275",
            "from": "2d0b31e36fc36ab7c8b8255",
            "to": "d241121647111766e19c743"
          },
          {
            "id": "99652b301b58111d86fb802",
            "from": "d241121647111766e19c743",
            "to": "6db8e6f91a9efc803f05004"
          },
          {
            "id": "78d167d96c6c1d9773d1651",
            "from": "d241121647111766e19c743",
            "to": "d6df89cc9917e1641537667"
          }
        ]
      }
    }
  ],
  "classifications": [],
  "relations": []
}

Tools with Nested Classifications

Bounding Box / Radio

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "c72440f85fecbd439bca284",
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                },
                "classifications": [
                    {
                        "schemaId": "a7800ce15dcae82c8d51463",
                        "answer": "Black"
                    }
                ]

            },
            {
                "schemaId": "c72440f85fecbd439bca284",
                "bounding-box": {
                    "x": 56,
                    "y": 56,
                    "width": 67,
                    "height": 44
                },
                "classifications": [
                    {
                        "schemaId": "a7800ce15dcae82c8d51463",
                        "answer": "Yellow"
                    }
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "c72440f85fecbd439bca284",
      "ocrEnabled": false,
      "classifications": [
        {
          "title": "Color",
          "tool": "radio",
          "required": false,
          "schemaId": "a7800ce15dcae82c8d51463",
          "frameSpecific": false,
          "classifications": [],
          "multiple": false,
          "options": [
            {
              "value": "Red",
              "schemaId": "752a2fcac3678fe2ce55143"
            },
            {
              "value": "White",
              "schemaId": "3c1f49512c9ce13d3b9c051"
            },
            {
              "value": "Black",
              "schemaId": "850cd2aa1a984d2e0759492"
            },
            {
              "value": "Blue",
              "schemaId": "027e53efb4f96329a0d2278"
            },
            {
              "value": "Green",
              "schemaId": "ae4281fc4ebf50e9bf2f625"
            },
            {
              "value": "Yellow",
              "schemaId": "6d5e4052b7a54c23c20e163"
            }
          ]
        }
      ],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Any tool and classification available in Ango Hub can be used as a nested classification. The Bounding Box and Radio combination is provided here as an example.

Tool Import for Video and Multi-Image Labeling

Tools: Video Labeling

Video object annotations use keyFrames for frames where the object's geometry is explicitly set. Hub interpolates supported object tools between those keyframes within the object's segments range. See Frame Interpolation for how keyframes, segments, and out-of-view segments appear in the video editor.

[
    {
        "externalId": "example.mp4",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "objectId": "12345",
                "segments": [0, 60],
                "outOfViewSegments": [[20, 25], [45, 50]],
                "keyFrames": {
                    "5": {
                        "bounding-box": {
                            "x": 50,
                            "y": 100,
                            "height": 200,
                            "width": 400
                        }
                    },
                    "15": {
                        "bounding-box": {
                            "x": 200,
                            "y": 100,
                            "height": 200,
                            "width": 400
                        }
                    },
                    "40": {
                        "bounding-box": {
                            "x": 200,
                            "y": 400,
                            "height": 200,
                            "width": 400
                        }
                    }
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Customize Timeline Color

It is also possible to customize the color of a specific interval in the video timeline as follows:

[
    {
        "externalId": "example.mp4",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "objectId": "12345",
                "segments": [0, 60],
                "outOfViewSegments": [[20, 25], [45, 50]],
                "customColorIntervals": [
                    {
                        "interval": [
                            5,
                            15
                        ],
                        "color": "#ffff00"
                    }
                ],
                "keyFrames": {
                    "5": {
                        "bounding-box": {
                            "x": 50,
                            "y": 100,
                            "height": 200,
                            "width": 400
                        }
                    },
                    "15": {
                        "bounding-box": {
                            "x": 200,
                            "y": 100,
                            "height": 200,
                            "width": 400
                        }
                    },
                    "40": {
                        "bounding-box": {
                            "x": 200,
                            "y": 400,
                            "height": 200,
                            "width": 400
                        }
                    }
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Any tool available in Ango Hub can be used with video assets. The Bounding Box tool is provided here as an example.

Tools: Multi-Image Labeling

Importing annotations for multi-image assets is functionally the same as importing video annotations, with each "image" being a page. Pages start from 0.

[
    {
        "externalId": "example.tiff",
        "objects": [
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "page": 6,
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                }
            },
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "page": 7,
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                }
            },
            {
                "schemaId": "09f90db83b842d7bf0c2225",
                "page": 8,
                "bounding-box": {
                    "x": 192,
                    "y": 166,
                    "width": 66,
                    "height": 61
                }
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "09f90db83b842d7bf0c2225",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": []
}

Any tool available in Ango Hub can be used with multi-image assets. The Bounding Box tool is provided here as an example.

---

Classifications

Radio

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "97e1dfeffc6228423aa3007",
                "answer": "Green"
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "radio",
      "required": false,
      "schemaId": "97e1dfeffc6228423aa3007",
      "frameSpecific": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Green",
          "schemaId": "98a48fa4a08513e2ed49621"
        },
        {
          "value": "Red",
          "schemaId": "78a1bb2814b65e53bfd4756"
        },
        {
          "value": "Blue",
          "schemaId": "b83883a9fdab443ab824195"
        },
        {
          "value": "Yellow",
          "schemaId": "423f7c7021445479e1fb016"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Checkbox

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "5080b746a37f41d3fc89933",
                "answer": ["Green", "Red"]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "checkbox",
      "required": false,
      "schemaId": "5080b746a37f41d3fc89933",
      "frameSpecific": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Green",
          "schemaId": "4f2c47ac537a2478b9b4788"
        },
        {
          "value": "Red",
          "schemaId": "988e1f12078d011dea48916"
        },
        {
          "value": "Blue",
          "schemaId": "2264999cc377c8875c11689"
        },
        {
          "value": "Yellow",
          "schemaId": "77686bf9451ddefe4c9f540"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Single-Select Dropdown

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "b12539e62f749ac59372624",
                "answer": "Green"
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "single-dropdown",
      "required": false,
      "schemaId": "b12539e62f749ac59372624",
      "frameSpecific": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Green",
          "schemaId": "f6fdafafbb3181d769c8146"
        },
        {
          "value": "Red",
          "schemaId": "c594fd08cfb06d070cf8224"
        },
        {
          "value": "Blue",
          "schemaId": "144b9df0b37055ed9e29649"
        },
        {
          "value": "Yellow",
          "schemaId": "c1e406eaa03aef110e47501"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Multi-Select Dropdown

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "9096a7b7d5cbd2057bb9356",
                "answer": ["Green", "Red"]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "multi-dropdown",
      "required": false,
      "schemaId": "9096a7b7d5cbd2057bb9356",
      "frameSpecific": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Green",
          "schemaId": "8fcb93e767f73db675f4543"
        },
        {
          "value": "Red",
          "schemaId": "0e63c4be51fb78fd712b576"
        },
        {
          "value": "Blue",
          "schemaId": "9745d1fe49ad079303ca923"
        },
        {
          "value": "Yellow",
          "schemaId": "aae6511fffb327abc17f306"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Single-Select Tree

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "27b16368a548b90d7169967",
                "answer": "Trunk / Branch 2 / Leaf 2"
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Sample Tree Dropdown",
      "tool": "single-tree-dropdown",
      "required": false,
      "schemaId": "27b16368a548b90d7169967",
      "frameSpecific": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Trunk",
          "schemaId": "a7607151c841a133fb84394"
        },
        {
          "value": "Trunk / Branch 1",
          "schemaId": "a6e322e426042b69b781020"
        },
        {
          "value": "Trunk / Branch 1 / Leaf 1",
          "schemaId": "82922b933af5a2783a54285"
        },
        {
          "value": "Trunk / Branch 2",
          "schemaId": "8c8391f4ed2c1015aa25501"
        },
        {
          "value": "Trunk / Branch 2 / Leaf 2",
          "schemaId": "a092d33d27e65937c2e2443"
        }
      ],
      "shortcutKey": "1",
      "treeOptions": [
        {
          "title": "Trunk",
          "key": "a7607151c841a133fb84394",
          "value": "a7607151c841a133fb84394",
          "children": [
            {
              "title": "Branch 1",
              "value": "a6e322e426042b69b781020",
              "key": "a6e322e426042b69b781020",
              "children": [
                {
                  "title": "Leaf 1",
                  "value": "82922b933af5a2783a54285",
                  "key": "82922b933af5a2783a54285"
                }
              ]
            },
            {
              "title": "Branch 2",
              "value": "8c8391f4ed2c1015aa25501",
              "key": "8c8391f4ed2c1015aa25501",
              "children": [
                {
                  "title": "Leaf 2",
                  "value": "a092d33d27e65937c2e2443",
                  "key": "a092d33d27e65937c2e2443"
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "relations": []
}

Multi-Select Tree

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "7fb05854b6b28ff05a4e227",
                "answer": [
                    "Trunk",
                    "Trunk / Branch 2",
                    "Trunk / Branch 1 / Leaf 1",
                    "Trunk / Branch 2 / Leaf 2"
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Sample Tree Dropdown",
      "tool": "tree-dropdown",
      "required": false,
      "schemaId": "7fb05854b6b28ff05a4e227",
      "frameSpecific": false,
      "showDropdown": false,
      "classifications": [],
      "multiple": false,
      "options": [
        {
          "value": "Trunk",
          "schemaId": "030c9bc65d0d7c677ac3705"
        },
        {
          "value": "Trunk / Branch 1",
          "schemaId": "5f04518646a82aff33e5573"
        },
        {
          "value": "Trunk / Branch 1 / Leaf 1",
          "schemaId": "650b8b3bbe7a6ae55b00639"
        },
        {
          "value": "Trunk / Branch 2",
          "schemaId": "2e44479c9098983b9611260"
        },
        {
          "value": "Trunk / Branch 2 / Leaf 2",
          "schemaId": "001c29efb030deb2188e481"
        }
      ],
      "shortcutKey": "1",
      "treeOptions": [
        {
          "title": "Trunk",
          "key": "030c9bc65d0d7c677ac3705",
          "value": "030c9bc65d0d7c677ac3705",
          "children": [
            {
              "title": "Branch 1",
              "value": "5f04518646a82aff33e5573",
              "key": "5f04518646a82aff33e5573",
              "children": [
                {
                  "title": "Leaf 1",
                  "value": "650b8b3bbe7a6ae55b00639",
                  "key": "650b8b3bbe7a6ae55b00639"
                }
              ]
            },
            {
              "title": "Branch 2",
              "value": "2e44479c9098983b9611260",
              "key": "2e44479c9098983b9611260",
              "children": [
                {
                  "title": "Leaf 2",
                  "value": "001c29efb030deb2188e481",
                  "key": "001c29efb030deb2188e481"
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "relations": []
}

Text

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "a9c72798e9cfb6ad9ab4364",
                "answer": "Green"
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "text",
      "required": false,
      "schemaId": "a9c72798e9cfb6ad9ab4364",
      "frameSpecific": false,
      "richText": false,
      "regex": "",
      "classifications": [],
      "multiple": false,
      "options": [],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Nested Classifications

Radio / Radio / Radio

[
    {
        "externalId": "example.png",
        "classifications": [
            {
                "schemaId": "905d68fb647890538d5a469",
                "answer": "A",
                "classifications": [
                    {
                        "schemaId": "00298d59fb1e305a771a603",
                        "answer": "A1",
                        "classifications": [
                            {
                                "schemaId": "403a2c4d4069ebbca375452",
                                "answer": "A1-1"
                            }
                        ]
                    }
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Level-1",
      "tool": "radio",
      "required": false,
      "schemaId": "905d68fb647890538d5a469",
      "frameSpecific": false,
      "classifications": [
        {
          "title": "Level-2",
          "tool": "radio",
          "required": false,
          "schemaId": "00298d59fb1e305a771a603",
          "frameSpecific": false,
          "classifications": [
            {
              "title": "Level-3",
              "tool": "radio",
              "required": false,
              "schemaId": "403a2c4d4069ebbca375452",
              "frameSpecific": false,
              "classifications": [],
              "multiple": false,
              "options": [
                {
                  "value": "A1-1",
                  "schemaId": "bb201ae71c27fa266f1f895"
                },
                {
                  "value": "A1-2",
                  "schemaId": "4ae7cdddec44bd1c6665215"
                }
              ],
              "parentOptionId": "50444ee32efadfce8bf9899"
            }
          ],
          "multiple": false,
          "options": [
            {
              "value": "A1",
              "schemaId": "50444ee32efadfce8bf9899"
            },
            {
              "value": "A2",
              "schemaId": "076152f01623a1b7e9b3146"
            },
            {
              "value": "A3",
              "schemaId": "f34db38f29da728bc25f312"
            }
          ],
          "parentOptionId": "b5650e446862a5383564396"
        }
      ],
      "multiple": false,
      "options": [
        {
          "value": "A",
          "schemaId": "b5650e446862a5383564396"
        },
        {
          "value": "B",
          "schemaId": "a029acbff0a2ef120c15689"
        },
        {
          "value": "C",
          "schemaId": "3fa2f657a1f3639c978d609"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Any classification available in Ango Hub can be used as a nested classification. Nested Radio classifications are provided here as an example.

Multiple Classifications

[
    {
        "externalId": "example.mp3",
        "classifications": [
            {
                "schemaId": "97e1dfeffc6228423aa3007",
                "answer": "Green"
            },
            {
                "schemaId": "97e1dfeffc6228423aa3007",
                "answer": "Red"
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "radio",
      "required": false,
      "schemaId": "97e1dfeffc6228423aa3007",
      "frameSpecific": false,
      "classifications": [],
      "multiple": true,
      "options": [
        {
          "value": "Green",
          "schemaId": "98a48fa4a08513e2ed49621"
        },
        {
          "value": "Red",
          "schemaId": "78a1bb2814b65e53bfd4756"
        },
        {
          "value": "Blue",
          "schemaId": "b83883a9fdab443ab824195"
        },
        {
          "value": "Yellow",
          "schemaId": "423f7c7021445479e1fb016"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Any classification available in Ango Hub can be used in multiple question mode. The Radio classification is provided here as an example.

Classification Import for Video and Multi-Image Labeling

Please ensure the "Frame-specific" flag is enabled to add classification labels to each frame, and the "Multiple" flag is enabled to add multiple classification labels for an asset.

Classifications: Video Labeling

Frame-specific video classifications also use keyFrames, but the keyframe value is an answer, not object geometry. The latest previous classification keyframe applies until another keyframe changes the answer, or until the classification's segments range ends. See Frame-Specific Classifications for the UI behavior.

[
    {
        "externalId": "example.mp4",
        "classifications": [
            {
                "schemaId": "5570fff8bbe9a7d2e7cb117",
                "objectId": "12345",
                "segments": [0, 60],
                "outOfViewSegments": [[20, 25], [45, 50]],
                "keyFrames": {
                    "5": {
                        "answer": "Green"
                    },
                    "15": {
                        "answer": "Red"
                    },
                    "40": {
                        "answer": "Blue"
                    }
                }
            }
        ],
        "objects": [],
        "relations": []
    }
]	

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "radio",
      "required": false,
      "schemaId": "5570fff8bbe9a7d2e7cb117",
      "frameSpecific": true,
      "classifications": [],
      "multiple": true,
      "options": [
        {
          "value": "Green",
          "schemaId": "26d805c6ec81245adccb862"
        },
        {
          "value": "Red",
          "schemaId": "0be6e24a61dbff01d708441"
        },
        {
          "value": "Blue",
          "schemaId": "af7f1bb93023a49e21ac924"
        },
        {
          "value": "Yellow",
          "schemaId": "0ba5dcc111376a878071563"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Customize Timeline Color

It is also possible to customize the color of a specific interval in the video timeline as follows:

[
    {
        "externalId": "example.mp4",
        "classifications": [
            {
                "schemaId": "5570fff8bbe9a7d2e7cb117",
                "objectId": "12345",
                "segments": [0, 60],
                "outOfViewSegments": [[20, 25], [45, 50]],
                "customColorIntervals": [
                    {
                        "interval": [
                            5,
                            15
                        ],
                        "color": "#ffff00"
                    }
                ],
                "keyFrames": {
                    "5": {
                        "answer": "Green"
                    },
                    "15": {
                        "answer": "Red"
                    },
                    "40": {
                        "answer": "Blue"
                    }
                }
            }
        ],
        "objects": [],
        "relations": []
    }
]	

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "radio",
      "required": false,
      "schemaId": "5570fff8bbe9a7d2e7cb117",
      "frameSpecific": true,
      "classifications": [],
      "multiple": true,
      "options": [
        {
          "value": "Green",
          "schemaId": "26d805c6ec81245adccb862"
        },
        {
          "value": "Red",
          "schemaId": "0be6e24a61dbff01d708441"
        },
        {
          "value": "Blue",
          "schemaId": "af7f1bb93023a49e21ac924"
        },
        {
          "value": "Yellow",
          "schemaId": "0ba5dcc111376a878071563"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Any classification available in Ango Hub can be used with video assets. The Radio classification is provided here as an example.

Classifications: Multi-Image Labeling

[
    {
        "externalId": "example",
        "classifications": [
            {
                "schemaId": "5570fff8bbe9a7d2e7cb117",
                "objectId": "12345",
                "answer": "Green",
                "page": 3
            },
            {
                "schemaId": "5570fff8bbe9a7d2e7cb117",
                "objectId": "12345",
                "answer": "Red",
                "page": 6
            },
            {
                "schemaId": "5570fff8bbe9a7d2e7cb117",
                "objectId": "67890",
                "answer": "Red",
                "page": 6
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [],
  "classifications": [
    {
      "title": "Color",
      "tool": "radio",
      "required": false,
      "schemaId": "5570fff8bbe9a7d2e7cb117",
      "frameSpecific": true,
      "classifications": [],
      "multiple": true,
      "options": [
        {
          "value": "Green",
          "schemaId": "26d805c6ec81245adccb862"
        },
        {
          "value": "Red",
          "schemaId": "0be6e24a61dbff01d708441"
        },
        {
          "value": "Blue",
          "schemaId": "af7f1bb93023a49e21ac924"
        },
        {
          "value": "Yellow",
          "schemaId": "0ba5dcc111376a878071563"
        }
      ],
      "shortcutKey": "1"
    }
  ],
  "relations": []
}

Any classification available in Ango Hub can be used with multi-image assets. The Radio classification is provided here as an example.

---

Relations

Single

Direction Options: "straight", "reverse", "bidirectional"

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "e29868a0f61c679133fe505",
                "objectId": "100001",
                "bounding-box": {
                    "width": 128,
                    "height": 128,
                    "x": 64,
                    "y": 192
                }
            },
            {
                "schemaId": "e29868a0f61c679133fe505",
                "objectId": "100002",
                "bounding-box": {
                    "width": 128,
                    "height": 128,
                    "x": 320,
                    "y": 192
                }
            }
        ],
        "relations": [
            {
                "schemaId": "c344baf6021ac976cd3f509",
                "direction": "straight",
                "from": "100001",
                "to": "100002",
                "classifications": [
                    {
                        "schemaId": "0c51ed85d18425a9d590100",
                        "answer": "Direct"
                    }
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "e29868a0f61c679133fe505",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": [
    {
      "title": "Related",
      "tool": "one-to-one",
      "required": false,
      "schemaId": "c344baf6021ac976cd3f509",
      "classifications": [
        {
          "title": "Connection type",
          "tool": "radio",
          "required": false,
          "schemaId": "0c51ed85d18425a9d590100",
          "classifications": [],
          "multiple": false,
          "options": [
            {
              "value": "Direct",
              "schemaId": "0c51ed85d18425a9d590101"
            },
            {
              "value": "Indirect",
              "schemaId": "0c51ed85d18425a9d590102"
            }
          ]
        }
      ],
      "multiple": false,
      "color": "#03a9f4",
      "shortcutKey": "2"
    }
  ]
}

The optional classifications list contains answers to questions configured on the relation. It follows the same nested-classification format used by tools and is supported for both Single and Group relations.

Group

[
    {
        "externalId": "example.png",
        "objects": [
            {
                "schemaId": "14b0745eb3fd0fb920a0664",
                "objectId": "10001",
                "bounding-box": {
                    "width": 128,
                    "height": 128,
                    "x": 64,
                    "y": 64
                }
            },
            {
                "schemaId": "14b0745eb3fd0fb920a0664",
                "objectId": "10002",
                "bounding-box": {
                    "width": 128,
                    "height": 128,
                    "x": 320,
                    "y": 64
                }
            },
            {
                "schemaId": "14b0745eb3fd0fb920a0664",
                "objectId": "10003",
                "bounding-box": {
                    "width": 128,
                    "height": 128,
                    "x": 192,
                    "y": 256
                }
            }
        ],
        "relations": [
            {
                "schemaId": "6261613fab7418ef20b0243",
                "group": [
                    "10001",
                    "10002",
                    "10003"
                ]
            }
        ]
    }
]

Sample Category Schema

{
  "tools": [
    {
      "title": "Car",
      "tool": "bounding-box",
      "required": false,
      "schemaId": "14b0745eb3fd0fb920a0664",
      "ocrEnabled": false,
      "classifications": [],
      "multiple": false,
      "color": "#f44336",
      "shortcutKey": "1"
    }
  ],
  "classifications": [],
  "relations": [
    {
      "title": "Related",
      "tool": "group",
      "required": false,
      "schemaId": "6261613fab7418ef20b0243",
      "classifications": [],
      "multiple": false,
      "color": "#03a9f4",
      "shortcutKey": "2"
    }
  ]
}

Any tool available in Ango Hub can be used with relations. The Bounding Box tool is provided here as an example.