Contact iMeritAngo Hub WebsiteLog In to Ango Hub

Issue Error Codes

  1. Category: Errors are to be grouped so that they can be easily distinguishable on the UI and analytics can be prepared based on this category.

    • A category is assigned a color so that on the Audit tool, an Auditor can associate which Issue(s) belong to the same category when they select an Issue from the list.

  2. Add an Issue Type, that will be visible on the Audit tool

Setting Up Error Codes

A default Error Code template is provided by Ango Hub. Authorized users can modify it to create a new template from it.

Assigning Error Codes During Review

To raise an issue the reviewer can follow either of the two:

  1. Clicking on 'Issue' on the Header opens the Issue Panel. Click on the '+' icon on the issue title row.

  2. Right-clicking on the annotation and select the ‘Create Issue’ option.

Create Issue

Create Issue prompt appears on the Issue panel.

Frame

  • Start: Frame number where the issue is observed. The tool will automatically populate this with the current frame and will not prompt for an input

  • End: Frame number till where the issue is observed if it spans across multiple frames. The tool will automatically populate this with the current frame assuming the error doesn't span beyond the current frame. The user can update to the frame till where it is applicable.

Class, Instance, Attribute Selection

Dropdown selection from the list defined in the Category Schema.

Severity

Leverage this field to indicates the level of impact of an issue, ranging from critical to minor.

Error Code Selection

All the error codes that can be observed are listed under default. The user must select whichever is applicable. The list of options for Issues is customisable.

Each error category is assigned a specific color, making it easier for the Auditor to quickly identify the type of issue they are looking for within the list. For example, in the below image, 'blue' represents wrong annotations, 'green' indicates missing annotations, 'orange' indicates inconsistency, and 'purple' refers to miscellaneous error code.

Comments (if any)

Add comments to give more context about the issue raised

Issue Menu

Each Issue Card created has a few options which can be pulled up by clicking on the 3 vertical dots on the top right corner.

  • Reply to the issue

  • Ignore/ Close the Issue (the same gets reflected on the Audit Dashboard)

  • 3D/ 2D markers to redirect the annotator's attention to a location.

    • For a Missed Annotation: In this case Select the Class and Issue type as 'Missing Object'. After saving, click on the three dots to mark the location of the expected Annotation on the Image/ point cloud using 2D/ 3D Marker respectively.

Quick Tip: To associate the card to the existing annotation, provide the class and instance details. This will allow users to click on the card to be redirected to where the issue lies.

Reviewing Complete

Once reviewing is completed, click on Accept or Reject on the top right of the tool.

  1. Accept will change the status of the batch to Audit Accepted in the sequence lifecycle

  2. Reject will change the status of the batch to Audit Rejected in the sequence lifecycle

Last updated