Issues
Open and talk about labeling issues for all reviewers and managers to see.
Last updated
Open and talk about labeling issues for all reviewers and managers to see.
Last updated
Labelers, reviewers, and managers can open issues on labeling tasks to have a conversation about a particular asset or label.
Labelers can open issues on the tasks they have been assigned to, for example, to clarify how a certain asset needs to be labeled. Mentioned reviewers and project managers will get notified of the new issue so that they may take action and respond.
Reviewers can open issues on tasks to, for example, communicate to the labeler how they should label similar tasks in the future. Labelers get notified of the opened issues opened this way.
Users can have real-time conversations on issue threads, mention people to be notified, and delete/resolve issues.
Users can open issues that do not point to a specific region of the asset, and are about the task in general.
To do so, open the task you'd like to open an issue in. From the right-hand sidebar, click on Issues and write your issue in the box. Mention other users if necessary by @ing them, and press Enter. You can also press "I" on your keyboard if no object is selected to quickly open a task-level issue.
When you get a reply, you will get a notification.
You can edit or delete the issue using the Edit and Delete buttons on the issue.
In visual and audio labeling tasks, you can place an issue marker on the image/audio to direct attention to a particular region of the asset related to your issue. This is available for images, videos, PDF, audio, and medical data.
To do so, open the task in which you'd like to open an issue, and click on the speech bubble icon in the top-right corner of the screen. Then, click on the asset region of interest. Type your issue and press Enter.
In audio files, after clicking on the issue bubble icon, click and drag on the waveform where you would like to place your issue:
For medical data, you can additionally draw a line when the issue cursor is active, to further point at a specific area when opening a Specific Area issue:
To open an issue tied to a particular object, right-click on the object, expand the context menu, click on the three dots and choose Open Issue:
Alternatively, from the Objects list on the bottom left of the screen, click on the three dots on the row of the object you'd like to open the issue on, then click on Create Issue.
Alternatively, click on an object, then press "I" on your keyboard.
Click on the three dots next to the classification answer you'd like to create an issue about, and click on Create Issue:
To do so, navigate to the image where this issue starts occurring. Then, select the issue "speech bubble" icon and click anywhere on the asset to open the Open Issue dialog:
In the issue export:
To view and respond to issues in the project, go to the Issues tab and click on the issue of interest:
You will be directed to the task where the issue was opened, and the issue will be highlighted for you. To respond, simply type your response in the box and press Enter:
If you believe your issue was resolved, click on Resolve on the top-right corner of the issue.
Navigate to the Issues tab in your project, and click on Export Issues:
You will receive a JSON file containing all details pertaining to all issues in the project.
If an issue is obstructing your view, you can hide it by clicking on the icon, and you can unhide it by clicking it again from the sidebar.
In , you may open an issue spanning multiple images.
At the End selector, pick the image number where the issue ends. Click on the arrow to create the issue. You'll be able to see the issue page range when browsing issues in the issue sidebar, as well as in the .
