Requeuing

Reset labeling tasks and put them back in the labeling or reviewing queue.

Once a labeling task is created, it flows through the workflow, moving from stage to stage as users, annotators, and plugins process tasks.

Ango Hub provides organization admins, or project users with the Lead or Manager role, with a way to manually override workflow and place a task in a specific stage of your choice with requeuing.

From a task's stage history, you are able to see if and when a task has been requeued.

However, requeuing moves a task from one stage to another without creating a task history entry.

This means that, for example, if you:

  • Have a task in the Start stage

  • Import pre-labels to it, or make any modifications

  • Then requeue it to another stage, for example a Label stage

  • An annotator makes further modifications to it in the Label stage

You would not be able to tell the difference between the modifications made in the Start stage and the Label stage. This is because the task in Start, as-is, was shifted to the Label stage.

To create stage history entries, tasks must be submitted or forwarded using the Start stage settings in the Workflow tab. Saving does not create new task history entries.

How to requeue a task

This section will show you how to open the requeue dialog. The sections below it will explain each option in the re-queue dialog.

Re-queue multiple tasks from the Tasks tab

Enter the Tasks tab (1), then toggle the checkbox (2) next to each task you wish to re-queue. Then, from the Item dropdown click on Re-queue (3). The re-queue dialog will open.

Requeue all tasks in a specific stage

From the Workflow tab of your project, left-click on the stage containing the tasks you'd like to re-queue to a different stage. A dialog will appear in the top-right corner of the workflow panel. Click on the three dots, then on Bulk Re-queue.

Requeue a Consensus sub-task

When a task is sent to a Consensus-type stage, Ango Hub creates copies of it, called sub-tasks, and places them in each consensus sub-stage.

For example, if you have a consensus stage with three Label sub-stages, for each task entering the Consensus stage, Ango Hub will create three copies of it and place each copy in its own Label sub-stage queue.

If you wish to requeue one such sub-task, navigate to the Tasks tab, expand the main Consensus task, and click on the "Requeue" button on the sub-task:

Re-queuing options

First, open the re-queue dialog in one of the ways shown in the previous sections. The re-queue dialog will appear:

Select a Stage: select here the stage where you'd like to send the tasks.

Remove Annotations: Clears all annotations, including objects, brush traces, classifications, and relations.

Remove Assignees: If the task was assigned for labeling/reviewing to a specific user, toggling this on will remove the assignment.

Remove Stage History: Deletes the stage history on the selected tasks.

Last updated