Contact iMeritAngo Hub WebsiteLog In to Ango Hub

TPT Export

Overview

The TPT Export plugin enables you to generate and download comprehensive reports containing essential annotation performance metrics from your project. These reports provide insights into labeling efficiency, review durations, and annotation counts across different stages, helping you evaluate team performance and optimize your annotation workflows.

Cover

TPT Export

Plugin Functionality

The TPT Export Plugin calculates and exports detailed time metrics for annotation tasks, providing insights into labeling efficiency and productivity. It offers flexible configuration options for filtering, measurement units, and reporting precision.

  • Calculates and exports detailed time-based metrics for annotation tasks to analyze labeling performance and productivity.

  • Allows defining a specific date range to include only tasks completed within the selected period.

  • Optionally excludes idle durations to ensure time reports reflect only active annotation work.

  • Supports flexible time units such as seconds, minutes, or hours for clear and consistent reporting.

  • Accurately measures time spent on nested or hierarchical classifications for comprehensive duration tracking.

TPT Export Plugin

Running the TPT Export plugin on your project generates two CSV files: one with the [TPT] extension and another with the [HIST] extension.

[TPT] File

Each row in this file represents an asset and provides a summary report showing the total labeling and review durations, along with the final annotation counts.

[HIST] File

Each row in this file corresponds to a single workflow stage, essentially showing the stage history. The annotation count and duration values indicate the amount of work performed during that specific stage.

The CSV files contains following columns:

  • Batch

  • External ID

  • Task ID

  • AngoHub URL

  • Asset's Stage

  • Number of Pages

  • Label Stages

    • Total Label Duration (sec)

    • Total Idle Label Duration (sec)

    • Total Blur Label Duration (sec)

    • Total Label Stage Visits

    • Last Label Stage

    • Last Labeler

  • Review Stages

    • Total Review Duration (sec)

    • Total Idle Review Duration (sec)

    • Total Blur Review Duration (sec)

    • Total Review Stage Visits

    • Last Review Stage

    • Last Reviewer

  • Number of Annotations

    • Number of Classifications

    • Number of Tools

    • Number of Tool Classifications

    • Number of Relations

  • Number of Issues

Supported Data Types

  • Compatible with all data types available in AngoHub.

Supported Annotation Tools

  • Compatible with all annotation tools available in AngoHub.

Plugin Configuration

From the Stage Filter field, pick the stages containing the tasks you'd like to get the export of. Similarly, from the Batch Filter field, you may select one or more batches the tasks of which will be exported. By default, all tasks are exported from all batches.

If you wish to receive an email when the export is complete, toggle Send Email on.

You may vary a number of settings related to your export from the Config JSON field. Each option is detailed below:

{
  "start_date": "2020-12-31",
  "end_date": "today",
  "extract_idle_duration": false,
  "duration_unit": "sec",
  "count_nested_classifications": true,
  "include_key_frames_only": true,
  "verbose": false,
  "verbose_frequency": 1000
}

  • "start_date": The starting date for the period over which the performance metrics will be calculated.

    • Example:

      • "start_date": "2020-12-31"

      • "start_date": null

      • "start_date": "today"

  • "end_date": The ending date for the period over which the performance metrics will be calculated.

    • Example:

      • "end_date": "2020-12-31"

      • "end_date": null

      • "end_date": "today"

  • "extract_idle_duration": A boolean flag that determines whether idle and blur durations are included in the reports.

    • Example:

      • "extract_idle_duration": true

      • "extract_idle_duration": false

  • "duration_unit": The unit of time for the metrics aggregation. This defines the granularity of the time per task metrics.

    • Options:

      • "msec"

      • "sec"

      • "min"

      • "hour"

    • Example:

      • "duration_unit": "min"

  • "count_nested_classifications": Determines whether nested classifications should be counted in the metrics.

    • Example:

      • "count_nested_classifications": true

      • "count_nested_classifications": false

  • "include_key_frames_only": Specifies whether only key frames should be included in the metrics calculation. (For video assets only)

    • Example:

      • "include_key_frames_only": true

      • "include_key_frames_only": false

  • "verbose": Controls the verbosity of the output. When enabled, more detailed logs and progress updates will be provided.

    • Example:

      • "verbose": true

      • "verbose": false

  • "verbose_frequency": Specifies how often verbose logs should be generated, in terms of processed tasks.

    • Example:

      • "verbose_frequency": 50

Last updated