TPT Export
The TPT Export plugin enables you to generate and download comprehensive reports containing essential annotation performance metrics from your project. These reports provide insights into labeling efficiency, review durations, and annotation counts across different stages, helping you evaluate team performance and optimize your annotation workflows.
Plugin Functionality
Running the TPT Export plugin on your project generates two CSV files: one with the [TPT] extension and another with the [HIST] extension.
[TPT] File
Each row in this file represents an asset and provides a summary report showing the total labeling and review durations, along with the final annotation counts.
[HIST] File
Each row in this file corresponds to a single workflow stage, essentially showing the stage history. The annotation count and duration values indicate the amount of work performed during that specific stage.
The CSV files contains following columns:
Batch
External ID
Task ID
AngoHub URL
Asset's Stage
Number of Pages
Label Stages
Total Label Duration (sec)
Total Idle Label Duration (sec)
Total Blur Label Duration (sec)
Total Label Stage Visits
Last Label Stage
Last Labeler
Review Stages
Total Review Duration (sec)
Total Idle Review Duration (sec)
Total Blur Review Duration (sec)
Total Review Stage Visits
Last Review Stage
Last Reviewer
Number of Annotations
Number of Classifications
Number of Tools
Number of Tool Classifications
Number of Relations
Number of Issues
Using the Plugin
From the Plugin Directory, search for the name of the plugin and add the plugin to your organization. More information on installing plugins can be found on the How to Add Plugins to Your Organization page.
Usage
Navigate to the project where you'd like to get the data.
Enter the Settings tab, then the Plugins section.
Find the plugin, and click on Open. A dialog will appear:
In the Config JSON area, you can tweak seven different input parameters. By default, they are:
{
"start_date": "2020-12-31",
"end_date": "today",
"extract_idle_duration": false,
"duration_unit": "sec",
"count_nested_classifications": true,
"include_key_frames_only": true,
"verbose": false,
"verbose_frequency": 1000
}"start_date": The starting date for the period over which the performance metrics will be calculated.
Example:
"start_date": "2020-12-31"
"start_date": null
"start_date": "today"
"end_date": The ending date for the period over which the performance metrics will be calculated.
Example:
"end_date": "2020-12-31"
"end_date": null
"end_date": "today"
"extract_idle_duration": A boolean flag that determines whether idle and blur durations are included in the reports.
Example:
"extract_idle_duration": true
"extract_idle_duration": false
"duration_unit": The unit of time for the metrics aggregation. This defines the granularity of the time per task metrics.
Options:
"msec"
"sec"
"min"
"hour"
Example:
"duration_unit": "min"
"count_nested_classifications": Determines whether nested classifications should be counted in the metrics.
Example:
"count_nested_classifications": true
"count_nested_classifications": false
"include_key_frames_only": Specifies whether only key frames should be included in the metrics calculation. (For video assets only)
Example:
"include_key_frames_only": true
"include_key_frames_only": false
"verbose": Controls the verbosity of the output. When enabled, more detailed logs and progress updates will be provided.
Example:
"verbose": true
"verbose": false
"verbose_frequency": Specifies how often verbose logs should be generated, in terms of processed tasks.
Example:
"verbose_frequency": 50
If you wish to receive an email when the export is complete, toggle Send Email on.
Click on Run to receive your data. You'll get a notification when it's ready. Clicking on the notification will start the download of your data.
You may check the progress of the conversion from the Plugin Sessions dialog. More information on checking plugin progress refer to the Monitoring Plugin Progress page.
Last updated