YOLO | Pose Estimation

The YOLO | Pose Estimation plugin allows you to estimate the pose of people in your image, using points, bounding boxes, and polylines.

Plugin Functionality

Adding the plugin to your organization will allow you, with one click, to estimate the pose of people in your image, using points, bounding boxes, and polylines on image (.jpg, .png) assets in the project of your choice.

Using the Plugin

From the Plugin Directory, search for the name of the plugin and add it to your organization. More information on installing plugins can be found in the Installing Plugins page.

Ensure you have created at least one Point-type, one Polyline, and one Bounding Box tool in your project.

From the Project Settings

Then, navigate to the project where you'd like to run the plugin.

Enter the Settings tab, then the Plugins section.

Find the plugin, and click on Open. A dialog will appear:

Ensure the dot before the plugin's name is green. The dot indicates the plugin's status, where green signifies the plugin's code is running, and red signifies the plugin's code is not running.

You will not be able to run plugins the code of which isn't running.

Do the following:

1. In the "Class Mapping" field, open the left dropdown, and pick the Points class.

2. Open the right dropdown, and pick from one of the Point tools you have created in your project.

3. Click on the "plus" button to finalize the pairing.

4. Repeat steps 1, 2, and 3 for the bounding box and for the polyline tools.

5. In the "Asset ID" field, enter the ID of the asset you would like to annotate.

6. In the "Task ID" field, enter the ID of the task you would like to annotate. (you may find info for steps 5 and 6 by entering the task and opening the "Task Info" drawer on the right-hand side, or by obtaining project information from the SDK.)

Click on Run. The plugin will start detecting the pose of the humans in the image.

From Workflow

In the project workflow, add a Plugin-type stage such that it receives the assets you wish to annotate as input.

Click on the plugin-type stage and select the plugin, then alter its settings as necessary:

Example image with a different plugin.

Click on Save to save the workflow. The plugin will now run every time it receives a compatible image asset as input.

From the Labeling Editor

With the image labeling editor open, click on the "Plugin Dropdown" to see a list of available model plugins:

If a default configuration was set, click directly on the plugin to run it immediately with the pre-set configuration. Otherwise, click on the three dots next to it to open the Run menu.

From the Run menu, configure its settings and click on Run to run it on the current image.

Plugin Configuration Settings

{
  "only_mapped_classes": false,
  "threshold": 0.5
}