YOLO | Instance Segmentation

The YOLO | Instance Segmentation plugin allows you to segment a variety of object types on image files in your project.

The plugin will draw a segmentation around each object type you specify, using a segmentation tool of your choice.

Plugin Functionality

Adding the plugin to your organization will allow you, with one click, to segment a variety of objects on image (.jpg, .png) assets in the project of your choice. The plugin will draw a segmentation around each object belonging to the categories you've selected.

Using the Plugin

From the Plugin Directory, search for the name of the plugin and add it to your organization. More information on installing plugins can be found in the Installing Plugins page.

Ensure you have created at least one Segmentation-type labeling tool in your project for each of the object classes you wish to segment.

From the Project Settings

Then, navigate to the project where you'd like to run the plugin.

Enter the Settings tab, then the Plugins section.

Find the plugin, and click on Open. A dialog will appear:

Ensure the dot before the plugin's name is green. The dot indicates the plugin's status, where green signifies the plugin's code is running, and red signifies the plugin's code is not running.

You will not be able to run plugins the code of which isn't running.

Do the following:

1. In the "Class Mapping" field, open the left dropdown, and pick from one of the classes the plugin can detect.

2. Open the right dropdown, and pick from one of the Segmentation tools you have created in your project.

3. Click on the "plus" button to finalize the pairing. Now the object class and your segmentation tool are linked. The plugin will use the selected segmentation tool to label the selected category.

4. Starting again from Step 1, link as many tools to categories as needed.

5. In the "Asset ID" field, enter the ID of the asset you would like to annotate.

6. In the "Task ID" field, enter the ID of the task you would like to annotate. (you may find info for steps 5 and 6 by entering the task and opening the "Task Info" drawer on the right-hand side, or by obtaining project information from the SDK.)

Click on Run. The plugin will start segmenting the selected object classes in the image.

From Workflow

In the project workflow, add a Plugin-type stage such that it receives the assets you wish to annotate as input.

Click on the plugin-type stage and select the plugin, then alter its settings as necessary:

Example image with a different plugin.

Click on Save to save the workflow. The plugin will now run every time it receives a compatible image asset as input.

From the Labeling Editor

With the image labeling editor open, click on the "Plugin Dropdown" to see a list of available model plugins:

If a default configuration was set, click directly on the plugin to run it immediately with the pre-set configuration. Otherwise, click on the three dots next to it to open the Run menu.

From the Run menu, configure its settings and click on Run to run it on the current image.

Plugin Configuration Settings

{
  "only_mapped_classes": false,
  "threshold": 0.5,
  "polygon_simplification_tolerance": 0.8
}