General Object Segmenter

The General Object Segmenter plugin allows you to detect a variety of objects on all image files in your project.

The plugin will either draw a bounding box, a polygon, or a segmentation around each object type you specify, using a labeling tool of your choice.

Plugin Functionality

Adding the plugin to your organization will allow you, with one click, to detect a variety of objects on all image (.jpg, .png) assets in the project of your choice. The plugin will either draw a bounding box, a polygon, or a segmentation around each object belonging to the categories you've selected.

The plugin will run object detection on all image assets in your project.

Currently, there is no way to only select specific assets as targets for the object detection.

Currently, the following object classes can be automatically detected:

Traffic

person	bicycle	car
motorcycle	airplane	bus
truck	train	boat
traffic light	fire hydrant	stop sign
parking meter	bench

Animals

zebra	elephant	bird
cat	dog	horse
sheep	cow	giraffe

Clothes/Accessories

backpack	umbrella	handbag
tie	suitcase

Sports

frisbee	skis	snowboard
sports ball	kite	baseball bat
baseball glove	skateboard	surfboard
tennis racket

Kitchen

wine glass	cup	fork
knife	spoon	bowl

Food

banana	apple	sandwich
orange	broccoli	carrot
hot dog	pizza	donut
cake

Home

chair	couch	potted plant
bed	dining table	toilet
tv	microwave	oven
toaster	sink	refrigerator
book	clock	vase
scissors	teddy bear	hair drier
toothbrush

Electronics

laptop	mouse	remote
keyboard	cell phone

Using the General Object Segmenter Plugin

From the Plugin Directory, search for General Object Detector and install the plugin to your organization. More information on installing plugins can be found in the Installing Plugins page.

The name of the plugin is General Object Segmenter.

Usage

First, ensure you have created at least one Bounding Box, Polygon, or Segmentation tool in your project for each of the object classes you wish to detect.

Then, navigate to the project where you'd like to perform the object detection task.

Enter the Settings tab, then the Plugins section.

Find the plugin, and click on Open. A dialog will appear:

Ensure the dot before the plugin's name is green. The dot indicates the plugin's status, where green signifies the plugin's code is running, and red signifies the plugin's code is not running.

You will not be able to run plugins the code of which isn't running.

In the Class Mapping field, do the following:

1. Open the left dropdown, and pick from one of the 80 classes the plugin can detect.

2. Open the right dropdown, and pick from one of the Bounding Box, Segmentation, or Polygon tools you have created in your project.

3. Click on the "plus" button to finalize the pairing. Now the object class and your tool are linked. The plugin will use the selected tool to label the selected category.

4. Starting again from Step 1, link as many tools to categories as needed.

Click on Run. The plugin will start detecting the selected object classes in all images in your project.

A Sample Object Segmenter Plugin Output

You may check the progress of the conversion from the Plugin Sessions dialog. More information on checking plugin progress here.

Because the plugin first performs detection on all assets, and only then imports the tokens to Ango Hub, depending on the number and size of the assets, it may take a long time for the prelabels to appear in your project.