Changelog
Last updated
Last updated
Project managers and leads can now see the export history of a project from the project’s Export tab.
The Workflow user interface has been improved. Connections and stages now have clearer colors, stages which have been selected are highlighted, and clicking on a stage highlights the connections connected in and out of it.
Support for NIFTI files has been enhanced, with a wider range of NIFTI file types now supported.
Organization admins can now see the IDs of all plugins in the organization from the “Plugins” page.
When a brush trace instance is selected, users can now use keyboard shortcuts to switch between different brush tool modes: Brush (Q), Pen (W) and Eraser (E).
When a brush-type class is selected, users can now press R to toggle on or off overwrite mode.
In the image labeling editor, pressing Shift + Z now makes the image fit to screen. As a result, the shortcuts to move to the first/last frame in a video have been changed to Alt + Z (⌥ + Z) and Alt + C (⌥ + C).
The get_project() SDK function now returns an accessible signed URL linking to the project instructions if present.
The benchmark export output now contains the totalDuration, totalIdleDuration, and totalBlurDuration properties.
A link to Ango Hub’s status page has been added to the Help section that appears when clicking on the question mark icon.
The documentation displayed in the Command Line Interface section of the Add Data dialog has been updated.
The brushDataUrl and the medicalBrushDataUrl properties have been added to the Task Info sidebar when present.
The invitation flow for users who sign up through Okta SSO has been improved.
When filtering by batch, now you can filter by tasks which have been assigned to any batch, and tasks which have not been assigned to any batch.
The opacity of all objects on screen in visual labeling editors can now be toggled completely on or off by pressing on Y on your keyboard.
The Shift + H keyboard shortcut to hide/unhide all annotations has been removed. In its place, press H when no object is selected to perform the same action.
Fixed bugs where:
Attempting to close a segmentation object by using the N keyboard shortcut while the mouse cursor was hovering over the initial segmentation point could freeze the UI.
While drawing a brush trace in Pen mode, having the mouse cursor leave the drawing area could potentially cause the cursor to be stuck in “drawing” mode.
In projects with the “Ground Control” toggle turned on, the isCompleted property would be occasionally returned as “true” for rejected tasks.
In the page displaying organization storages, pagination would not work correctly.
When clicking on “Re-run” from the plugin stage settings, occasionally, not all assets in the plugin stage would be re-run.
Occasionally, the sign-up flow would return an error when attempting to sign up as a new user.
Occasionally, attempting to enable 2FA would return an error.
Occasionally, attempting to delete a brush trace instance using the Del button could crash the UI.
The opacity slider would not work correctly for brush trace instances.
In tasks with more than ~150 individual brush instances, the UI could freeze.
When focusing on the 2FA OTP text area, suggestions from previous text completions would appear.
In specific circumstances, in projects with benchmarking enabled, occasionally, benchmark tasks did not have the Submit button.
The totalDuration of a task would not be correct in benchmark tasks.
In the webhook response to a task, the medicalBrushData field would appear to be populated in tasks which has a Brush tool, but not a Voxel Brush tool.
In the medical labeling editor, activating both the threshold and the border functions at the same time could cause the UI to freeze.
Pinning a project could, in rare circumstances, cause another project in the organization to disappear from the list.
Quickly navigating between images in multi-image assets could cause the loading bar to behave unexpectedly.
In the medical editor, when the Threshold function was open, drawing with the Pen mode of the Voxel Brush tool would not work correctly.
Brush trace imports would not appear in overlay images.
Brush traces would occasionally not appear when accessing previous versions of a task through the Stage History panel.
Users can now change the class of an existing brush trace instance. Read more in our docs.
The in-editor plugin menu now features liveness indicators for listed plugins.
Hovering over brush instance object rows in the “Objects” panel now also causes the related brush instance to be highlighted.
While drawing using the Brush tool, after having created multiple closed loops in the same instance, undoing (Ctrl + Z / ⌘ + Z) will undo the creation of the latest closed loop rather than undoing the entire instance.
In image / video assets with brush traces, the performance of unhiding all annotations (Shift + H) has been dramatically improved.
While drawing with the Pen mode of the Brush tool, the performance of finalizing a loop has been improved, with the duration of the finalization being reduced, depending on image and region size, by between one third and one half.
In assets with a large number of brush trace annotations, the general performance and responsiveness of the platform has been improved significantly.
The speed at which an existing brush trace instance is highlighted when hovering over it with the mouse cursor has been significantly improved.
When clicking on a brush trace instance, the cursor will not immediately turn into the Pen tool, giving users the chance to right-click on the instance to open the context menu. Users can still make edits to existing instances by clicking on them and then clicking on either the Pen or Brush tools on the top toolbar.
When opening a task with a considerable number of brush traces, Ango Hub will wait to display the asset until the brush traces are loaded as well.
The code underlying all labeling operations, including label creation, editing, and saving, as well as parts of task and asset management, has been reviewed in its entirety and optimized, leading to potential performance and stability improvements across the platform.
Server-side code powering issue creation, stage history, sample projects, and storage integrations has been reviewed and optimized, leading to potential performance and stability improvements in those areas.
Fixed bugs where:
Zooming in and out of the waveform in the audio labeling editor would not work.
While drawing using the Pen mode of the Brush tool,
panning could cause the cursor to create a pen point.
the trace would occasionally not follow the cursor exactly for small movements and for extremely fast movements.
pressing on N while the mouse cursor hovers over the end point of the trace would cause the UI to freeze.
Occasionally, connections coming out of a Logic-type stage would appear solid rather than dashed in the workflow editor.
Occasionally, in assets which were pre-labeled in the Start stage, the pre-annotations would not appear on screen when selecting the “Start” stage from the task’s stage history panel.
While using the Brush tool in assets with overlays, switching between the main and overlay images after having used Ctrl + Z would crash the UI.
After erasing a brush instance with the Eraser tool, it would occasionally not be possible to draw a trace on that area again.
After clicking on an existing brush trace instance, users would need to move the mouse cursor to see that instance being highlighted.
Under specific circumstances, using the externalId filter in the Tasks tab could cause Ango Hub to crash.
In a project’s Workflow tab, pasting certain incorrect JSON could crash the UI.
A user would not be redirected to the correct page after login if they opened a direct link without being initially logged in.
The Brush tool now defaults to Pen mode.
Project managers can now copy-paste workflows between projects. Read our docs to learn how.
Ango Hub now extracts the number of words of text files and the duration of audio files, and displays this data on the labeling editors.
Support for the Okta single sign-on (SSO) provider has been added.
Export plugins added to the organization are now also visible in the Export tab of projects in the organization.
While drawing a segmentation, hovering over another object will not highlight that object.
When the Segmentation tool is open and the Merge/Subtract functions are not available, they are hidden completely instead of being greyed out.
The toggles for the Auto-Merge and Auto-Subtract functions are now visible when selecting an existing segmentation instance.
The built-in File Explorer now allows project managers to prevent the importing of duplicates when importing folders.
The built-in File Explorer now allows project managers to import folders of files as single multi-image assets.
The code powering Workflow and the code powering the Voxel Brush tool have been fully reviewed and rewritten, enhancing stability and performance.
When an org administrator is demoted to the “member” role, or when they are removed from the organization altogether, the plugins added by them to the organization are also removed from the org.
During log in, Ango Hub now asks for the email and password separately. This way, if the entered email is part of a single sign-on (SSO) scheme, the user will be redirected to the SSO provider page directly.
Fixed bugs where:
In assets with overlay images, brush traces would disappear when switching between the main image and overlay images.
In assets with overlay images, skipping would not refresh the image displayed in the editor.
In the medical labeling editor, different Voxel Brush classes with the same color would occasionally be treated as if they were the same class.
Occasionally, in the medical editor, the spherical (3D) Voxel Brush tool would behave as if it were a 2D tool.
In the medical labeling editor, scrolling through slices containing hidden voxel brush traces would cause flickering on screen.
Tooltips over NER entity classes would be off center.
Occasionally, removing assignees while re-queuing would not work.
Occasionally, when users were added to projects, they might receive erroneous notifications indicating that they were removed from the project.
In the login page, the width of the password recovery section would be different from that of the normal login flow.
Attempting to log in without entering an email would display unrelated errors.
Attempting to sign up or log in with an email containing a plus sign would cause errors.
Rarely, attempting to reset the user password would not redirect to the correct page.
Occasionally, quickly switching between audio assets might cause Ango Hub’s UI to crash.
Plugin stages now feature a liveness indicator for the selected plugin directly on the workflow stage. Liveness checks may be performed manually using a new “Refresh” button in the plugin stage settings.
If an unsupported asset is uploaded, it will be marked with an “error” icon and attempting to open it will give an error.
In the medical labeling editor, function dialogs are now collapsible.
In the medical labeling editor, Window Levels can now be set to be negative from the provided number input areas.
Handling of how objects behave when they are dragged partially outside of the asset’s boundaries has been improved.
As a result of the introduction of the new stage filters in the Tasks tab, the quick “Complete” filter has been removed from the Tasks tab to remove visual redundancies.
Images uploaded as overlay now have their dimensions stretched to match the dimensions of the main image.
In the text labeling editor, a new toggle has been added to the quick settings to enable the display of NER classes next to each entity.
Users with the Lead role may now only annotate and edit tasks they have been assigned to, and in the labeling and review queues, they will only be shown tasks in stages available to them.
Fixed bugs where:
In the medical labeling editor, after setting the window level with a preset, attempting to change the window level manually would reset the window level to the value it was before the initial preset setting.
If an object was moved partially outside of an image/video frame, the object would be cut to align with the image / video frame’s edges.
Dragging a segmentation point outside of the boundaries of an asset would occasionally cause the segmentation to be deleted.
Occasionally, when opening a task, a brief error message would be flashed on screen before the asset was loaded.
Attempting to upload more than ~300 files by dragging and dropping would not work.
In the file explorer, a user could add the same extension to both the accepted and rejected lists at the same time.
Attempting to remove a user from a project from the three-dot menu would not remove the user.
Attempting to load files with incorrect headers to the Asset Builder would cause the UI to crash.
In extremely rare cases, requeuing a task from the Start to a Label stage would cause the task to be deleted.
Attempting to use the brush tool on a task where brush pre-labels had just been uploaded would remove all brush traces from the task.
In certain circumstances, in the Plugin stage settings panel, the plugin picker dropdown would display duplicate entries.
Occasionally, a “No asset updated” message would display after correctly adding assets to batches.
Organization admins can now make two-factor authentication (2FA) mandatory for their organization. Read more in our docs.
The Tasks tab now features a quick and easy way to filter by stage.
The results of tasks used to benchmark users can now be downloaded from the project settings.
The Workflow stage now supports the “All Answers” adjudication strategy. With it selected, the task being output from the Consensus stage will be a composite task, merging all annotations made from all users in the Consensus stage.
In the text labeling editor, pressing Shift + T will toggle displaying class names next to each entity in the text.
The Stage History of a task now displays when a task was skipped.
Backup codes are now offered to users who enable 2FA for their account. If you have already enabled 2FA for your account, we strongly recommend disabling and then re-enabling it again to obtain the backup codes.
In image tasks with overlays, users can now switch between main and overlay images without the annotation being drawn being deleted.
The text of the Skip button has been updated in projects where skipping is disabled for improved clarity.
The handling of existing objects after their class is deleted from the category schema has been improved.
In the Segmentation tool, the eraser now stays selected until it is manually deselected.
The ability to re-queue tasks has been restricted to users with Lead or Manager permissions only.
The performance of syncing queues from the Workflow tab has been improved dramatically, leading to significantly lower queue sync times.
Webhook responses now contain two new properties: answerSchemaId, stageId and stageName.
Tasks which are not benchmarks no longer contain benchmark-related properties in the export.
Database stability improvements.
Fixed bugs where:
Workflows of cloned projects would give unexpected errors on save.
In extremely rare cases, segmentations could not be closed.
When attempting to add new points to a polygon, the new point green “dot” would be stuck on the asset even after polygon creation.
In some cases, opening an invitation would cause the “Invalid Invitation” error to appear even if the invitation was valid.
In Consensus stage settings, the “Auto-Assign” function would not work correctly if Plugin-type sub-stages were present.
Project managers can now configure how skipping works in their projects. They may disable skipping altogether or they may choose to unassign tasks from the user skipping them. Read our docs for more.
Tasks can now be created using the Asset Builder through the Ango SDK. Read our docs for more.
Users can now enable a crosshair around the cursor’s location. Read our docs for more.
In the stage history of tasks which passed through a consensus stage, their iteration number is now visible.
Expanded the availability of Real World Coordinates to more types of NRRD files.
The real-world length of lines created with the new medical tape measure tool is now available in the export. Read our docs for more.
Overlays can now have unique IDs, which will appear in the Overlay dropdown. Read our docs for more.
The code underlying the built-in file explorer table has been rewritten, significantly improving performance in folders with more items.
The code powering projects in Ango Hub has been rewritten, bringing potential stability and performance improvement.
The order in which plugin logs are displayed in the “Plugin Sessions” dropdown has been altered for clarity.
The Brush tool can now be used on single-frame TIFF assets.
Fixed bugs where:
In the medical labeling editor, attempting to use the Crosshair tool on the 3D view would cause the UI to crash.
In the video labeling editor, changing the answer of an attribute would reset the answers of other attributes.
Occasionally, users would not receive a notification when the export is ready.
The “Upload” button in the file explorer would be active when a folder is selected even when the “Upload Subfolders” toggle was not active.
In the medical labeling editor, attempting to set the 3D view as the main one would crash the UI.
Users could create projects using the API even without the correct permissions.
Attempting to clone a project with a particular workflow configuration would cause an error.
Webhooks now, in addition to all previous information, also return the project’s unique ID and category schema. Read more about Webhook functionality on Ango Hub here.
Users can now change the brightness, contrast, and color inversion sliders with new keyboard shortcuts.
Users can now lock and unlock objects using a new keyboard shortcut: L. See all keyboard shortcuts in Ango Hub here.
Fixed bugs where:
Export links provided in “Export Ready” emails would be broken.
If a user with a poor internet connection clicked on “Submit” multiple times, multiple entries would be created in the task’s Stage History.
The radiology labeling editor now features real-world coordinates. When hovering over a voxel with your cursor, you will now be able to view the real-world coordinates of the voxel, in millimeters, in the data probe. Read more about the Data Probe here.
Tape Measure measurements in the radiology labeling editor now feature real-world measurements in millimeters. Read more about the Tape Measure tool here.
Organization admins can now see, from the organization page, which organization members enabled 2FA.
If an object has a description set, in the video editor’s timeline view, the description will be displayed instead of the class name.
During the 2FA setup workflow, an option was added to enable 2FA on devices without the capability to scan QR codes.
When using the Segmentation tool, the Auto-merge and Nudge Draw tools have been made mutually exclusive.
The number of colors available from the tool color picker has been doubled.
The email displayed in the “iMerit Workforce” section in the Members section of the project settings has been changed to a link to iMerit’s “Contact Us” page.
The text in asset import dialogs has been updated to reflect the addition of .mkv support.
The text in the 2FA setup dialog has been improved for clarity.
Fixed bugs where:
When opening a link belonging to an organization different from the user’s active organization, an error message would be displayed under the organization switch dialog.
Previously, if Ango Hub returned an error, a completely blank page would be displayed. Now, a new error page has been designed, containing details about the error encountered, allowing for better and faster troubleshooting.
As part of our transition to a more stable video metadata extraction process, the ability to manually extract metadata using the old method from the UI was removed.
Asset Builder templates will now also save batch selection columns.
Fixed bugs where:
Model plugins could not be included in Consensus-type stages
Occasionally, after signup, the organization name would not be visible in the navigation bar.
Occasionally, the File Explorer plugin would take a long time to load remote files.
Occasionally, the File Explorer plugin would not return a “Success” even after importing assets successfully.
Rarely, in videos, the frame number and the time stamp would not match correctly.
Rarely, the consensus stage, when connected directly after the Start stage, would not behave in the expected way.
Introducing the built-in File Explorer, a new and easier way to import assets directly from a private AWS S3, Azure, or GCP storage. Navigate connected storages and import large quantities of data with a single click.
In the medical labeling editor, Hounsfield units are now rounded to the second decimal.
In the medical labeling editor, the “Main” and the “Reference” volumes are now clearly tagged for easier recognition.
Project managers can now select and edit or delete assets as they are undergoing metadata extraction.
Three new sample projects have been added under a new “Generative AI” heading.
In the audio labeling editor, spot issues placed with a single click will now clearly display the timestamp of where they have been placed with a line.
In the text labeling editor, in the “Objects” panel on the bottom left, expanding single relation entries now displays the content of the single relations.
When cloning projects, project managers can now choose to include the cloning of plugin presets and all project settings as well.
The code powering all import functionality (pre-labels, attachments), login and authentication, plugins, and dashboards, has been enhanced and rewritten, potentially leading to stability and performance improvements.
Ango Hub now renders files in the .ogg format as audio rather than video.
In the medical labeling editor, when an asset with reference volumes is displayed, the hamburger menu now contains the names of the volumes.
In the medical labeling editor, when a reference volume is being displayed, it can now be set as the “Main” volume. This is the volume which will be contained in the export and upon which segments will be created. Switching the main volume will delete all annotations present in the previous main volume.
In project workflows, project managers can now feed tasks back to a consensus stage from other stages (e.g. review stages). When this happens, while the stage history will show all previous judgments, the consensus score will only be calculated using the latest consensus group.
In the NER labeling editor, users can now quickly jump to an object-specific text annotation issue.
Project managers can now upload files of up to 512MB when using the Local Upload method (i.e. “Drag and Drop”) to add assets to a project.
In the video labeling editor, users can now quickly jump to any frame by typing its number.
Users can now quickly type to search between all the organizations they are part of.
The Ango Hub UI in various places in the project views has been slightly altered to minimize empty space.
The final export now contains consensus scores if the project workflows contains a consensus stage.
Fixed bugs where:
Very rarely, segmentations of an NRRD would be saved to another NRRD while performing a certain click sequence.
In the NER editor, certain annotations would display as shifted by one.
Editing the names of stages within a consensus stage would cause “missing connections” errors to appear upon saving.
Occasionally, a project manager would be unable to add a user to an organization due to Ango Hub incorrectly marking that user as already existing.
HTML attachments imported using the SDK would not display correctly in the UI.
In the export, the medicalBrushDataUrl field is missing the label task history.
In very specific circumstances, tasks which failed a consensus stage would not move to the next stage.
Occasionally, a plugin’s status would appear as “failed” even though it ran correctly.
In screens with very low resolution, the “Sign Up” button would not be visible during user sign up.
When uploading a large number of files using the “Local Upload” method, a visual overflow bug would occur.
Occasionally, medical brush data could not be loaded as preannotation.
Project managers can now save Asset Builder code as templates they can reuse in the project.
Project managers can now import reference medical volumes. Users are able to switch between them as they annotate. Read more in our docs.
Users can now customize which axis they wish to see in each medical editor view. Read more in our docs.
Users can now quickly annotate text tokens by double clicking, and multiple tokens by double clicking and dragging.
Project managers can now assign individual tasks created with the Asset Builder to batches. Read more in our docs.
Users can now mark points in splines by hovering over them and pressing B. Marked points will appear in a different color and will possess a “marked” property in the final export.
Spline points can now be snapped to existing spline points. Read the Spline docs for more.
While drawing splines, users can now use the keyboard shortcuts Y and U to narrow/widen the current spline point by 1 pixel, or 0.5 pixels if holding the Alt/Option button.
Project managers can now import multiple single-frame DICOM files as a single asset. Read more in the docs here.
Users can now open area-specific issues on audio files.
Added full support for all Unicode languages for data uploaded to the Asset Builder through .csv tables. (This includes all Indian languages and many more.)
Attempting to remove a storage integration from an organization now displays a confirmation message that is both more informative and more difficult to accidentally accept.
The ability to import sample projects has been made more prominent when viewing the organization’s list of projects.
The library used to parse Excel spreadsheet files (Sheet JS) has been updated, fixing a potential security vulnerability. (CVE-2024-22363)
In the sample JSON provided in the “Label Import” dialog, sample JSON for importing tree dropdown classifications has been added.
The code powering export, user, organization, issue, database, and notification-related functionality has been optimized, potentially leading to improved stability and performance.
The code underlying the medical labeling editor has been rewritten to prepare for future updates, potentially leading to improved stability and performance.
A number of tooltips have been added throughout Ango Hub to improve intelligibility of action buttons.
In the text labeling editor, users can now quickly jump to the location of a spot issue from the Issues drawer.
The user is now warned in advance and when they try to import more than 20k rows at once in the Asset Builder if they attempt to do so.
The warning shown when users attempt to upload more than 20k rows at a time with the Cloud Upload method has been improved.
Multi-page DICOM assets are now loaded all at once, improving speed when navigating between pages.
The auto-merge functionality is now available for the Segmentation tool. Click on an existing segmentation and then on the Auto-Merge icon to quickly expand it.
Fixed bugs where:
In some cases, Ango Hub would allow workflows with unconnected inputs or outputs.
In some cases, video files with the .ogg format would not have their metadata correctly detected.
In some cases, quickly switching between unloadable audio files would cause a blank screen.
In multi-frame 2D DICOMs, unannotated frames would occasionally contain annotations from other pages in the export.
In some cases,
In the medical annotation editor, when using the spherical brush in conjunction with the threshold tool, only certain slices in the sphere were correctly bound by the threshold.
When cloning or copying annotations, some nested classifications would not be copied over.
If a Consensus stages was created but no tools/classifications were selected as part of its threshold, Hub would return an error as tasks exit the stage.
The Spline labeling tool is now available. Add the tool to your project to draw curved lines with adjustable width.
Project managers can now choose to display users a live preview of KaTeX markup in text classifications.
Project managers can now pre-label assets directly from within the Asset Builder, by picking a column from the table which will be the source for the pre-annotations.
Fixed a bug where changing the class of an audio segmentation would not change its color
Fixed a bug where, in rare circumstances, clicking on a logic stage would crash the UI.
Fixed a bug where, occasionally, asset builder inline classifications would visually disappear after saving or submitting a task.
Fixed a bug where, rarely, the names of classifications would be repeated above or below inline classifications in assets created with the asset builder.
The user interface in the audio labeling editor has been completely revamped to enable audio transcription, translation, and better NER workflows on Hub, including a chronological list of segments, easy transcription, looping, and more.
The Ranking tool is now available as a classification type. During asset upload, project managers may add data which will appear as a ranking option Read more in our docs.
In annotator-type logic stages, after a user email is included in the logical statement, it will be removed from the list of available users to add to the logical statement, as the user has already been added.
In the labeling editor, in the Asset Drawer present in the left-hand side of the screen, which users with the lead and manager role are able to view, the asset currently open is now highlighted in a different color.
Project managers can now assign individual assets to batches when uploading them with the Cloud Import method. Read more in the docs.
Benchmark-related statistics and details are now available when obtaining the CSV export from a project’s Performance tab.
Ango Hub now extracts metadata from video assets on upload more efficiently, allowing for videos to be available sooner.
The appearance of the single relation has been altered to improve performance.
Re-ordering and Syncing now works in consensus stages.
Fixed a bug where segmentation points created manually would, in the export, have a coordinate precision of more than two decimal points.
Fixed a bug where filtering by “Answer”, in the Task list, would occasionally return an error.
Fixed a bug where a large number of classifications would cause a visual glitch to appear in the asset builder.
Fixed a bug where inline classifications might not appear correctly in assets created with the asset builder.
Fixed a bug where, occasionally, creating an issue using the bubble icon in the text editor would crash the UI.
The Asset Builder is here and it’s an entirely new way of importing and creating assets on Ango Hub. Import CSV files, Excel spreadsheets, or any other table containing rows of data, then dynamically generate assets based on data in the table. Embed in the asset dynamic text, videos, images, audio, classification questions, and more for a completely new asset import experience. Read more in our docs on how to use the Asset Builder.
The Asset Import flow received a complete facelift, making it both more modern and informative.
Issues on audio segments (objects) now have a button allowing you to quickly jump to and highlight the segment on which the issue was opened.
You can now zoom further into the waveform in the audio labeling editor.
In the audio labeling editor, you can now zoom with the scroll wheel, and the view will zoom towards the location of the playhead.
Ango Hub now supports audio files with a duration of up to 3 hours. (file size limitations still apply)
A shape was added to the plugin liveness indicator to allow users with impairments to color recognition (e.g. color blindness) to discern between a plugin that is live and one that is not.
Improved the speed at which pre-labels are processed during import.
Project managers can now import pre-labels for objects (e.g. bounding boxes, etc.) without having to specify a Schema ID, the title of the class will be sufficient for matching.
From the Plugin Run dialog, plugins can now be run on tasks in Hold-type stages.
Fixed a bug where in long text assets, relations would appear in the incorrect position when scrolling.
Fixed a bug where in long text assets, the last row of text might be partially obscured by UI elements.
Fixed a bug where the character “<“ would not appear when saved in text classifications.
The Line (also known as Tape Measure) tool has been added to the medical labeling editor. Read our docs for more.
A loading bar is now displayed when audio files of large sizes are loading.
In the audio labeling editor, the keyboard left and right arrows can now be used to move the playback head 5 seconds backwards and forwards.
In the audio labeling editor, Shift + the left and right keyboard arrows can be used to quickly jump to the previous/next annotation when an annotation is already selected.
In the audio labeling editor, when an annotation is selected, pressing R on the keyboard will start playback of the audio file starting from the beginning of the selected annotation.
Fixed a bug where, occasionally, frame-specific nested classification answers would not be saved in video assets.
Fixed a bug where, in the audio editor, the creation of new segments could not be started inside of other segments.
Project managers can now import multiple Markdown files as a single asset. Annotators and reviewers will be able to switch between them with navigation buttons. Read more in our docs.
Ango Hub now prevents users from creating a new plugin if they have not first created an API key from their Account page.
Fixed a bug where, in the Category Schema section of the project settings, labeling classes with long names would cause the class’s ‘delete’ button to move off of the screen.
Fixed a bug where, rarely, opening the Task Info panel on a Markdown asset would produce a blank page.
The medical threshold tool UI has been updated. It now displays Hounsfield units and range values can be changed granularly by typing them in.
3D Bounding Boxes are now available in the medical labeling editor. Read more in our docs.
A Data Probe is now displayed on the bottom left of the medical labeling editor, with information on the voxel currently being hovered on.
Project managers can now create multi-image single-page assets. With this new asset type, users can switch between different images while retaining the annotations present on screen. Read more in our docs.
The text on annotator-type logic stages has been updated for clarity.
Fixed a bug where, occasionally, the audio labeling editor’s screen would turn blank after hiding a number of audio entity annotations.
Fixed a bug where 0% benchmark scores would appear as “-” in the dashboard.
Fixed a bug where the Tasks -> Answer filter doesn't work.
Fixed a bug where the merge and subtract functions of the Segmentation tool would not work as expected.
Benchmarks can now be fuzzy. For example, a project manager may mark more than one correct answer to a radio or dropdown classification. Read more in our docs.
In projects where benchmarking has been activated, the Tasks tab now shows each benchmark’s average score and the number of users who have annotated each benchmark.
In the labeling editor, pressing Ctrl + A will now select all objects in the asset (or all objects for the current frame in multi-frame assets).
In the Hold and Start stages, users can now type to search names of batches to forward to the next stage.
Task attachments can now contain arbitrary HTML. Read more in our docs.
Hiding or revealing objects with the keyboard shortcut “H” will no longer delete an annotation that is currently being drawn with the mouse cursor.
Answers to multiple classification questions no longer have a line running between the classification title and its options, improving readability in projects with large numbers of multiple classification answers.
The code powering the Segmentation tool has been substantially rewritten, leading to possible performance improvements in some scenarios and simplifying further development on the tool.
Idle duration and blur duration times can now be optionally included in the export.
The way total, idle, and blur durations are displayed in the Task Info panel has been improved.
Frames per second information in the Task Info view is now limited to two decimals.
The information panel regarding the transition to Export V3 has been removed from the Export tab.
When deleting assets from the Settings tab, files related to assets uploaded with drag-and-drop will also be purged from iMerit’s AWS private S3 storage. Read more in our docs.
OCR text can now be imported in the pre-labeling step for bounding box tools which have the Targeted OCR toggle activated. Read more in our docs.
Fixed a bug where the “Set as Sample” button was visible for users with the Labeler and Reviewer role.
Fixed a bug where setting a task as benchmark from the labeling editor did not cause the task’s status to immediately be reflected in the UI of the labeling editor.
Fixed a bug where the consensus scores shown int the Tasks tab and in the Stage History panel would occasionally mismatch.
Introducing benchmarks, also known as test questions or gold sets. With benchmarks, project managers will be able to measure the performance of annotators by having them annotate against known good tasks. Read more in our docs here.
The consensus calculation algorithm has been rewritten, now providing more intuitive consensus score results. Consensus projects created before Ango Hub 3.11 are not affected. Read more in our docs
The way tasks leave a consensus stage (i.e. adjudication) has been changed. Before this update, the consensus judgment that was sent was the one that was submitted last. Now, the task output from a Consensus stage is a composite task, combining all of the best consensus answers. Read more in our docs.
Added storage integration support for Azure. Read more in our docs.
The way metadata (e.g. frame count, frame rate, duration) is extracted for video assets has been updated to be more reliable.
Tools and classifications can no longer have single letters as shortcuts for quick selection. Existing classes and classifications with single letters as their shortcut will no longer be selectable with their keyboard shortcut. This was done to free up possible keyboard shortcuts for other functionality in the editor.
The description of an object can now be quickly changed by pressing “D” when the object is selected.
Task-level issues can now be opened by pressing “I” when no object is selected.
Object-level issues can now be opened by pressing “I” when an object is selected.
Polylines containing only two points can now be created.
AWS S3 private buckets can now be integrated by using IAM delegation, in addition to the previous method of creating a new IAM user for Ango Hub. Read more in the docs.
The brush tool in the radiology tool can now be spherical by changing its type to “3D” from the brush settings.
The opening and closing smoothing types have been added to the medical labeling editor.
The medical brush tool can now be used within a threshold region you specify. Open the threshold tool while the brush is active and the brush will only paint in areas defined by the threshold.
Fixed a bug where Hub would not warn users of unsaved changes on exit if the only modification was a change in annotation layering.
Fixed a bug where disabling interpolation of a rich text classification in video tasks could lead to a crash.
Fixed a bug where disabling interpolation of a text classification in video tasks did not correctly reset the classification.
Fixed a bug where disabling interpolation of a tree dropdown classification in video tasks did not correctly reset the classification.
Fixed a visual bug where, in the Overview tab, the auto-forward status of the Start stage was not always reflected accurately.
Fixed a bug where, in rare cases, vertical videos would appear stretched horizontally in the video labeling editor.
Now, consensus stages work in parallel, such that when a task is sent to a Consensus stage, it is sent simultaneously to all judgment sub-stages, rather than sequentially. Existing consensus projects are not affected. Read more in our docs here.
When reviewing a task after a Consensus stage, for classifications, reviewers are able to see all of the answers given in all judgments to the classification with a single click.
Annotations may now be moved to the front or to the back of other annotations. Read more in our docs.
Introducing Island Tools for the radiology editor. You can now quickly keep, delete, and manage islands of voxels in medical assets. Read more in our docs.
You can now upload pre-labels while importing assets, with a single JSON, removing the need to first import the assets and then import the annotations. Read more in our docs here.
Threshold can now optionally be applied exclusively in areas where segmentations are already present.
The stage history of tasks can now optionally be deleted while re-queuing.
Plugins will keep running even if the plugin developer changes their API key while the plugin is live.
If no brush is selected, the “Apply” button on Threshold and other related tools is now disabled.
Plugin logs in the “Plugin Sessions” view now display tabulation and new line characters.
Added the Shift + Z and Shift + C keyboard shortcuts to quickly jump to the first and last frame of a video.
The window options presets in the medical labeling editor have been changed to conform to those of 3D Slicer.
The message returned by the SDK when attempting to upload annotations for assets not in the Start stage has been improved for clarity.
Videos can now be scrubbed from the playback timeline while the video is playing.
Fixed a bug where the logic sanity validation would give a warning if, in the “Annotation Type” logic, the class name was empty
Fixed a bug where project managers who were not organization admins could not upload pre-labels.
Fixed a bug where, occasionally, NRRD files could not be saved if they had previously had overlapping annotations.
Fixed a bug where in the video editor annotation timeline, classifications may visually appear as relations.
Fixed a bug where exports of video tasks may contain duplicate annotations.
Fixed a bug where the video annotation editor would crash on open if it was opened with annotations created with a now-deleted class.
Connection lines between stages in workflows have the color of the stage the line is emanating from.
Tasks can now be filtered by “Assignee History” and “Stage History”. This will allow you to get a list of all tasks that had, at some point, been assigned to a particular user or went through a particular stage.
When clicking on “Select All” in the Tasks tab, you may now choose to select all tasks matching the current filter, rather than only the ones visible on screen.
Notifications can now be filtered by type from the notification dialog.
If a project changed in such a way that it would break a logical condition, the affected logic stage will show a warning detailing what needs to be done to fix the error.
Targeted OCR is now available for the Rotated Bounding Box tool.
NRRD compatibility has been improved.
Added a confirmation dialog when trying to delete all annotations from a class in the radiology labeling editor.
Added support for the Matroska (.mkv) video container format.
Added support for videos with non-square (1:1) pixels.
Project managers can now mark individual validation errors as blockers for submission or not. The “Prevent Submission” project-wide toggle has been deprecated. By default, all validation code created before this update will emit blocking errors. Read more in our docs on how to adapt your project to this update.
Video editor timeline rows can now be collapsed by class
Added a link to documentation in the Label Validation section of the settings.
[Radiology Editor] Fixed a bug where panning did not work when windowing options were selected.
Fixed a bug where NRRD files with external IDs containing spaces would occasionally fail to load annotations.
Fixed a bug where some annotations in NRRD files would not display in the export.
[Video Editor] Fixed a bug where, when changing an annotation’s class, some keyframes were not updated.
Fixed a bug where the nudge tool would not work as expected with sizes below 3px.
Workflow logic stage conditions are now shown visually on the stage itself.
A new stage type, "Hold", is now available in workflows. Read more in our docs.
You may now quickly search and filter plugins by their title, description, author, and type wherever plugins are listed.
Fixed a bug in the radiology labeling editor where quickly switching between tasks of different dimensions could cause the cache not to be fully cleared.
The video labeling editor's buffering and metadata extraction processes have been improved for large files.
Added Pen Mode to the Brush tool, enabling brush traces to be drawn by their border. Read more in our docs.
Named keypoints are now available in the medical labeling editor. Add keypoints anywhere in 3D space and name them. Read more in our docs.
Answers of multiple classifications now show a numerical index next to their title, enabling easy identification of answers.
Fixed a bug where cloning unknown relations in multi-page assets could cause a crash.
Plugins can be made private to only selected organizations.
Issues in multi-page assets may span more than one page.
Introducing Dynamic Consensus. Consensus stages marked as dynamic are only activated when the task does not meet the threshold in the other stages.
In consensus stages with shuffle enabled, submitted tasks will be sent to the labeling or plugin stage with the least number of tasks.
A progress bar is shown when large image files are loading.
Hub now shows a warning if there are unconnected workflow stages.
The text labeling editor has been re-written from scratch, including performance improvements allowing users to smoothly navigate multi-megabyte text files with hundreds of annotations.
Fixed a bug where Markdown files would show with the wrong formatting.
Fixed a bug with label validation.
Fixed a bug where some Nifti files were not displayed correctly.
Segmentations can now overlap in the radiology tool.
Logical operations such as add, subtract, invert, and more can be performed on segmentations in the radiology tool. Read our docs for more on logical operators.
The 3D view in the radiology editor can now be panned.
You can now obtain your export in a private storage bucket of your choice. Read more in our docs.
Segmentations and polygons can be fine-tuned with the new Nudge tool. Read about it in our docs.
Performance improvements in the audio and text labeling editors for large file sizes.
The text labeling editor now shows class names on hover.
You can now jump to the location of objects where object-level issues were created in PDFs.
Added support for magnetic lasso in the video and ultrasound labeling editors.
Added spellchecking for free text classifications inputs.
The "interpolation stop" shortcut has been changed from S to T. You can now save your progress in the asset by using the shortcut "S". See our docs for a list of all shortcuts in Hub.
Fixed a bug preventing plugin presets from being saved correctly.
New Features:
Introducing an all-new video and DICOM ultrasound editor with a timeline view of all your annotation. Read more in our docs.
Segmentations are now interpolated in video labeling tasks.
Issues can be opened at the object level.
Issues can now have custom error codes. Read more in our docs.
Notifications can now be muted.
Asset metadata is now automatically extracted from files when they are first opened in the labeling editor.
Project issues can now be exported as a JSON.
The export V3 format is now made the default. Export V2 has been deprecated. Read more about Export V3 in our docs.
The performance of segmentation actions such as erase, merge, and subtract has been drastically improved.
The project overview data normally only shown in the project dashboard can be downloaded with the SDK.
All annotations in a task can now be hidden and revealed at once with Shift+H.
Bug Fixes:
Fixed an issue where the segmentation eraser tool would cause the entire segmentation to shift.
Fixed an issue where the wrong user role would be shown in the Organization page.
Fixed an issue preventing batches from being filtered during export.
Introducing contextData, a way to attach additional data to assets which will appear in the final export. Read more about contextData.
Asset colors can now be inverted from Quick Settings.
Segmentation points can now be hidden from Quick Settings. This improves performance in segmentation-heavy projects.
With Shuffle, Labeling tasks can now be automatically distributed among consensus stages, eliminating bottlenecks. Read more about Shuffle
With Auto Assign, you can prevent the same annotator from labeling the same task twice in consensus stages. Read more about Auto Assign.
Project overviews now include a consensus distribution dashboard.
Annotators can now access a list of all keyboard shortcuts directly from the editor.
Hub can now detect when annotators and reviewers are idle. Read the docs to learn more.
The 3D view in the medical editor can now be updated through a new refresh button without having its position reset.
The medical smoothing tool allows you to smooth out annotations created with a brush tool you specify. Read the docs to learn more.
Performance optimizations when loading assets from private storages.
Bug fixes and stability improvements for the medical editor.
Segmentation Tool: The Segmentation tool has been completely rethought. It now allows for merging and subtraction of segmentations, allowing for mutually exclusive segmentations and other often-requested features. Read the docs to learn more.
Stage History Export: Added the ability to export the entire stage history of tasks, including annotations as submitted at the end of each stage. Read the docs to learn more.
Plugin Presets: You can now create presets to quickly set all settings of a plugin in a project. Read the docs to learn more.
Issues for Radiology Tool: Issues can now be opened on specific spots and areas of NIFTI and NRRD assets.
Unknown Stages: If you have tasks in an unknown stage as a result of deleting a stage with tasks in it, Hub now warns you from the Workflow tab and offers to re-queue them.
Submit Popup: Submitting a task with Enter now causes a confirmation popup to appear, preventing accidental submissions.
Various security-oriented updates.
The current frame's data URL can now be viewed in the Task Info panel when annotating multi-page assets.
Improved NRRD support by adding support for further medical modalities. In practice, this will result in Ango Hub displaying as intended a few NRRD files which were previously being displayed incorrectly.
Classification classes can now be marked as being "multiple". Multiple classifications can be answered more than once. More in our docs.
A Consensus stage has been added to the Workflow tab, allowing you to present the same asset to multiple annotators. The task can then be sent to review according to the level of agreement between annotators in classes of your choice. More in our docs.
The 3D medical labeling editor is now available. Upload a NIFTI or NRRD asset and use the Medical Brush tool to annotate it and see the labels in 3D. Learn more in our documentation.
Custom Workflows are now available, allowing you to set up a custom data labeling pipeline ranging from simple single-stage labeling tasks to intricate multi-stage processes involving reviews, webhooks, plugins, logical gates, random sampling, and more. Learn more in our documentation.
You can now add users to projects in the Lead role. Leads can access everything in the project they are assigned to except for the Project Settings tab.
The labeling editor interface has been refreshed. Submit buttons are now in the top-right, and more space has been given to the asset.
The Brush tool now supports creating instances. When drawing with the brush, deselect the tool to close the instance. Click on an existing instance to edit it. Read more in our docs.
In the video labeling editor timeline, each object’s unique ID is displayed next to the object’s class.
You can now enable two-factor authentication (2FA) for your Ango Hub account, adding a layer of security to your login experience. Read more about how to enable and use it in our docs.
In the File Explorer, project managers can now limit which files will be imported using indices. Read more about it in our docs.
In the list of users in projects, you can now filter by email and name.
Workflow logic stages now support multiple conditions in a single node.
Polygons can now share edges with themselves or other polygons. Read more and see it in action in our docs.
