Image Annotation and Labeling Instructions
- Link to Labelme annotation tool
- First, set up and log in to your Labelme annotation tool account.
- Once a contestant has logged in, they should upload an image in Labelme using the "Upload Image" button on the right side.
- Once uploaded, contestants will then select their image from "Annotations In Progress" and determine which objects are present in each image, with an emphasis on the priority objects as they are more important and earn points. A list of the priority objects and their point values can be found here.
- Next, contestants will use polygons to annotate individual objects in an image. To create/draw a new polygon, select the circle under the "Polygon Tool" from the left toolbar, or click anywhere on the image. Then, continue to click on the image along the boundary of the object to form a polygon. To delete the last point, press Delete or click on the eraser in the left toolbar. To close the polygon, click on the initial point (highlighted in green).
- After the polygon is closed, a popup edit box appears querying for the label, or the object name. Enter the label from the list of priority objects. Contestants can enter any label, but only object labels shown in the dropdown will earn points. Click "Done" to save the annotation or "Delete" to cancel creating it
- To edit or update a label or polygon, click on the annotation's border or on its name in the polygon list to start editing. Enter a new name or adjust the properties in the edit box. Click "Done" to save changes. Click "Delete" to permanently delete the annotation. To edit the annotation's shape, click "Adjust polygon" in the edit box. To adjust the shape of the polygon, drag any of the green points. To delete a point, right-click on the point. To add a point, right-click on the border of the polygon. When finished with adjusting, click anywhere outside of the polygon to finish adjusting and save it.
- Further instructions can be found by clicking the question mark , ? , to the right of the Labelme logo.
Contestants will use Labelme annotation tool for annotating images. It can be used in a web browser, so there is no need to download anything. Below are the instructions for annotating and labeling images with Labelme:
- Do not overlap or obscure different polygons. If the objects overlap, draw polygons to outline all visible parts of each object. The borders of the polygons may touch, but do not draw the borders so that either polygon is obscured by the other.
- For images containing 10 object instances or fewer of a given object, every instance should be individually labeled.
- When labeling a closed door, you should label the actual door. If the door is open with the door and frame visible, you should label just the actual door. If the door is open, but only the frame is visible, mark the frame of the door only.
- When labeling a closed elevator, you should label the elevator doors. If the elevator is open so only the frame is visible, label the frame of the elevator.
- The label "fixed equipment" is meant to describe all closed box-type immovable equipment such as an AC unit. The label "mechanical equipment" is meant to describe equipment that has open, moving parts.
Below are some general guidelines for labeling images.
In addition to these guidelines, below is a tutorial video showing the annotation process in Labelme as well as example images of “good” and bad” annotation.
The image on the left is an example of a properly annotated image. The polygons outline the shape of the objects and all of the priority objects are annotated. The image on the right is an example of a poorly annotated image. The polygons overlap each other and do not outline the shape of the objects. Also, there are unnecessary polygons with incorrectly labeled objects.
Below are sample images that include priority objects from the priority object table in the section on Image Annotation and Labeling Instructions.
The image on the left contains a door (outlined in pink), windows (outlined in yellow), a sign exit (outlined in green), and fire suppression systems - sprinklers (outlined in dark blue). The image on the right contains doors (outlined in pink), a sign exit (outlined in green), and fire suppression systems - sprinkler (outlined in dark blue).
The image on the left contains doors (outlined in pink), windows (outlined in yellow), a fire alarm (outlined in light blue), fire suppression systems - extinguisher (outlined in yellow), and fire suppression systems - sprinklers (outlined in dark blue). The image on the right contains doors (outlined in pink), a sign exit (outlined in green), windows (outlined in yellow), and fire suppression systems - sprinkler (outlined in blue).
The image on the left contains a window (outlined in yellow), a fire alarm (outlined in light blue), and a fire suppression systems - extinguisher (outlined in yellow). The image on the right contains a door (outlined in pink) and fire suppression systems - extinguisher (outlined in yellow).
The image on the left and right both contain a standpipe connection (outlined in green).
The image on the left contains windows (outlined in yellow), building entrance-exits (outlined in light blue), a sign exit (outlined in green), a fire alarm switch (outlined in red), and a fire alarm (outlined in light blue). The image om the right contains windows (outlined in yellow), sign exits (outlined in green), and a fire alarm switch (outlined in red).
The image on the left contains doors (outlined in pink) and hazmat (outlined in light blue). The image on the right contains doors (outlined in pink) and hazmat (outlined in light blue).
The image on the left and right both contain a fire hydrant (outlined in yellow) and a sign stop (outlined in light blue).
The image on the left contains a fire escape access (outlined in green) and image on the right contain a fire escape access (outlined in green) and a window (outlined in yellow).
The image on the left contains a fire door (outlined in dark blue), a door (outlined in pink), a sign exit (outlined in green), and a fire suppression systems - extinguisher (outlined in yellow). The image on the right contains a fire door (outlined in dark blue), a sign exit (outlined in gree), a fire alarm switch (outlined in red), and a fire alarm (outlined in light blue).
The image on the left contains doors (outlined in pink), a sign exit (outlined in green), emergency lighting (outlined in red), and a smoke detector (outlined in yellow).The image on the right contains a smoke detector (outlined in yellow).
The image on the left contains building entrance-exit (outlined in light blue) and a fire suppression systems - extinguisher (outlined in yellow).The image on the right contains a sign exit (outlined in green), a door (outlined in pink), emergency lighting (outlined in red), and a fire alarm (outlined in light blue).
The image on the left and the right both contain roof accesses (outlined in yellow).
The image on the left and the right both contain stairways (outlined in peach).
The image on the left and the right both contain elevators (outlined in green).
The image on the left contains interior structural features - pillar (outlined in red), doors (outlined in pink), and windows (outlined in yellow). The image on the right contains interior structural features - pillars (outlined in red) and windows (outlined in yellow).
The image on the left contains a fire suppression systems - extinguisher (outlined in yellow) and an AED (Automated External Defibrillators) (outlined in yellow). The image on the right contains an AED (Automated External Defibrillators (outlined in yellow).
The image on the left contains fire suppression systems - sprinkler (outlined in teal), server equipment (outlined in yellow) and fixed equipment (outlined in teal). The image on the right contains server equipment (outlined in yellow).
The image on the left contains fixed equipment (outlined in teal) and a roof access (outlined in yellow). The image on the right contains mechanical equipment (outlined in yellow).
The image on the left contains utility shut offs - electric (outlined in teal) and a utility shut offs - water (outlined in pink). The image on the right contains utility shut offs - electric (outlined in teal).
The image on the left contains utility shut offs - water (outlined in pink) and the image on the right contains mechanical equipment (outlined in yellow).
The image on the left contains utility shut offs - gas (outlined in pink) and the image on the right contains utility shut offs - gas (outlined in pink).
The image on the left contains an IFAK (Individual First Aid Kit) (outlined in yellow) and the image on the right contains an IFAK (Individual First Aid Kit) (outlined in yellow).
The image on the left contains a fire wall (outlined in pink) and windows (outlined in yellow) and the image on the right contains a fire wall (outlined in pink) and windows (outlined in yellow).
Theses images contain fire suppression systems - sprinkler cover/escutcheons on the ceilings. The images on the left are the original images and the images on the right are cropped to get a better view of the fire suppression systems - sprinkler cover/escutcheon on the ceilings.
These images are the images from above that have been annotated. The image on the left contains two fire suppression systems - sprinkler cover/escutcheons (outlined in purple), two doors (outlined in pink),and a person (outlined in yellow). The image on the right contains two doors (outlined in pink), three fire suppression systems - sprinkler cover/escutcheons (outlined in orange), four windows (outlined in yellow), a fire alarm (outlined in blue), a sign exit (outlined in green), and a person (outlined in yellow).
