From a98326addef7144a2365f4e2b8d248c6b65122ab Mon Sep 17 00:00:00 2001 From: jingweij Date: Wed, 24 Jun 2020 15:07:48 -0700 Subject: [PATCH] init --- README.md | 28 ++ bbox.html | 1065 +++++++++++++++++++++++++++++++++++++++++++++ multiclass.html | 489 +++++++++++++++++++++ relationship.html | 1035 +++++++++++++++++++++++++++++++++++++++++++ 4 files changed, 2617 insertions(+) create mode 100644 README.md create mode 100644 bbox.html create mode 100644 multiclass.html create mode 100644 relationship.html diff --git a/README.md b/README.md new file mode 100644 index 0000000..672d9a8 --- /dev/null +++ b/README.md @@ -0,0 +1,28 @@ +# AMT Video Annotation Tools + +This repo contains some prototype tools for video annotations. +These single-page HTML tools are designed to be used for Amazon Mechanical Turks crowd-sourcing annotation. + +Some demo frames/GIFs are dumped from [Charades dataset](https://prior.allenai.org/projects/charades). + +Contributers: [@ranjaykrishna](https://github.com/ranjaykrishna) and me + +## Bounding boxes +Provided with a reference video clip and the interested human action, the task is to draw a bounding box around an +object involved in the action. + +See [bbox.html](bbox.html). + +## Human-object relationships +Provided with a reference video clip and the interested human action, the task is to label all relationships between the +actor and the object. + +See [relationship.html](relationship.html) + +## Clip multi-classification +Find all occurring actions in each short video clip. + +See [multiclass.html](multiclass.html) + + + diff --git a/bbox.html b/bbox.html new file mode 100644 index 0000000..676dfc7 --- /dev/null +++ b/bbox.html @@ -0,0 +1,1065 @@ + + + Describe images with text + + + + + + + + + + + + + + + + + + + + + + +
+

Draw the bounding boxes of objects.

+ +
+ +

We'll be going through a list of objects occurring in videos.

+

Objects are things that appear in the image, like cat, grass, or jacket. Draw a bounding box around each object in the list.

+ +

How should the bounding box be drawn?

+
    +
  • You'll be given the object to look for. Draw a box with your mouse around the relevant image region.
    • +
  • + Each box should be tight around its object, and should completely cover the object. +
    +
    + Good: +
    + +
    +
    + Bad: +
    + +
    +
    + Bad: +
    + +
    +
    +
    • +
  • + Each box should only cover the visible part of all objects mentioned in the object. +
    +
    + Good: +
    + +
    +
    + Bad: +
    + +
    +
    +
    • +
  • + Objects that take up a large portion of the image should be completey covered + by their boxes, such as the boxes for the road below: +
    +
    + Good: +
    + +
    +
    + Bad: +
    + +
    +
    +
    • +
  • + If the object we're asking for does not exist in the image, click "No Box Exists" and continue to the next one. + Click this button will remove the current box and disable box drawing. Click the button again to re-enable. +
    + Every question should either have a bounding box or be marked as "No Box Exists". +
    • +
  • + If for whatever reason the box drawing cursor is not aligned with your mouse, click "Redraw box" to reset + the interface. +
    • +
  • + If no image loads, click "No Box Exists" and continue to the next question. +
    • +
+
+
+ + + +
+ +
+ +
+

YOUR TASK IS BELOW

+
+ + +
+
+
+
+

[Reference Video]

+

+
+
+
+
+
+
+
+
+
+
+
+
+
+
+

[Your Workspace]

+

+

+

The object you draw around MUST correspond to the action described above!
If you don't see the object in this frame, or you aren't sure where it is, click No Box Exists.

+
+
+
+
+
+
+
+
+
+
+ + +
+
+ + + / + + +
+
+
+
+ + + +
+ + + +
+ + + + + \ No newline at end of file diff --git a/multiclass.html b/multiclass.html new file mode 100644 index 0000000..37f8010 --- /dev/null +++ b/multiclass.html @@ -0,0 +1,489 @@ + + + Choose what actions are happening in videos + + + + + + + + + + +
+

Choose the actions that are happening in this video clip. (Select all that apply)

+
+ +
+
+
+

+
+
+
+
+

+
+
+
+
+
+
+
+
+
+
+

+
+
+
+ + + / + + +
+
+ +
+ + + +
+ +
+
+
+ + + + \ No newline at end of file diff --git a/relationship.html b/relationship.html new file mode 100644 index 0000000..bc2f5a6 --- /dev/null +++ b/relationship.html @@ -0,0 +1,1035 @@ + + + Tell the Relationships between Human and Objects + + + + + + + + + + + +
+

Choose the relationships that match the two words and the image.

+
+ +
+
+
+

Reference Action:

+ +
+
+

What's the relationship between and at this moment?

+
+
+
+
+

Click all that apply:

+
+
+
+
+
+
+
+ +
+
+ +
+
+
+
+
+ +
+
+ + + / + + +
+
+ +
+ + + +
+ +
+
+
+ + + +