Datasaur
Search
⌃K

Dynamic Review Capabilities

Allows you to assign another person to review your project automatically
Dynamic review is a feature that allows you to assign your team member as reviewer automatically when the labelers have conflicts in a project. This feature is best suited to small teams that only have a few of labelers available.

How do we enable Dynamic Review?

First thing, ensure that you are in a team project. Then, create a project through Custom Project and assign at least 2 labelers with consensus 2. Dynamic review is available on Step 4: Assignment.
Check “Allow dynamic review assignment” option. Choose one of the options to assign the reviewer.
  • Any other team member
    • It will select one of your team members, except those who have been assigned as labelers.
  • Any reviewer
    • It will select one of reviewers in your team.
  • Dedicated member
    • Select a particular member as a reviewer.

Use Cases

No conflicts

  1. 1.
    Admin assign at least 2 labelers to the project.
  2. 2.
    The labelers start labeling.
  3. 3.
    The labelers have completed the project (Mark as Completed).
  4. 4.
    There are no conflicts available.
  5. 5.
    The project will be completed automatically.

Conflicts

  1. 1.
    Admin assign at least 2 labelers to the project.
  2. 2.
    The labelers start labeling.
  3. 3.
    The labelers have completed the project (Mark as Completed).
  4. 4.
    There are at least 1 conflict.
  5. 5.
    The project status as “Ready for review” and notify the assigned dynamic reviewer.