Product Documentation
Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Toggle Dark/Light/Auto mode Back to homepage

Auto Review

Introduction

The Auto Review function leverage state-of-the-art artificial intelligent to identify and review PII (Personal Identifiable Information) in structured documents such as Social Security, W2, Passport, Driver Licence, etc. This function is designed to automate the document review process, enhancing accuracy, and productivity in completing your data mining effort.

In addition to automate your review process workflow, the auto review provide user the freedom to choose and customize their review from 3 different workflows:

  1. Robot (bot) is a workflow performed by the system’s artificial intelligence persona within the Canopy App.
  2. Automation is predefined tasks that are defined and run on behalf of the user to perform the review process.
  3. Wizard is a workflow that guide users through steps-by-steps process to accomplish specific goal, configuration, and review process. Wizard simplified complex processes by breaking them down into small manageable and sequential steps.

User Interface

Dashboard

dashboard_autoreview.png

The dashboard provide an overview of all your automated projects, the process status and key metrics, and it is organized based on the state of the project’s process status: Queued, Working, and Completed.

Under each status, there are cards. These cards represent each process workflow. For example, if you create an auto review process, it will become a workflow which is shown as a Card. These workflow cards are grouped by their status in a swimlane.

Card

A card represents an auto review workflow may look like this:

img_16.png

  1. Icon - an icon representing the workflow type: automaton, wizard, or user-created,
  2. Workflow ID - Unique id for this instance of the workflow,
  3. Title - the name of the workflow (max: 32 char),
  4. Description - description of the workflow
  5. Tags - tags for which module the workflow belongs to: Process, Assess, Review, Consolidate, or Notification, followed by a unique number (we will make this optional),
  6. Avatars - an avatar depicting the owner of the present task in the workflow, and
  7. Jobs - an indication whether the card is a subtask.
  8. Actions - Actions include:
    • View jobs that are queued or working
    • Stop the workflow
    • View the details of the workflow

Status

Cards are grouped based on Status in swimlanes. Users manage the cards/workflows by moving them through swimlanes in each module’s board. Admins can access the Kanban board from the project level and see all the workflows related to a project grouped by module.

  1. Queued: A workflow is under “Queued” when it is either needs to be initiated by user or it is set on queue by the system.
  2. Working: A workflow is under “Working” when it is either started by the system or the users. “Working” workflow show all the jobs and the process of those jobs associated with that workflow.
  3. Completed: A workflow is under “Completed” when it is either successfully complete all the job within the workflow or it is voluntarily terminated by the user. Users can stop a workflow by clicking on “Stop” button in each workflow card or by moving/dragging the card to the “Completed” swimlane.

How tos

🥾Create an Auto Review Image Workflow

  1. Login with the Project Administrator role.
  2. Select a project.
  3. In the navbar, navigate to and select Assessment.
  4. Click on Workflows on the left hand corner of the page.
  5. Click on Create Automation on the upper right hand corner of the page.
  6. Search for and select the Auto Review Images. Then click on the “Use Template”.

create_automation.png

  1. After clicking on the “Use Template”, you will land on a page below. From here, user can customize the auto review conditions according to their wants and needs.

autoreview_template.png

To create the Auto review image process, users have to provided auto review condition:

Auto Review

Click on the dropdown menu to see the list and select the type of structured document you want to review. For example, Social Security Card

When

When describes an event, action or condition placed on the review process. For example, in the case of auto reviewing social security card, the When condition could be “the system classified images/documents as or containing” social security card. This means that you only want to auto reviewing images/documents that is classified as social security card by the system.

And

And is an additional condition placed on the review process. Most generally, it is where you choose the “confidence level”.

Confidence level is a concept in statistics that describe probability that a prediction or estimation is correct. It is expressed as a percentage. For instance, a 95% confidence level means you can be 95% sure that the AI has correctly identified and extracted the PII information in the review process. .

Canopy allows users to customize their auto review process into low confidence (less than 95%) and high confidence interval (95% or higher).

Then

Then describe the expected outcome or result of the auto review process.

  1. Click on Automate to start the auto review image workflow.

🥾Create QA Batches of Auto Reviewed Documents with Low Confidence

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Click on Automate on the upper right hand side of the page.
  6. Search and click on the Auto Review Images template. img_13.png
  7. Select Social Security Cards img_18.png
  8. Then click on Create Automation.

🥾Create QA Bathes of Sampled Documents Auto Reviewed with High Confidence

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Click on Automate on the upper right hand side of the page.
  6. Search and click on the Auto Review Images template. img_20.png
  7. Select Social Security Cards img_19.png!
  8. Then click on Create Automation.

🥾Stopping a Workflow

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find the workflow card that is either queued or working that you want to stop.
  6. Click on Stop.
  7. Observe that the card moved to the Done column with a status of “Stopped”

🥾Viewing the Workflow Configuration

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on Configuration in the drawer on the right.
  7. View the configuration.

🥾Viewing the Status of All Jobs

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on Jobs in the drawer on the right.
  7. View the job status.

🥾Viewing the Status of Jobs in Progress

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the Jobs icon on the lower right.
  6. View the status of queued and working jobs.

🥾View Activity History of a Job

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on History in the drawer on the right.
  7. Click on the Job ID that you want to review history.
  8. View the filtered history in the Activity History.

🥾View Activity History of a Workflow

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on History in the drawer on the right.
  7. Click on the Workflow ID.
  8. View the filtered history in the Activity History containing all jobs for the selected workflow.

🥾Add/Edit a note to the Workflow

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on Notes in the drawer on the right.
  7. Click on edit and type text.
  8. Press Save

🥾Add comments to the Workflow

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on Comments in the drawer on the right.
  7. Instructions TBD

🥾View analytics about the workflow

  1. Login with the Project Administrator role.
  2. Select project.
  3. In the navbar, navigate to the module you want implement the automation. In this case, in the beta example, click on Assessment.
  4. Click on Workflows on the left hand side of the page.
  5. Find and click on the workflow card
  6. Click on Analytocs in the drawer on the right.
  7. Instructions TBD