Real study

Google Project for Automating Contract Processing

Google AI (with Orby) has been launched in May, 2023.

Download link

AI Agent


Organizations are inundated with an overwhelming volume of documents that need to be processed, validated, and organized. Orby AI, powered by Google Document AI, helps customers automate document-centric repetitive tasks like contract processing, email processing, and invoice validation.

Learn Entire Design Process

Project type

Design Team


Collaboration


Contribution


Contract project

  • Sabrina Zhu
  • Glendon Guo
  • Jundi Fu
  • Stakeholder Bella Liu
  • Engineer Will Lu
  • Engineer Tianjun Fu
  • Interviews
  • Mockups
  • Prototypes
  • Presentations
  • User testing
  • Iterations

My role

As a Design Associate, I solved the key usability issues and redesign the experience of the review and validation process.

I worked in a cross-functional workshop, collaborated with stakeholders, developers, and project managers to ensure successful delivery.

Impact

From 45 minutes to 9 minutes 🚀
End-user testing with our key users showed  the time to collect information and read the contracts dropped from 45 min to 9 min. It has dramatically reduced the data collection and aggregation burden on finance teams. Our product help increase the speed of processing contract by 80%.

Solutions

Solution 01

A User-friendly
Tutorial

it decreases training time and the learning curve

Users find it boring to have to train over 100 contracts before being able to use the AI system.

Solution 02

A Goal-oriented
Suggestion List

Access to Important Information

Users struggle to locate the task file within hundreds of tasks in systems because the files names are almost same

Solution 03

An Accessible
Review Page

It gives end users full control and enhance their confidence

Users do not trust the accuracy of AI when they review AI’s extracted results

Persona

Financial professionals are known for their meticulous work ethic, where even a single word cannot be extracted inaccurately

Everyday, they open up google drive to view new contracts waiting to be dealt with. Then they review contracts, invoice, and other financial documents. They extract new terms and put them manually in a master spreed sheet.

How might we help finance operation specialists review and process contracts more efficiently with AI automation?

Information Architecture

The financial specialists work starts with
training Orby algorithm,
locating the documents Orby manages,
and finally extracting terms in the contracts

Iteration

Based on feedback from client engineers, product managers, and usability testing. We conducted iterations, including user flow, wireframes, and visual presentation

Iteration A: Train Orby system's Database

Implementing a Training mode editor

before

After

"I don't realize Orby is learning behind the scene when I extract terms when I am inputting them into Sheets."

"I get familiar with the interfaces while I can quickly train Orby system by selecting keywords in the box. After which they can be automatically fill in the entities."

Intergrating term collection system into Google drive

Second revision
Hi-Fi
  • Integrate two windows
  • Add pagination to provide controls of reading process status
  • Not follow traditional reading sequence
  • Distract users with two many colors
  • Establish left-right work sequence
  • Make page clean
  • Not efficient enough when typing in keywords manually
  • Lack of search bar
  • Two columns layout
  • Motivate users training
  • Automatically jump to the corresponding entity in the contract
  • Highlight selected keywords
First revision

Iteration B: Importing files to Orby AI system

Identify different files with complex information

before

After

“I need more info because I need to know which file should be dealt with first"

"I identify different files with complex information including name, file ower, file type. last updatad time.

Creating suggestion list to show info

Second Revision
Hi-Fi
  • Add Indicator for pending tasks number
  • Add estimated recognition accuracy
  • Hard to read with small fonts
First Revision
  • Add file information
  • Expand file information
  • Set hierachy information on the card
  • Unable to see file details immediately
  • Have easy access to important information
  • Create a new task easily
  • Visually diffrenciate pending tasks with completed tasks
  • Add estimated recognition accuracy

Iteration C: Review Process

Optimize the key term suggestion and validation interaction flows

before

After

"It does not match my working habit like add missing terms and reject terms"
"All the information presents equally in the list"

"It is so easy now to check the extraction results one by one by tapping "enter" on the keyboard"
"I can tell which words may be misrecognized"

Customize review process

Second Revision
Hi-Fi
  • All Fuctions stacking up together
  • Differentiate scores
  • Group entities according to score
  • Lack of considering userflow
  • Score classfication lack basis
  • Develop a sortable list
  • Filtered entities into three catagories "all", "missing" and "optional entities"
  • Not clear where is clickable
  • Not conforming the logic of checking experience
  • Customized review process with filter and sorting methods
  • Shrunk unclickable cards
  • Comparing the content of left and right sections smoothly
Fisrt Revision

Reflection

Get input

Rooted in user needs, gather design ideas from real use cases.

Loop Engineers

The team needs to engage in open communication with the engineers to address the concerns. Explore useful solutions. Be a resourceful designer and find different ways to solve problems.

Iterative Design

Promote an iterative design process where improvements are continuously made based on user testing and feedback. Remember that a design is never really 'finished'.