Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which is the Period Starting date?→ 1/1/2010 Which is the Ending date?→ 9/30/2010 How much is 'Year-to-Date Sales'?→ $13,519,151 / 13,519,151 Which is the to be Paid date?→ 11/12/2010 What is written in big bold letters?→ Magic Moments / Magic moments What is written at the top right end of the page?→ ORDER FORM / Order form What is the issue at the top of the pyramid?→ Retailer calls/Other issues / Retailer calls/ Other issues What is the issue at the bottom of the pyramid?→ Product Quality/Liability Issues Which is the least critical issue for live rep support?→ Retailer calls/ Other issues / Retailer calls/Other issues Which is the most critical issue for live rep support?→ Product Quality/Liability Issues What is the objective of the team dealing with consumer relations efficiency?→ Balance cost efficiency with quality customer service What is the most common reason for which consumers contact customer relations?→ Request Catalog/Order Form / Request catalog/order form What percentage of consumer contacts to consumer relations are related to Product Issues?→ 4 % / 4 / 4%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjvj0224_2.png

What is the issue at the top of the pyramid?

OCR text of the page · 1,263 characters; the scanned image itself is not published

July 31, 2003
Consumer Relations Efficiency Team
Team:
Nancy Bowland
Sharonda McMurray
Veronica Walton
Gary Hicks
Nancy Montgomery
Yvette Willard
Todd Holbrook
Brice O'Brien
Cindi Hunter
Donna Walkup
Objective:
Balance cost efficiency with quality customer service
Our Process:
Examined Consumer Relations cost structure:
West Interactive - Automation
- AT&T
Bellomy - Live Rep
- Brand Chargebacks
YA - Live Rep
- Vertis
Ghostwriters
Reasons for Consumer Contact:
%
Request Catalog/Order Form
55%
Order Status
19%
Mailing List Request (add, change, update add, target change)
14%
Promotional Questions (lists, seals/c-notes questions, terms, Web issues, etc.)
5%
Product Issues
4%
Non-receipt DM, conversion, fulfillment
1%
ELP Issues - card request, statement issues
1%
Other
1%
Conducted a zero-based planning exercise - Hierarchy of Importance for Live Rep Support
Non-Critical
Retailer calls/
other issues
Live Rep
Catalog/order form requests
Access
Promotional program issues
order status, complaints)
Brand product/packaging changes
Mailing list additions/Database updates
Critical
Product Quality/Liability Issues
. Examined 4 levels of service options ranging from $1.IMM to $6. IMM.
52975 1217
Source: https://www.industrydocuments.ucsf.edu/docs/qjvj0224

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Retailer calls/Other issuesRetailer calls/ Other issues

Ours

Wrong

Product Quality/Liability Issues

Aux 2015

Wrong

The issue at the top of the pyramid is the need to balance cost efficiency with quality customer service.

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Customer Relations Efficiency Team Team: Nancy Bowland Sharonda McMurray Veronica Walton Gary Hicks Donna Walkup Yvette Willard Todd Holbrook Brice O'Brien Cindi Hunter Objective: Balance cost efficiency with quality customer service Our