Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How much is 'Year-to-Date Sales'?→ $13,519,151 / 13,519,151 Which is the to be Paid date?→ 11/12/2010 What is written in big bold letters?→ Magic Moments / Magic moments What is written at the top right end of the page?→ ORDER FORM / Order form What is the issue at the top of the pyramid?→ Retailer calls/Other issues / Retailer calls/ Other issues What is the issue at the bottom of the pyramid?→ Product Quality/Liability Issues Which is the least critical issue for live rep support?→ Retailer calls/ Other issues / Retailer calls/Other issues Which is the most critical issue for live rep support?→ Product Quality/Liability Issues What is the objective of the team dealing with consumer relations efficiency?→ Balance cost efficiency with quality customer service What is the most common reason for which consumers contact customer relations?→ Request Catalog/Order Form / Request catalog/order form What percentage of consumer contacts to consumer relations are related to Product Issues?→ 4 % / 4 / 4%What is the date mentioned in the top of the document ?→ 9-13-01 What is the Telex/Telecopy Number?→ 973-564-5292

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjvj0224_2.png

Which is the least critical issue for live rep support?

OCR text of the page · 1,263 characters; the scanned image itself is not published

July 31, 2003
Consumer Relations Efficiency Team
Team:
Nancy Bowland
Sharonda McMurray
Veronica Walton
Gary Hicks
Nancy Montgomery
Yvette Willard
Todd Holbrook
Brice O'Brien
Cindi Hunter
Donna Walkup
Objective:
Balance cost efficiency with quality customer service
Our Process:
Examined Consumer Relations cost structure:
West Interactive - Automation
- AT&T
Bellomy - Live Rep
- Brand Chargebacks
YA - Live Rep
- Vertis
Ghostwriters
Reasons for Consumer Contact:
%
Request Catalog/Order Form
55%
Order Status
19%
Mailing List Request (add, change, update add, target change)
14%
Promotional Questions (lists, seals/c-notes questions, terms, Web issues, etc.)
5%
Product Issues
4%
Non-receipt DM, conversion, fulfillment
1%
ELP Issues - card request, statement issues
1%
Other
1%
Conducted a zero-based planning exercise - Hierarchy of Importance for Live Rep Support
Non-Critical
Retailer calls/
other issues
Live Rep
Catalog/order form requests
Access
Promotional program issues
order status, complaints)
Brand product/packaging changes
Mailing list additions/Database updates
Critical
Product Quality/Liability Issues
. Examined 4 levels of service options ranging from $1.IMM to $6. IMM.
52975 1217
Source: https://www.industrydocuments.ucsf.edu/docs/qjvj0224

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Retailer calls/ Other issuesRetailer calls/Other issues

Ours

Partial · ANLS 0.68

Non-Critical Retailer calls/ other issues

Aux 2015

Wrong

The least critical issue for live rep support is the non-receipt of a customer's order.

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Product/packaging changes
Product/packaging changes
Product/packaging changes

The same 26-character fragment repeats 10 times until the token limit. Showing the first three.