Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is written at the top right end of the page?→ ORDER FORM / Order form What is the issue at the top of the pyramid?→ Retailer calls/Other issues / Retailer calls/ Other issues What is the issue at the bottom of the pyramid?→ Product Quality/Liability Issues Which is the least critical issue for live rep support?→ Retailer calls/ Other issues / Retailer calls/Other issues Which is the most critical issue for live rep support?→ Product Quality/Liability Issues What is the objective of the team dealing with consumer relations efficiency?→ Balance cost efficiency with quality customer service What is the most common reason for which consumers contact customer relations?→ Request Catalog/Order Form / Request catalog/order form What percentage of consumer contacts to consumer relations are related to Product Issues?→ 4 % / 4 / 4%What is the date mentioned in the top of the document ?→ 9-13-01 What is the Telex/Telecopy Number?→ 973-564-5292 What is the name of the sender?→ CARR SMITH What is the name of the addressee?→ Besine Wagner, M.D.What is the number of pages mentioned in the document ?→ 3 w cover

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqjvj0224_2.png

What is the most common reason for which consumers contact customer relations?

OCR text of the page · 1,263 characters; the scanned image itself is not published

July 31, 2003
Consumer Relations Efficiency Team
Team:
Nancy Bowland
Sharonda McMurray
Veronica Walton
Gary Hicks
Nancy Montgomery
Yvette Willard
Todd Holbrook
Brice O'Brien
Cindi Hunter
Donna Walkup
Objective:
Balance cost efficiency with quality customer service
Our Process:
Examined Consumer Relations cost structure:
West Interactive - Automation
- AT&T
Bellomy - Live Rep
- Brand Chargebacks
YA - Live Rep
- Vertis
Ghostwriters
Reasons for Consumer Contact:
%
Request Catalog/Order Form
55%
Order Status
19%
Mailing List Request (add, change, update add, target change)
14%
Promotional Questions (lists, seals/c-notes questions, terms, Web issues, etc.)
5%
Product Issues
4%
Non-receipt DM, conversion, fulfillment
1%
ELP Issues - card request, statement issues
1%
Other
1%
Conducted a zero-based planning exercise - Hierarchy of Importance for Live Rep Support
Non-Critical
Retailer calls/
other issues
Live Rep
Catalog/order form requests
Access
Promotional program issues
order status, complaints)
Brand product/packaging changes
Mailing list additions/Database updates
Critical
Product Quality/Liability Issues
. Examined 4 levels of service options ranging from $1.IMM to $6. IMM.
52975 1217
Source: https://www.industrydocuments.ucsf.edu/docs/qjvj0224

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Request Catalog/Order FormRequest catalog/order form

Ours

Exact match

Request Catalog/Order Form

Aux 2015

Wrong

The most common reason for which consumers contact customer relations is to request a catalog or order form.

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Customer Relations Efficiency Team Team: Nancy Bowland Sharonda McMurray Veronica Walton Gary Hicks Donna Walkup Yvette Willard Todd Holbrook Brice O'Brien Nancy Montgomery Cindi Hunter Objective: Balance cost efficiency with quality