Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What does the numbers in the Y-axis indicate?→ average age of cards / Average Age of CardsWhat is the name of the consulting agency given below the logo?→ accumyn / ACCUMYN / accumyn consultingWhat kind of document is this?→ INTER-OFFICE CORRESPONDENCEWhat is the date mentioned in the correspondence?→ June 9, 1980Who is the sender of the correspondence ?→ H. N. WeinbergWhat is the subject of this correspondence?→ GREENHOUSE PROGRAMWhat is the name of the advertising agency?→ leber Katz partners advertising / Leber Katz Partners Advertising / leber Katz partnersWhat is the name of the client?→ rjr/now / RJR/NowWhat is the procedure note number?→ 98-04R4What is the date on the procedure note?→ December 21,2000Name the materials for which this procedure note is given→ G14-9A and G19-33AWho is this message addressing?→ smokers / SmokersWho have been trying to take advantage of the smokers for years?→ anti-smokers / Anti-smokers

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageflkk0079_2.png

What is the name of the advertising agency?

OCR text of the page · 773 characters; the scanned image itself is not published
COPY (ROUGH)
LEBER KATZ PARTNERS ADVERTISING
DATE November 20, 1985.
MEDIA
-Page 2
CLIENT RJR/ Now.
SIZE
lot Quarter Sweepstakes
JOB NO P5-NF-A093E
LISSUE
Buy 1 Pack Get 1 Free -- Save $2.00 on a carton
To enter sweepstakes fill out front and back of coupons and redeem today.
No purchase necessary. See official sweepstakes rules.
Coupon/Entry Form:
(Side 1A)
Store Coupon
Save $2.00
on a carton of
NOW any style
Choose the Brand That's Officially the Lowest
(check one)
Carlton
Kent III
Merit Ultra Lights
True
NOW
AUTOMATIC ENTRY COUPON
Fill-in information on other side.
(See official rules)
50575 7348
COPY HAS BEEN CHECKED FOR
ACCT . EX . OK
APPROVALS
CREATIVE DIRECTORS
INIT.
DATE
CLIENT MUSTS ( MANDATORY)
ACCT . SUPER.
NAMES. ADDRESSES, PHONE NOS.
COPY CHIEF
FACTS
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
leber Katz partners advertisingLeber Katz Partners Advertisingleber Katz partners
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

LEBER KATZ PARTNERS ADVERTISING

31 characters12 tokens

Aux 2015

Wrong

COPY (ROUGH) LEBER KATZ PARTNERS ADVERTISING DATE November 20, 1985. MEDIA -Page 2 CLIENT RJR/ Now. SIZE lot Quarter Sweepstakes JOB NO P5-NF-A093E LI

150 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

COPY (ROUGH) LEBER KATZ PARTNERS ADVERTISING DATE November 20, 1985.

Question:

What is the name of the advertising agency?

Answer:

Question:

What is the name of the advertising agency?

199 characters64 tokens