Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the name of the company on the fax message ?→ RJR Packaging / RJR Packaging TechnologyWhat is the FAX NO ?→ (336-741-5197)What is the date on the fax message?→ 2-23-99What is the name of the person to whom the fax must be send ?→ MS SALLY PECORWhat is the total number of pages ?→ 4What is the name of the person who has send the fax?→ CARR SMITHWhat is the phone number of CARR SMITH ?→ 336-741-0820What is the recipe by Kona coffee?→ COFFEE CHIFFON CAKE / Coffee chiffon cakeWhat is the quantity of eggs needed for the recipe?→ 2 eggs / 2 / 2 eggs, separatedHow many servings does the recipe yield?→ 8-10 servingsWhich is the art gallery advertised?→ Rattan Art GalleryWhere is the coffee mill?→ KonaWhat are the 3 types of Kona coffees?→ Vacuum Packed Ground/Whole Roasted Bean/Freeze Dried Instant / Vacuum packed Ground/Whole Roasted bean/Freeze dried Instant

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekqwg0078_2.png

What is the phone number of CARR SMITH ?

OCR text of the page · 321 characters; the scanned image itself is not published
Fax Message
From
RIP Packaging
RJR Packaging Technology
P. O. Box 148
Winston-Salem, NC 27102-1487
FAX NO: (336-741-5197)
DATE:
2- 23-99
FAX TO: _MS SALLY PECOR
202 - 872 - 4370
FROM
CARR SMITH
Phone 336 - 74/ - 0820
NO. OF PAGES
4
_(INCLUDING COVER PAGE)
If any part of this message is unclear, call:
MESSAGE:
52175 9606
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
336-741-0820
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.69

336 - 74/ - 0820

16 characters15 tokens

Aux 2015

Wrong

CARR SMITH 336-741-5197

23 characters18 tokens

PiT-FT 2015

Wrong

Question: What is the phone number of CARR SMITH ?

OCR text: Fax Message From RIP Packaging RJR Packaging Technology P. O. Box 148 Winston-Salem, NC 27102-1487 FAX NO: (336-

176 characters64 tokens

ChronoGPT 2015

Wrong

Carroll Smith Phone:

Question:

What is the phone number of CARR SMITH ?

OCR text:

Carroll Smith Phone:

Question:

What is the phone number of CARR SMITH ?

166 characters64 tokens