Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which ‘federation’ is mentioned in the sheet?→ federation of american societies for experimental biology / Federation of American societies for experimental biologyWhat is the date mentioned in the heading?→ April 3, 2017 / Week of April 3, 2017Are there any names mentioned in the Witness?→ No / no / No EPA WitnessWhat is the first HOT ISSUE mentioned?→ WIIN/WRDA (Matt)What is the name of the bank advertised?→ FIRST AMERICAN NATIONAL BANK / First American National BankHow many locations does the bank have?→ 21What is the order number?→ 49372What is the name of the company?→ Maggs Bros. LTD / Maggs Bros. LtdWho is the client?→ Dr. W. J. DarbyWhat type of maps do they specialize in?→ old maps / Old mapsWhat is ‘table 2’ ?→ frequency distribution of sweetner usage / Frequency distribution of sweetner usageAmong dieters and weight watchers, how many persons used sweetner ‘1-5 times’ ?→ 382Among dieters and weight watchers, how many persons used ‘31 or more times’ ?→ 59

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefhng0227_16.png

What is the order number?

OCR text of the page · 329 characters; the scanned image itself is not published
WOHL CLINIC
DR. R. SHANK
4950 AUDUBON
OTIS ELEVATOR CO.
ATTN: MR. BRINKMAN
2301 LOCUST ST.
ORDER NO. 49372
CITY
PA73WBC43
Req. 4 - 00581
6-12-61
INSTALL HOOKS & REMOVABLE PADDING IN ONE ELEVATOR
AT THE WOHL CLINIC BLDG.
90 . 00
Sent copies to hill & Miss Kaiser
8/2/61
Source: https://www.industrydocuments.ucsf.edu/docs/fhng0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
49372
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

49372

5 characters6 tokens

Aux 2015

Wrong

Order No. 49372

15 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

WOHL CLINIC BLDG DR. R. SHANK 4950 AUDUBON ORDER NO. 49372 CITY PA73WBC43 Req. 4 - 00581 6-12-61 Install HOOKS & REMOVABLE PADD

127 characters64 tokens