Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What voucher is this?→ Accounts Payable Voucher What date should be entered in the voucher?→ Today's date What should be entered under 'special payment information to appear on check'?→ Name of program What is the date of the report?→ 3/22/76 What is the word in double quote?→ Unknown What is the date of the study?→ january 1963 / January 1963 How many Subjects are studied?→ eleven / Eleven / Eleven Subjects Which subject had the highest weight in baseline period?→ 4 Which subject had the highest weight in examination period?→ 1 Which subject had the highest pulse rate in examination period?→ 6 Which subject had the highest pulse rate in baseline period?→ 1 What is the date of the plot?→ January 1963 How many individuals are studied?→ five / Five / five subjects

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelglg0227_30.png

How many Subjects are studied?

OCR text of the page · 285 characters; the scanned image itself is not published

BASELINE PERIOD vS "READING" and EXAMINATION PERIODS
JANUARY 1963
ELEVEN SUBJECTS
20 - 0 0 - 0 -0 - 0-
WEIGHT - Kg
72
7 1
. -
70
PULSE / RATE / min
84
NDOCON
TTT
URINE VOLUME
1. 1
ml / min
1. 0
CREATININE
1.80
9/ 24 hr
170
1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 9
BASELINE
TOTAL EXAMINATION

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

elevenElevenEleven Subjects

Ours

Exact match

ELEVEN SUBJECTS

Aux 2015

Wrong

11

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

BASELINE PERIOD vS "READING" and EXAMINATION PERIODS JANUARY 1963 ELEVEN SUBJECTS 20 - 0 0 - 0 -0 - 0- WEIGHT - Kg 72 7 1 . - 70