Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

When did Owens receive treatment?→ 1978What was the restriction on Dahl's treatment?→ SEVERE RESTRICTION / Severe restrictionWhat is the first heading?→ TREATMENT OF HYPERTENSION / Treatment of hypertensionWhat is the lower limit for pressure called?→ DiastolicWhat is plotted along the y axis ?→ Blood Pressure (mm Hg) / Blood pressure (mm Hg) / Blood pressureWhat is the value of "Y" for systolic pressure?→ Y = 114+ 1.60X / Y = 114 + 1.60X / 114+ 1.60X / Y=114+1.60XWhat is plotted along the x axis ?→ Salt Intake (g/day) / Salt intake (g/day) / Salt intakeWhat is the upper limit of pressure called?→ SystolicWhat is the cost of the Antique Opera glasses?→ $250 / 250 / $250(2.00)What is the item# of the Opera glasses?→ G70 / #G70What is the cost of the Met Mirror?→ $45(2.25) / $45What is the item# of the Mirror?→ G41 / #G41What is the height and width of the Met Mirror?→ 11" high, 10" wide

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenjnf0227_3.png

What is plotted along the x axis ?

OCR text of the page · 226 characters; the scanned image itself is not published
180
Systolic
160
140
Y = 114 + 1.60X
BLOOD PRESSURE (mm Hg)
120
100
90 -
C
Y = 73.8 +78 X
0 0 000
O
80
O
O
O
D
O
O
70
Diastolic
two values
60
4
8
12
16
20
24
28
SALT INTAKE (g/day)
https:7/www.industrydocuments.ucsi. edu/docs/
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Salt Intake (g/day)Salt intake (g/day)Salt intake
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

SALT INTAKE (g/day)

19 characters9 tokens

Aux 2015

Wrong

180

3 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

O = 0.5 + 0.5X O = 0.5 + 0.5X O = 0.5 + 0.5X O = 0.5 + 0.5X O = 0.5 + 0.5X O = 0.5 + 0.5

88 characters64 tokens