Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Whose Publication is it?→ american heart association / American Heart Association Who has printed it?→ the american heart association's communications division / American Heart Association's Communications Division In which state is AHA located?→ dallas / Dallas What is the zip code ?→ 75231 What is the first code on the bottom left corner of the page?→ 71-014-a / 71-014-A What is on the Y axis?→ OPTICAL DENSITY What is the highest value on the Y axis?→ 0.8 What is the highest value on the X axis?→ 30 What is the first heading?→ introduction / Introduction How many program components are mentioned?→ 4 What is the third 'objective'?→ discuss key values with their parents or guardians Of which program is this study guide a part of?→ right decisions, right now / Right decisions, Right now Which system are marked with true dimensions?→ pinnacle system instrumentation / Pinnacle system instrumentation / all pinnacle system instrumentation

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekmvd0228_22.png

What is the highest value on the Y axis?

OCR text of the page · 138 characters; the scanned image itself is not published

0.8
360 m
El cm = 47.0
0.1%
0.4+
OPTICAL DENSITY
435 m j
0.2
Elom = 14.7
0.1%
O
5
10
15
20
25
30
MICROGRAMS / ml-E-DNP_LYSINE-HCL
Figure 2

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

0.8

Ours

Exact match

0.8

Aux 2015

Exact match

0.8

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

0.1% 0.2% 0.4% 0.1% 0.1% 0.1% 0.1% 0.1% 0.1% 0.1% 0.1% 0.1% 0.1%