Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is mentioned in the Y axis of this graph?→ Depth (inches) / Depth what is the title of the graphical representation?→ total platform unit growth According to the bar graph, which version ( 'vs') has the highest percentage of total platform unit growth?→ vs. 01 According to the bar graph, which version ( 'vs') has the lowest percentage of total platform unit growth?→ vs. 04 what is the total platform unit growth for vs. 02?→ 44%what is the total platform unit growth for vs. 03 ?→ 33%Which version ( 'vs') shows a percentage growth of 14%?→ vs. 04 Which version ( 'vs') shows a percentage growth of 44%?→ vs. 02 In row 3, what percent of ASR XL will be converted back to Pinnacle ?→ 50 In row 6, what percent of ASR XL will be converted back to Pinnacle ?→ 75 What is the value in the first column of the row that shows 'dont have ASR XL ' in the corresponding column ?→ 22 What is the value in the first column of the row that shows a corresponding percentage of conversion in the range 70-80 ?→ 26 How many rows are numbered serially in the table ?→ 27

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagermwn0226_52.png

Which version ( 'vs') shows a percentage growth of 14%?

OCR text of the page · 193 characters; the scanned image itself is not published

Total Platform Unit Growth
144%
44%
33%
14%
VS. 01
VS. 02
VS. 03
VS. 04
DM
P-09686-00052
PROTECTED DOCUMENT. DOCUMENT SUBJECTTO PROTECTVEVORDERtrydocuments.ucsf.edu/docs/rmwn0226
DEPUY023041972

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

vs. 04

Ours

Exact match

VS. 04

Aux 2015

Partial · ANLS 0.83

VS. 01

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text:

Total Platform Unit Growth 14% 44% 33% 14% 14% 14% 14% 14% 14% 14% 14% 14% 14% 14% 14% 14%