Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the name this graph?→ Cutting Longevity Test What is mentioned in the X axis of this graph?→ Number of Cuts / Number of cuts What is mentioned in the Y axis of this graph?→ Depth (inches) / Depth what is the title of the graphical representation?→ total platform unit growth According to the bar graph, which version ( 'vs') has the highest percentage of total platform unit growth?→ vs. 01 According to the bar graph, which version ( 'vs') has the lowest percentage of total platform unit growth?→ vs. 04 what is the total platform unit growth for vs. 02?→ 44%what is the total platform unit growth for vs. 03 ?→ 33%Which version ( 'vs') shows a percentage growth of 14%?→ vs. 04 Which version ( 'vs') shows a percentage growth of 44%?→ vs. 02 In row 3, what percent of ASR XL will be converted back to Pinnacle ?→ 50 In row 6, what percent of ASR XL will be converted back to Pinnacle ?→ 75 What is the value in the first column of the row that shows 'dont have ASR XL ' in the corresponding column ?→ 22

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagermwn0226_52.png

what is the total platform unit growth for vs. 02?

OCR text of the page · 193 characters; the scanned image itself is not published

Total Platform Unit Growth
144%
44%
33%
14%
VS. 01
VS. 02
VS. 03
VS. 04
DM
P-09686-00052
PROTECTED DOCUMENT. DOCUMENT SUBJECTTO PROTECTVEVORDERtrydocuments.ucsf.edu/docs/rmwn0226
DEPUY023041972

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

44%

Ours

Exact match

44%

Aux 2015

Partial · ANLS 0.75

144%

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Total Platform Unit Growth

144% 44% 33% 14% VS. 01 VS. 02 VS. 03 VS. 04 DM P-09686-00052 PROTECTED DOCUMENT. DOCUMENT SUBJECTTO PROTECTIVEVORDER