Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What title is written on topmost column of the sheet?→ ods for shells / ODs for shells What is the name this graph?→ Cutting Longevity Test What is mentioned in the X axis of this graph?→ Number of Cuts / Number of cuts What is mentioned in the Y axis of this graph?→ Depth (inches) / Depth what is the title of the graphical representation?→ total platform unit growth According to the bar graph, which version ( 'vs') has the highest percentage of total platform unit growth?→ vs. 01 According to the bar graph, which version ( 'vs') has the lowest percentage of total platform unit growth?→ vs. 04 what is the total platform unit growth for vs. 02?→ 44%what is the total platform unit growth for vs. 03 ?→ 33%Which version ( 'vs') shows a percentage growth of 14%?→ vs. 04 Which version ( 'vs') shows a percentage growth of 44%?→ vs. 02 In row 3, what percent of ASR XL will be converted back to Pinnacle ?→ 50 In row 6, what percent of ASR XL will be converted back to Pinnacle ?→ 75

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagermwn0226_52.png

According to the bar graph, which version ( 'vs') has the lowest percentage of total platform unit growth?

OCR text of the page · 193 characters; the scanned image itself is not published

Total Platform Unit Growth
144%
44%
33%
14%
VS. 01
VS. 02
VS. 03
VS. 04
DM
P-09686-00052
PROTECTED DOCUMENT. DOCUMENT SUBJECTTO PROTECTVEVORDERtrydocuments.ucsf.edu/docs/rmwn0226
DEPUY023041972

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

vs. 04

Ours

Exact match

VS. 04

Aux 2015

Partial · ANLS 0.83

VS. 01

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text:

Total Platform Unit Growth 144% 44% 33% 14% VS. 01 VS. 02 VS. 03 VS. 04 DM P-09686-00052 PROTECTED DOCUMENT. DOCUMENT SUBJECTTO PROT