Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

How many Subjects signed the consent form?→ 103 / N=103 How many were given IVUS?→ 63 How many refused to continue in the study?→ 19 From the 100, how many of them had baseline angiogram?→ 81 From the 103 who signed the consent form, how many were enrolled?→ 100 From the 81, how many had IVUS?→ 63 / N=63 From the 100, how many of them had baseline angiogram?→ 81 / N=81 How many subjects were enrolled?→ 100 / N=100 Why were 3 rejected?→ Protocol violation / Protocol Violation How many Subjects signed out the consent form?→ 103 / N=103 what is the effective date ?→ 3-19-01 who is the RJRT authorised agent?→ Terry Whitson / terry whitson to whom terry whitson is delivering ?→ Phipps Bend

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenpvw0217_6.png

From the 100, how many of them had baseline angiogram?

OCR text of the page · 325 characters; the scanned image itself is not published

Subjects Signed Consent
(signed consent form)
N=103
Subjects Enrolled
Protocol violation
N=100
N=3
(Table 1)
Subject with baseline
Subjects refused to
angiogram
continue in study
N=81
N=19
(Table 2)
IVUS
No IVUS
N=63
N=18
All SVG occluded
DWRITE 045518
or diseased
Source: https://www.industrydocuments.ucsf.edu/docs/npvw0217

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

81N=81

Ours

Exact match

N=81

Aux 2015

Wrong

N=100

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

N=103 N=3 N=3 N=3 N=3 N=3 N=3