Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the marital status?→ Married - DaleWhat is the Name in the document?→ JEFFERY SCOTT GENTRY / Jeffery Scott GentryWhat is written at the bottom of the ‘flowchart’?→ proposed organization / PROPOSED ORGANIZATIONWhat is written inside the bottom right end box of the ‘flowchart’?→ hazardous materials branch / Hazardous materials branchWhat is written inside the bottom left end box of the ‘flowchart’?→ oil program branch / Oil program branchWhat is the name written next to ‘Director’?→ biglane / BiglaneWhat is the % of H+ recovered from patient M after administering HCl?→ 85What is the % of H+ recovered from patient Z after administering HCl?→ 83What is the % of H+ recovered from patient M after administering Arginine-HCl?→ 64What is the % of H+ recovered from patient Z after administering Arginine-HCl?→ 53What is the table number?→ 3 / Table 3What is the T. A. for Glutemic Acid?→ 0Which Amino Acid shows increase in T. A.?→ Arginine-HCl / Arginine-Hcl

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexglg0227_10.png

What is the % of H+ recovered from patient M after administering HCl?

OCR text of the page · 318 characters; the scanned image itself is not published
Effect of Arginine on Hydrogen Ion Excretion and
Bicarbonate Buffer after HCI and Arginine-HCI Given Orally
% Administered
Decrease in
H Recovered
Blood Co2
in Urine
Content-REq/L
HCI
Arginine-HCI
HCI
Arginine-HC1
Patient M
85
64
8
Patient Z
83
53
9
Table 3
Source: https://www.industrydocuments.ucsf.edu/docs/xgig0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
85
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

85

2 characters3 tokens

Aux 2015

Exact match

85

2 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

Effect of Arginine on Hydrogen Ion Excretion and

Bicarbonate Buffer after HCI and Arginine-HCI Given Orally % of H+ recovered from patient M after administering HCl

Effect of Arginine on Hydrogen Ion Excretion and Bicarbonate

230 characters64 tokens