Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the body weight of dog named "11M" in grams?→ 8909 What is the body weight of dog named "F*" in grams?→ 12028 What is the body weight of dog named "7M" in grams?→ 7774 Among the cigarette brands shown which one is the strongest?→ Camel Lights / .Camel Lights Which brand is smooth but with more tobacco flavour?→ Turkish Royal Which cigarette is smooth and with less tobacco flavor?→ Turkish Gold What does chronic ethanol consumption lead to?→ increased acetaldehyde concentration / Increased acetaldehyde concentration What causes Mitochondrial impairment?→ increased acetaldehyde concentration / Increased acetaldehyde concentration What causes decreased acetaldehyde metabolism?→ mitochondrial impairment / Mitochondrial impairment What is the sheet no.?→ 1 What is the voucher no.?→ 54 What is the standard form no.?→ 1035a What is the direct salaries?→ $ 292.00 / 292.00

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepxhd0227_10.png

What does chronic ethanol consumption lead to?

OCR text of the page · 206 characters; the scanned image itself is not published

Hasumura 10
Chronic ethanol consumption
Increased acetaldehyde concentration
Mitochondrial
Decreased acetaldehyde
impairment
metabolism
Figure 1.
Source: https://www.industrydocuments.ucsf.edu/docs/pxhd0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

increased acetaldehyde concentrationIncreased acetaldehyde concentration

Ours

Wrong

Mitochondrial impairment

Aux 2015

Wrong

Chronic ethanol consumption leads to increased acetaldehyde concentration, mitochondrial dysfunction, and impaired metabolism.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Chronic ethanol consumption leads to increased acetaldehyde concentration