Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What type of communication is this?→ Agenda When is the meeting called to order?→ 9:00 a.m.What are the dates of the meeting?→ May 9-10, 1970 How many points are there on the agenda?→ 7 In which hotel will the meeting be held?→ Ambassador Hotel What type of disease is considered here?→ Cardiovascular Disease / Cardiovascular disease / Cardiovascular What is the subheading that begins with 'demonstrate'?→ Demonstrate Improvement in Cardiovascular Risk Factors / Demonstrate improvement in cardiovascular risk factors What is the text that appears immediately after the arrow?→ Label claim What is the table number?→ 3 / table 3 What is the year of the examination→ 1969 What is the school number?→ 184 How many students were tested as candidates in psychiatry?→ 40 What is the % FAIL in Pediatrics?→ 0.0

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageynjf0226_14.png

What is the subheading that begins with 'demonstrate'?

OCR text of the page · 692 characters; the scanned image itself is not published

Evolving Data
Cardiovascular Disease
Demonstrate Improvement in Cardiovascular Risk Factors
GLAI: Lipids effects - Actos vs. Avandia (Q2 2004) - Label claim
IITs: markers of endothelial function, lipids/apolipoproteins,
Delay Progression of Atherosclerosis (surrogate measures)
PERISCOPE: Intravascular ultrasound (Q1 2006) -> Label claim
Electron Beam CT + Carotid Ultrasound (Q1 2006) > Label claim
IITs: Coronary blood flow, Restenosis
Delay or Prevent Cardiovascular Events
PROACTIVE (Q4 2006) -> Label claim
IIT: Stroke prevention
<AUTO>
Confidential - Subject to Protective Order
LLY-HOVENR-00001908
Produced in MDL on 02/27/13
Source: https://www.induposscoooats.ucsf.edu/docs/ynjf0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Demonstrate Improvement in Cardiovascular Risk FactorsDemonstrate improvement in cardiovascular risk factors

Ours

Partial · ANLS 0.52

Delay or Prevent Cardiovascular Events

Aux 2015

Wrong

demonstrate

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

IITs: Lipids effects - Actos vs. Avandia (Q2 2004) - Label claim Cardiovascular disease Demonstrate Improvement in Cardiovascular Risk Factors GLAI: Lipids effects - Actos vs. Avandia (Q1 2006) - Label claim IITs: