Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagengvh0227_1.png

What is the date of the Summary?

OCR text of the page · 1,551 characters; the scanned image itself is not published
P. A. Willis, III, M. D.
March 27, 1979
Northwestern MRFIT Center
Northwestern Annual Report - - July 1, 1978-June 30, 1979
Pricing Proposal -- 1979-1980
Summary :
1)
Report disorganized, incomplete in parts, confused in format and
not uniformly or well written.
2) Much above average performance in follow-up.
3 )
Average performance in weight reduction - below average in choles-
terol, blood pressure and smoking control in SI group.
- Weight - + 1.9%% versus 1.9% for all clinics @ 36 months
- Cholesterol - + 4.7% versus 6.5% for all clinics @ 36 months
- Diastolic Blood Pressure -
+ 6.5% versus 9.1% for all clinics
@ 36 months
Smoking Quit Rate - + 28% versus 36% for all clinics @ 36 months
(corrected by thiocyanate - therefore in bottom 1/3)
(uncorrected 44%% versus 45% - therefore average middle 1/3)
corrected per CC on 7 variables 3%% versus 16% therefore #22)
4 )
Excellent patient card returns
5 )
Low missed annual visit rates
NW
All Clinics
SI
UC
SI
UC
3%
4%
VS
7%
8%
Low missed 4 & 8 month visits
6)
One SI lost to follow-up
7) 7 UC and 5 SI drop-outs
8)
High error correction memo rate
9 )
Problems noted by contractor:
(a) Participants object to ECG at ST. Joseph and rest of exam at
Northwestern
(b) 3 participants live out of state - try to come in
3 participants not able to come in due to illness
(c) Ethical problem of high risk UC participants asking MRFIT MD
for . advice, diagnosis etc.
(d) Ethical problem of SI's who do not continue to see personal
physician
Source: https://www.industrydocuments.ucsf.edu/docs/ngvh0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
MARCH 27, 1979March 27, 1979
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

March 27, 1979

14 characters11 tokens

Aux 2015

Wrong

Based on the OCR text, the summary appears to be a report from the Northwestern MRFIT Center, dated March 27, 1979, and titled "Pricing Proposal -- 1979-1980." The text is fragmented and contains several errors, including misspellings

234 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

P. A. Willis, III, M. D. March 27, 1979 Northwestern MRFIT Center Northwestern Annual Report - - July 1, 1978-June 30, 1979 Pricing Proposal - - July 1, 1978-June 30, 1979 Summary : 1)

184 characters64 tokens