Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekfhd0227_22.png

Which month & year is mentioned under the heading?

OCR text of the page · 1,853 characters; the scanned image itself is not published
8 .
29/ 26 / 74
WASHINGTON UNIVERSITY
SCHOOL OF MEDICINE
ACADEMIC ROSTER JULY 1974
DEPARTMENT OF_PREVENTIVE MEDICINE._.3235
YRS F -T
SUBJECT AREA
NAME AND- - ---
DOCTORAL
ON P -T
TEACHING
ACADEMIC RANK--
AGE DEGREES DATE - ----
-- - -INSTITUTION - - - - ----------- FAC VOL
RESPONSIBILITY
CHAPLIN
HUGH
51_ _MD
1947 . COLUMBIA_U COLLEGE OF_PHYS & SURG N 19 - F-T.
KCUNTZ PROFESSOR OF PREVENTIVE MED
HOLLOSZY
JOHN 0
41 MD
1957 WASHINGTON U SCH OF
F -T
PROFESSOR OF PREVENTIVE MEDICINE
KING
MORRIS KENTON.
49 MD
17 F-T
PROFESSOR OF PREV MED
195 1 VANDERBILT U_ SCH MED TENN
ALSO DEAN OF MEDICAL SCHOOL
SHANK
ROBERT E
DANFORTH PROFESSOR OF PREV MED
60 MD
1939 WASHINGTON U SCH OF MED MO
26 F-T
ALSO HEAD OF DEPARTMENT
WETTE
REIMUT
PROF OF BIOSTATISTICS IN PREVENTIVE MED
47 D SC
1955 U OF HEIDELBERG GERMANY.
2 _ F -T
CHOI
SUNG C
ASSOC PROF OF BIOSTAT IN PREV MED
43 PHD
1966 U OF CALIF LOS ANGELES CAL
F -T
FISHMAN M.
SCHONFELD
GUSTAV
40 MD
ASSOC PROF OF PREVENTIVE MED
1960 WASHINGTON U SCH. MED MO
2 ._ _ F - T_
WEIDMAN
STUART WAYNE
39 PHD
1965 / UNIV OF CHICAGO ILL
5 F - T
ASST PROF OF PREV MED ( BIOCHEM)
BANTON' II
WILLIAM C
51 MD
1946_HOWARD_UNIV_DC
3.. VOL
ASST PROF OF PREVENTIVE MED
BERGER
EDWARD J
63 MD
1937 WASHINGTON U MED SCH MO
VOL
ASST PROF OF PREV MED ( PL )
BOMZE
HOWARD A
RESRCH ASST PROF REHAB BIOMED ENG IN P M
30 D SC.
1972 WASH UNIV MO
6 .. F-I
BRENNAN
RUTH E
ASST PROF OF NUTRITION IN PREV MED PART-TIME
54 SCD
1966 UNIV OF PITTSBURGH
CHENG
CHUAN HUAN
RESEARCH ASSIST PROF OF PREV MED
5.5 PHD
195.5 MICHIGAN STATE UNIV MICH.
11 _ F-T.
COOKSEY
JON DAVID
36 MD
1962 TULANE UNIV LA
2 F -T
ASST PROF OF PREV_MED
HIXON
BARBARA B
61
ASST PROF OF BIOSTAT IN PREV MED (PT)
8 P-T.
MACKIE
M ANITA
44
MD
2 VOL
ASST PROF OF HLTH SERV IN PREVENTIVE MED
PHO
1962 MICHIGAN ST UNIV MICH
Source: https://www.industrydocuments.ucsf.edu/docs/kfhd0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
JULY 1974July 1974
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

JULY 1974

9 characters9 tokens

Aux 2015

Wrong

The document mentions the following:

  • "8 ."
  • "29/ 26 / 74"
  • "WASHINGTON UNIVERSITY"
  • "SCHOOL OF MEDICINE"
  • "ACADEMIC ROSTER JULY 1974"
  • "DEPARTMENT
154 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ChronoGPT





























125 characters64 tokens