Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyplp0227_8.png

Who has become H.L.M in 1982?

OCR text of the page · 736 characters; the scanned image itself is not published
PAST PRESIDENTS
AND
HONORARY LIFE MEMBERS
1. John Dingee . . . ..
1949-1951
2. Robert A. Sindall, Jr. ......... 1952-1953
3. M.R. (Joe) Feeney . .
1954-1955
4. David S. Nay . ....
1956-1957
5. Frank S. Langsenkamp ...... . 1958-1959
6. Edward E. Judge. ........... . 1960-1961
7. Charles E. Schick. ......
1962-1963
8. Louis E. Kibler, Sr. .......... . 1964-1965
9. Clyde N. Monda . .
. . 1966-1967
10. Nat C. Barnard . .. .
. . 1968-1969
11. James G. McGinnis . ........ . 1970-1971
12. Thomas N. Martin. .
. . . . . . . 1972-1973
13. Herbert E. Shek. ....
1974-1975
14. Arthur I. Judge II . . ....
. 1976-1977
15. George L. Shipley* .. ....
1978-1979
*Becomes H.L.M. in 1982
Source: https://www.industrydocuments.ucsf.edu/docs/yplp02z
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
George L. ShipleyGeorge L. Shipley*
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

George L. Shipley

17 characters6 tokens

Aux 2015

Wrong

Who has become H.L.M. in 1982?

30 characters15 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

John Dingee .

13 characters4 tokens