Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyscw0217_61.png

What is the row number in which the text ' of gonadal steroids... ' appear?

OCR text of the page · 435 characters; the scanned image itself is not published
22
Walsh, 1998
23363
23
Ceballos, 2000
18325
24
Koh, 1999
13993
25
Rosselli, 1995
15128
26
Van Baal, 1999
16501
27
Sorensen, 1998
Circulation 97:1234-1238; no rm#
28
Herrington, 1999
J Am Coll Cardiol 33:2030-2037; cant
read #
29
Hayashi, 1995
Biochem Biophys Res Commun 214: 847.
30.
Duckles, 1996
J Pharmacol Exp Ther 1996:297. Effects
of gonadal steroids...
Source: https://www.industrydocuments.ucsf.edu/docs/yscw0217
DWRITE 067872
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
3030.
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

30

2 characters3 tokens

Aux 2015

Wrong

22

2 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

22 WashU, 1998 23 Ceballos, 2000 23 Koh, 1999 13993 25 Rosselli, 1995 16501 26 Van Baal, 1999 15128 27 Sorensen, 1998 Circulation 97:1234-

138 characters64 tokens