Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqhll0226_1.png

Which date is printed on this mail?

OCR text of the page · 627 characters; the scanned image itself is not published
COPY
mr. Place
SUGAR RESEARCH FOUNDATION, INC.
99 WALL STREET
NEW YORK 5, N. Y.
August 1at, 1945
TO: John C. Geran
FROM:
Ody H. Lamborn
Please let me know when the 50,000 copies of "Sugar is the Foundation
of All Life" will be ready for distribution.
Towards the bottom of the cover I would like a "box", say an inch
square, that says inside of it "Extra copies of this address will be
supplied upon request".
The title on the cover should read:
SUGAR IS THE FOUNDATION OF ALL LIFE
(By Dr. Wm. J. Robbins, Director
N.Y. Botanical Garden, Bronx Park
New York)
OHL: be
Source: https://www.industrydocuments.ucsf.edu/docs/qhll0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
AUGUST 1ST, 1945August 1st, 1945
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

August 1st, 1945

16 characters11 tokens

Aux 2015

Wrong

99 WALL STREET

14 characters5 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

OCR text: SUGAR RESEARCH FOUNDATION, INC. 99 WALL STREET NEW YORK 5, N. Y. August 1, 1945 TO: John C. Geran FROM:

OCR text: SUGAR

131 characters64 tokens