Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagesrxv0228_1.png

What is the ‘date’ on the letter?

OCR text of the page · 562 characters; the scanned image itself is not published
THE
Great
Western
Sugar
COMPANY
August 18, 1976
Serials Department
General Library
University of California, Berkeley
Berkeley, California, USA 94720
Gentlemen:
We are enclosing copies of Upbeet magazine which were issued
after volume two 1975. We have checked our mailing records and made
certain that you are on our mailing roster.
Very truly yours,
CDF:VC
Encl.
*Jent Sept 15 March 76
POST OFFICE BOX 5308 . DENVER, COLORADO 80217 . (303) 893-4600 . A SUBSIDIARY OF GREAT WESTERN UNITED CORPORATION
Source: https://www.industrydocuments.ucsf.edu/docs/srxv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
august 18, 1976August 18, 1976
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

August 18, 1976

15 characters11 tokens

Aux 2015

Wrong

The date on the letter is August 18, 1976.

42 characters18 tokens

PiT-FT 2015

Wrong

Question: What is the date on the letter?

OCR text: THE Great Western Sugar COMPANY August 18, 1976 Serials Department General Library University of California, Berkeley Berkeley, California, USA 94720 Gentlemen:

215 characters64 tokens

ChronoGPT 2015

Wrong

The date on the letter is August 18, 1976.

42 characters11 tokens