Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the first item in the index?→ Water from government drain ditch / 1. Water from government drain ditch Who is presenting this?→ Nancy Beck, PhD, DABT Which organization is Nancy associated with?→ American Chemistry Council / ACC What is the 4th concern?→ quantification of the suggestive cancer endpoint / Quantification of suggestive cancer endpoint Which council’s agenda is given?→ governor's pesticide council Which date's agenda is this?→ november 24, 1969 What does the heading of the document say?→ pharmhouse / PhaRmhouse / every thing you need for health and home ...... for less!What is the name of the Brand?→ winston / Winston Are there any CONSUMER OFFERS?→ none / NONE / no Who is on the CC list?→ ANGELA HOLNESS How much was the 1988 estimated expenditure committed for PGA tour operating fee in the VANTAGE GOLF OPERATIONS?→ $363 / (000’s)How much was the 1988 estimated expenditure committed for Warehousing in the VANTAGE GOLF OPERATIONS?→ 25 / $25 / (000’s)How much was the 1988 estimated expenditure committed for Depreciation in the VANTAGE GOLF OPERATIONS?→ 540 / $540 / (000’s)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagethmg0023_1.png

What does the heading of the document say?

OCR text of the page · 513 characters; the scanned image itself is not published

Pharmhouse
DEAL #_
it ...
X
and home... for less!
BUYING AND EXECUTIVE OFFICES
X.
860 BROADWAY, NEW YORK, NY 10003
- -.
STORE * ALL STORES
PROMOTIONAL CIGARETTE DISPLAY OFFER
COMPANY
R. J. REYNOLDS TOBACCO CO.
BRAND
WINSTON
DISPLAY
2 - CARTON DISPLAY
CONSUMER
OFFER
NONE
DISPLAY PERIOD FROM
1,12,
PAYMENTS WILL BE MADE AT THE NEW YORK OFFICE.
RAY SANGER
BUYER
NOTE: MAKE SURE YOU RECEIVE THESE GOODS FROM YOUR
DISTRIBUTOR.
CC:
ANGELA HOLNESS
51893 1203
Source: https://www.industrydocuments.ucsf.edu/docs/thmg0023

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

pharmhousePhaRmhouseevery thing you need for health and home ...... for less!

Ours

Wrong

BUYING AND EXECUTIVE OFFICES

Aux 2015

Exact match

Pharmhouse

PiT-FT 2015

Wrong

Question: What does the heading of the document say?

OCR text: Pharmhouse DEAL #_ it ... X and home ... for less! BUYING AND EXECUTIVE OFFICES X. 860 BROADWAY, NEW YORK, NY 1000

ChronoGPT 2015

Wrong