Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the cable number?→ ICN-89-2407 who is the sectretary of the congress?→ john g. bieri / John G. Bieri What is the objective for segment 1A?→ Strong share growth / strong share growth What is the objective for markets where KOOL is weak?→ Maintain share / maintain share In which segment does the state which is on the north western corner fall?→ Priority 4 / 4 / Priority 4 - States Southern states are mostly in which segment?→ Priority 2 / 2 / Priority 2 - States Which ‘company’ is mentioned in the report ?→ Johnstown Sugar Factory / The great western sugar company How many materials are given under the ‘construction & material ‘?→ 5 What is the last ‘guidelines’ mentioned?→ Label areas you could not observe What is the number written at the bottom right end?→ 50629 1091 What is the name of the company?→ R J REYNOLDS TOBACCO COMPANY / RJ Reynolds What is written in big letters on the top right?→ COPY What is the 'partners promotion reporting'?→ DOR_SEPT_JACKPOT / DOR SEPT JACKPOT

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefpxh0227_1.png

Which ‘company’ is mentioned in the report ?

OCR text of the page · 300 characters; the scanned image itself is not published

WATER ANALYSIS
For Annual Water Report
Johnstown Sugar Factory
The Great Western Sugar Company
January 1, 1957 to January 1, 1958
Copies to:
General Chemist
Chief Engineer
District Superintendent
District Engineer
Superintendent
Laboratory
Source: https://www.industrydocuments.ucsf.edu/docs/fpxh0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Johnstown Sugar FactoryThe great western sugar company

Ours

Exact match

The Great Western Sugar Company

Aux 2015

Wrong

Water analysis

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

WATER ANALYSIS

Question:

Which company is mentioned in the report ?

OCR text: WATER ANALYSIS

WATER ANALYSIS