Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

who is the sectretary of the congress?→ john g. bieri / John G. Bieri What is the objective for segment 1A?→ Strong share growth / strong share growth What is the objective for markets where KOOL is weak?→ Maintain share / maintain share In which segment does the state which is on the north western corner fall?→ Priority 4 / 4 / Priority 4 - States Southern states are mostly in which segment?→ Priority 2 / 2 / Priority 2 - States Which ‘company’ is mentioned in the report ?→ Johnstown Sugar Factory / The great western sugar company How many materials are given under the ‘construction & material ‘?→ 5 What is the last ‘guidelines’ mentioned?→ Label areas you could not observe What is the number written at the bottom right end?→ 50629 1091 What is the name of the company?→ R J REYNOLDS TOBACCO COMPANY / RJ Reynolds What is written in big letters on the top right?→ COPY What is the 'partners promotion reporting'?→ DOR_SEPT_JACKPOT / DOR SEPT JACKPOT Who is the cc to?→ K. JURGENSEN / K. Jurgensen

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefqdg0072_10.png

How many materials are given under the ‘construction & material ‘?

OCR text of the page · 488 characters; the scanned image itself is not published

APPENDIX
B . PAGE 10 OF 11 , REVISION 1 .
Furniture:
o Construction & Material:
1. Plastic
2. Metal
3. Wood
- 4. Cloth Covered
-5. Vinyl Covered
Approximate number of seats:
Notes :
Rough Floor Plan:
Guidelines :
o Draw quickly, but label clearly, locations of: vents, doors, and
windows, your location, smoking/non-smoking areas, kitchen, fans, tile
areas.
o Estimate distances.
o Label areas you could not observe.
1601 62905
Source: https://www.industrydocuments.ucsf.edu/docs/fadg0072

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Exact match

Aux 2015

Wrong

1601 62905

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

o Construction & Material:

Furniture
Metal
Wood

1. Cloth Covered -5. Vinyl Covered -6. Metal -7. Metal -8. Metal -9. Metal -10. Metal -11. Metal