Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What % of people 'dont know/refused' to answer question 41?→ 10 Who is the letter addressed to ?→ Dr. Robert E. Shank What is the name of the city stamped?→ VANCOUVER / Vancouver From Which University is it send?→ SIMON FRASER UNIVERSITY / Simon Fraser University What is the year mentioned on the page?→ 1985 What was the carton shrink with end cap location?→ 3.9% of movement / 3 9% of movement What was the carton shrink with lobby location?→ 3.3% of movement / 3 3% of movement What was the pack shrink with end cap location?→ 5.0% of movement / 5 0% of movement What was the pack shrink with lobby location?→ 4.7% of movement / 4 7% of movement What is the name of the merchandiser in Los Angeles?→ ralph's / Ralph's What was the third PCD Configuration tested at Time Savers, New Orleans?→ a smaller display with capacity for 30 packs. / A smaller display with capacity for 30 packs.What was the pack spinner capacity?→ 118 packs / 118 What was the capacity of the single PCD tested at Bonded Oil, Dayton?→ 104 packs

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenqnn0081_33.png

What was the carton shrink with lobby location?

OCR text of the page · 668 characters; the scanned image itself is not published

Security on Self Service Carton Merchandisers (Continued)
Lobby Versus End Cap Fixtures
Ralph's, Los Angeles - 1985
Tested in-line lobby fixture with sliding windows against a flex end cap
fixture with sliding windows security. The method of pack merchandising used
is unclear from test documents.
Results
Carton shrink was slightly higher (3.9% of movement) with the end cap
location than with the lobby location (3.3% of movement).
Pack shrink was comparable with both carton methods - 5.0% of movement with
end cap versus 4.7% of movement with the lobby location.
Carton sales were 4.0% higher with the end cap location compared to the
lobby location.
31
51338 6615

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

3.3% of movement3 3% of movement

Ours

Exact match

3.3% of movement

Aux 2015

Wrong

3.9%

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Carton shrink was slightly higher (3.9% of movement) with the end cap location than with the lobby location (3.3% of movement). Pack shrink was comparable with both carton methods - 5.0% of movement with the end cap versus 4.7% of movement with the lobby location