Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekhxj0037_4.png

full form of PM super lights

OCR text of the page · 1,242 characters; the scanned image itself is not published
DOMESTIC PRODUCT DEVELOPMENT (cont'd.)
POL 0911, B&H Menthol versus Salem 100 - B&H Menthol, without print down rod, are
being produced in Cabarrus this week.
HTI 1723, Marlboro Lights Menthol versus Salem Lights 100's samples are being
produced in Louisville this week.
Market Research
HTI 2526 and HTI 2532, Marlboro 80 Box versus Camel 80 Box - These samples have
been approved for shipment on 6/4/90.
INTERNATIONAL PRODUCT DEVELOPMENT
PM Super Lights (Hong Kong)
Production start-up of Philip Morris Super Lights Menthol began the 6th of June at the
Manufacturing Center. The 18 million order is to be shipped to Hong Kong in preparation for a
July 1 launch.
Project Ring (Korea)
Cigarettes for PMI test #13 (Parliament KS 9mg versus 88 Lights) have been approved and
shipped to the warehouse.
Seoul Consumer Panel Testing (Korea)
Cigarettes for SCP #9 (88 Lights versus PM Super Lights carbon loading study) have been
approved and shipped to the warehouse. Filters have been made and combined for SCP #10
Parliament filter study).
Merit Lights (Hong Kong)
Cigarettes for PMI testing of Merit Lights prototype versus Kent have been produced and
are under analysis.
4
2022155854
Source: https://www.industrydocuments.ucsf.edu/docs/khxj0037
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Philip Morris Super Lightsphilip morris super lights
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Philip Morris Super Lights

26 characters5 tokens

Aux 2015

Wrong

The full form of PM Super Lights is PM Super Lights.

52 characters13 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

OCR text: DOMESTIC PRODUCT DEVELOPMENT (cont'd.)

Market Research (cont'd.)

Project Ring (Korea)

Cigarettes for PMI test #13 (Parliament KS 9mg versus 88 Lights) have been approved and shipped to the

208 characters64 tokens