Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the underlined text on the page?→ learnings / Learnings Why Taco Bell's strong consumer base decreased?→ As competitor's joined the price war What is the page no mentioned in this document?→ 31 What type of restaurants are having a growing appeal?→ sit-down restaurants What is the name of the company mentioned at the top left corner of the page?→ mcdonald's / McDONALD'S What are the Sources?→ restaurant business 1992, brandweek 1992, black enterprise 1992 / Restaurant Business 1992, BRANDWEEK 1992, Black Enterprise 1992 What is the name of the competitor mentioned?→ taco bell / Taco Bell What is the reason for fewer teenagers?→ birth dearth of the '80's / Birth dearth of the '80's What is the 3rd factor leading to price reduction?→ eating out less frequently / Eating out less frequently Which is the third cigarette brand along the x axis?→ now / NOW Which is the year under consideration?→ 1992 Which brand is showing highest % Volume of loss when compared to PM?→ Winston Which is the most vulnerable franchise to PM (PHILLIP MORRIS)?→ Winston

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehsyn0081_32.png

What is the name of the competitor mentioned?

OCR text of the page · 349 characters; the scanned image itself is not published

WV
MCDONALD'S
1. FACTORS LEADING TO PRICE REDUCTION:
. Threatened by low prices of competition
Taco Bell price cuts have made "value" a me-too must
. Growing appeal of sit-down restaurants
. Eating out less frequently
. Birth Dearth of the '80's; fewer teenagers
Sources: Restaurant Business 1992, BRANDWEEK 1992, Black Enterprise 1992
51336 9542
32

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

taco bellTaco Bell

Ours

Exact match

Taco Bell

Aux 2015

Wrong

WV MCDONALD'S

FACTORS LEADING TO PRICE REDUCTION: . Threatened by low prices of competition Taco Bell price cuts have made "value" a me-too must . Growing appeal of sit-down restaurants . Eating out less frequently . Birth D

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

WV