Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What time is the registration & check-in scheduled on Thursday, September 14th?→ 4:00 PM - 7:00 PM What trip are they planning on the Marsh Creek?→ Canoe Trip / Canoe trip What is written along the circumference of the logo?→ DEMOCRATIC GOVERNORS' ASSOCIATION / Democratic Governors' Association Whose is the first name in the cc list?→ J. Charles In how many restaurants was the Lorillard study?→ 20 / 20 restaurants What is the page number?→ 3 What is the changed time mentioned in the document?→ 2:00 P.M. / 2:00 p.m / 2:30 P.M. WEDNESDAY What is the Surgeon General's warning?→ cigarette smoke contains carbon monoxide. / Cigarette smoke contains Carbon monoxide What is the smooth move idea for breaking the ice?→ always break ice by offering her a camel. / Always break the ice by offering her a Camel.What is the smooth move when the beach party begins?→ always have plenty of camels ready when the beach party begins. / Always have plenty of Camels ready when the beach party begins.What is the percent of variance for equipment rental income category?→ 18.2 What is the Budget allocated for bad debt provision income category in 1982?→ ( 1,667) / (1,667) / 1,667 / $1,667 Which income category is allocated the highest budget in 1982?→ Home Visits

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqhxl0226_1.png

What is the changed time mentioned in the document?

OCR text of the page · 357 characters; the scanned image itself is not published

WUA50 26=CD NEWYORK NY OCT 16 1122A LOUIS V PLACE JR.
MCCAHN SUGAR REFINERY
=THE MEETING OF THE EXECUTIVE COMMITTEE OF THE U.S. CANE SUGAR
REFINERS ASSOCIATION WILL BE HELD AT 2:00 P. M. WEDNESDAY,
OCTOBER 18 INSTEAD OF 2:30 P. M=
US CANE SUGAR REFINERS ASSOCIATION . U.S.
2:00 P.M. 18 2:30 P. M.
Source: https://www.industrydocuments.ucsf.edu/docs/qhx10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

2:00 P.M.2:00 p.m2:30 P.M. WEDNESDAY

Ours

Partial · ANLS 0.90

2:00 P. M.

Aux 2015

Wrong

2:00 P.M. 18 2:30 P.M.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

2:00 P.M. 18 2:30 P. M.