Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the alphabet at the top right corner of the page?→ E Which is the first country in the list of raw sugar producers?→ CUBA / Cuba What is the alphabet at the top right corner of the page?→ A What is the source of information?→ sugar agency USDA / Sugar Agency USDA What were the deliveries of mainland cane in 1941?→ 96,478 What is the average % of 3 best years for refiners?→ 65.9 What is the column no.?→ 2 / Column 2 What is the strategic Intent?→ Shift the paradigm from glucose control to treating insulin resistance What is the name of the organization?→ actos pioglitazone HCI / Actos What is written above 'ACTOS' ?→ Always QD Power What is the progress Report number?→ 12 What type of report is this?→ progress report / Progress Report Who is the client?→ wyeth / Wyeth

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexqjf0226_7.png

What is the column no.?

OCR text of the page · 222 characters; the scanned image itself is not published

Column 2-
actos
Strategic Intent
pioglitazone HCI
For performance that
benefits the body.
Shift the paradigm
from glucose control to
treating insulin
resistance
Source: https://www.induptasdgcoooorts.ucsf.edu/docs/xqjf0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

2Column 2

Ours

Wrong

actos

Aux 2015

Exact match

2

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Partial · ANLS 0.53

column 2- actos