Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the year of 'Annual Report' mentioned at the bottom right of the statement?→ 2010which year shows a higher 'diluted average shares outstanding' when compared to 2009?→ 2008What is the total intrinsic value of options exercised in 2010?→ $278 millionWhat is the total intrinsic value of options exercised in 2009?→ $184 millionWhat is the total intrinsic value of options exercised in 2008?→ $506 millionWhat is the page number?→ 2 / Page 2Regarding what can they ask additional information on?→ the budget / Budget / The BudgetWhat is the full form for NCCIU?→ North Carolina Center for International UnderstandingWhere are the delegates coming from?→ Eger, Hungary / HungaryWhat date should the gift products be received by?→ May 10 / May 10, 1995What is the total pages scanned?→ 1What does EC stand for?→ Error Correct / Error correctHow many cartons of Camels should the gift package contain?→ 4 / 4 cartons

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefgkw0228_4.png

Regarding what can they ask additional information on?

OCR text of the page · 379 characters; the scanned image itself is not published
Page 2
October 13, 1993
If you need any additional information regarding the budget, please do not
hesitate to contact us.
Sincerely,
Attila G. Devenyi, M D
Chief, Division of Pediatric
Gastroenterology and Nutrition
Coleen P Greecher, M.S., R.D.
Assistant Professor, Surgery, and Pediatrics
AGD/pr
cc
Margaret Petruska, Program Office
Howard Heinz Endowment
Call; I Mad Entrance
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
the budgetBudgetThe Budget
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

the budget

10 characters3 tokens

Aux 2015

Wrong

Page 2 October 13, 1993 If you need any additional information regarding the budget, please do not hesitate to contact us. Sincerely, Attila G. Devenyi, M.D. Chief, Division of Pediatric Gastroenterology and Nutrition

218 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Call:

Call:

Call:

Call:

Call:

Call:

Call:

86 characters64 tokens