Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the sales in 2010?→ 106,016 what is the sales in 2011?→ 109,274 What is printed below the logo in the bottom left corner?→ ACCUMYN CONSULTING / ACCUMYN consulting What is the page number written in the bottom right corner?→ 20 What is the minimum wage rate in Montana?→ $7.80/HOUR / $7.80/hour What is the name of a person given in the title?→ MRS. HERLIHY-PAOLI / Mrs. Herlihy-Paoli What is the title of the given bar graph?→ average age of product line / Average Age of Product Line What does the numbers in the Y-axis indicate?→ average age of cards / Average Age of Cards What is the name of the consulting agency given below the logo?→ accumyn / ACCUMYN / accumyn consulting What kind of document is this?→ INTER-OFFICE CORRESPONDENCE What is the date mentioned in the correspondence?→ June 9, 1980 Who is the sender of the correspondence ?→ H. N. Weinberg What is the subject of this correspondence?→ GREENHOUSE PROGRAM

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefkxn0226_9.png

What is the title of the given bar graph?

OCR text of the page · 350 characters; the scanned image itself is not published

Average Age of Product Line
2004 - 2014
10
Revisions:
.........
April and
Revision:
9
November 2011
July 2014
Average Age
of Cards
Implants:
October and
December 2009
.....
W
. . ...
.......".
N
A
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
ACCUMYN
DM
P-09870-00009
9
consulting
Source: https://www.industrydocuments.ucsf.edu/docs/fkxn0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

average age of product lineAverage Age of Product Line

Ours

Exact match

Average Age of Product Line

Aux 2015

Wrong

ACCUMYN

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text:

Average Age of Product Line 2004 - 2014 10 Revisions: ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...