Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefkxn0226_14.png

what is the sales in 2010?

OCR text of the page · 1,245 characters; the scanned image itself is not published
Comparison of Earnings Before and After the Injury
Past Earnings = (Officers' Compensation + Net Income)
Calculation Based on Total Earnings (Officers' Compensation + Net Income)
200
2005
2006
2007
2008
2009
2010
Sales
470,832
415,582
447,099
317,916
277,946
88,753
106,016
Operating Income
354,433
309,251
356,666
236,747
190,544
135,444
75,331
Officers' Compensation
64, 101
30.455
38,061
99,268
93,562
53,464
42,768
Net Income
165,442
110,745
156,353
35,942
4,198
2,326
(26,706)
Total Earnings
229,543
191,200
244,414
135,210
97,760
65,790
16,062
Weight
3
Pre-Injury Annual Earnings
(based on 5 year weighted average)
$ 158,322
2011
2012
2013
2014
(Jan 1 - Aug 27)
Sales
109,274
1 10,854
93,528
53,172
Operating Income
75,183
80,587
64,070
37,163
Officers' Compensation
8,563
31,420
27,391
2,500
Net Income
10,424
(12,115)
(9,566)
(10,412)
Total Earnings
18,987
19,305
17,825
2,088
Post-Injury Annual Earnings
(based on 2011 - 2012 average)
$
19,146
A
Date of First Implant Revision (Left)
April 26, 201 1
Date of Implant (Right)
October 29, 2009
Date of Second Implant Revision (Right)
November 8, 2011
Date of Implant (Left)
December 14, 2009
ACCUMYN
P-09870-000044
14
consulting
Source: https://www.industrydocuments.ucsf.edu/docs/fkxn0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
106,016
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

106,016

7 characters8 tokens

Aux 2015

Wrong

The sales in 2010 are not provided in the text. The question asks for the sales in 2010, but the text only provides information up to 2010.

139 characters43 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Sales

Pre-Injury Earnings

Past Earnings (Officers' Compensation + Net Income) Calculation Based on Total Earnings (Officers' Compensation + Net Income) 200 2005 2006 2007 2008 2009 2010 Sales 470,832 415,582

212 characters64 tokens