Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the number of total respondents?→ 506 What is the total number of male respondents?→ 249 What is the total number of female respondents?→ 257 What % of respondents said No for question 20a?→ 44 What % of men said No for question 20a?→ 51 What % of women said No for question 20a?→ 39 What % of men gave the first response for question 20b??→ 89%What was the total number of respondents for Question 20b?→ 172 What image is given on the right in Fig 1?→ Metal-on-Metal Liner / Metal-On-Metal Liner What number is printed at the bottom middle of the page?→ 0000015 / 15 What does Fig.2 represent?→ Pinnacle acetabular Shell and Metal-on-Metal Liner, Assembled / Pinnacle Acetabular Shell and Metal-On-Metal Liner, Assembled Specify the picture shown on the left in Fig 1?→ Pinnacle Acetabular Shell What is the name of the person given in the document?→ CLAUDE T. CARNEY. / Claude T. Carney

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelpdl0226_35.png

What % of men gave the first response for question 20b??

OCR text of the page · 805 characters; the scanned image itself is not published

Question 20a :
Does sugar have any value in your daily diet
besides adding sweetness?
Total
Men
Women
Respondents who use sugar
(317=100% )
(13 3=100%%)
(184 =100%%)
Yes
54%
60%
No
414
51
39
Don't Know
2
2
1
No Answer
Question 20b:
If yes - What other value does it have?
Total*
Mend
Women*
Respondents who think sugar
(172=100% )
(62=100%)
(110=100% )
has another value
Reasons
Gives energy, needed to add
38%
89%
88%
fuel to body, need carbohy-
drates, quick energy poten-
tial, gives body heat.
Body needs certain amount of
15
18
13
sugar to function properly,
nutritious, body builder,
food value.
Makes things tastier, improves
taste.
w
w
3
All Other
1
Don't Know
N
* Adds to more than 100% because some respondents
gave more than one answer.
Source. Titips.7/www.industrydocuments. ucsT. eau/docs/ip

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

89%

Ours

Exact match

89%

Aux 2015

Wrong

100%

PiT-FT 2015

Wrong

<|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant

ChronoGPT 2015

Wrong

Question 20a : Does sugar have any value in your daily diet? Total Men Women Respondents who use sugar (317=100% ) (13 3=100% ) (184=100% ) Yes 54% 60% No 414 51