Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelpdl0226_35.png

What % of men said No for question 20a?

OCR text of the page · 805 characters; the scanned image itself is not published
Question 20a :
Does sugar have any value in your daily diet
besides adding sweetness?
Total
Men
Women
Respondents who use sugar
(317=100% )
(13 3=100%%)
(184 =100%%)
Yes
54%
60%
No
414
51
39
Don't Know
2
2
1
No Answer
Question 20b:
If yes - What other value does it have?
Total*
Mend
Women*
Respondents who think sugar
(172=100% )
(62=100%)
(110=100% )
has another value
Reasons
Gives energy, needed to add
38%
89%
88%
fuel to body, need carbohy-
drates, quick energy poten-
tial, gives body heat.
Body needs certain amount of
15
18
13
sugar to function properly,
nutritious, body builder,
food value.
Makes things tastier, improves
taste.
w
w
3
All Other
1
Don't Know
N
* Adds to more than 100% because some respondents
gave more than one answer.
Source. Titips.7/www.industrydocuments. ucsT. eau/docs/ip
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
51
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

51

2 characters3 tokens

Aux 2015

Wrong

The question asks for the percentage of men who said "No" to question 20a, which is "Does sugar have any value in your daily diet besides adding sweetness?" The total number of respondents is 100% (men + women). The breakdown is:

  • Men: 100
241 characters64 tokens

PiT-FT 2015

Wrong

<|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant| <|assistant

141 characters64 tokens

ChronoGPT 2015

Wrong

Question 20a: Does sugar have any value in your daily diet?

Total* Mend Women Respondents who use sugar (317=100% ) (13 3=100% ) (184=100%%) Yes 54% 60% No

156 characters64 tokens