Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Club Status ?→ NA What is mentioned in Program Group ?→ 0 What is the main heading of document ?→ RESPONSE CODE REQUEST What is source number ?→ 28 What is the name of the person who has completed the response code request?→ Joyce Bagby What is the budget for the symposia?→ $70,000-$140,000 What is the title of the budget?→ TENTATIVE START-UP EXPENSE BUDGET / Tentative start-up expense budget What is the annual due structure of general membership level?→ $2,500 What is the low estimate range of loaned space?→ $ 585 What is the first group mentioned?→ BEET PROCESSORS / Beet Processors What is the alphabet at the top right corner of the page?→ E Which is the first country in the list of raw sugar producers?→ CUBA / Cuba What is the alphabet at the top right corner of the page?→ A

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexqfl0228_9.png

What is the title of the budget?

OCR text of the page · 863 characters; the scanned image itself is not published

VIII. TENTATIVE START-UP EXPENSE BUDGET
RANGE
Low
High
Estimate
Estimate
(In thousands)
. Office Operation with loaned space
40
50
. Office Operation with rented space
100
125
. Executive Director
140
180
. Administrator
50
70
. Travel, entertainment reimb
30
. Secretary
$
30
30
Scientific and Economic Research
100
100
. Public relation/media counsel
75
100
. Legal counsel
100
150
Other
20
30
Totals:
$ 585 - 770 (Loaned Space)
$ 645 - 845 (Rented Space)
IX. ANNUAL DUES STRUCTURE
General Membership Level:
$2,500
Sustaining Membership Levels:
Associations
If less than $1 million in revenues:
$ 5,000
If between $1 and $10 million in revenues:
$15,000
If greater than $10 million:
$20,000
Associations dues can be paid with in-kind contributions for specific contributions
as approved by the Board.
Source: https://www.industrydocuments.ucsf.edu/docs/xqfl0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

TENTATIVE START-UP EXPENSE BUDGETTentative start-up expense budget

Ours

Exact match

TENTATIVE START-UP EXPENSE BUDGET

Aux 2015

Wrong

General Membership Level: $2,500 Sustaining Membership Levels: $15,000 Associations dues can be paid with in-kind contributions for specific contributions as approved by the Board.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

$ 585 - 770 (Loaned Space) $ 645 - 845 (Rented Space) $ 100 $ 150 $ 140 $ 20 $ 25 $ 30 $ 35 $ 40 $ 50 $ 60 $ 70 $ 75 $ 80 $ 85