Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexqfl0228_9.png

What is the annual due structure of general membership level?

OCR text of the page · 863 characters; the scanned image itself is not published
VIII. TENTATIVE START-UP EXPENSE BUDGET
RANGE
Low
High
Estimate
Estimate
(In thousands)
. Office Operation with loaned space
40
50
. Office Operation with rented space
100
125
. Executive Director
140
180
. Administrator
50
70
. Travel, entertainment reimb
30
. Secretary
$
30
30
Scientific and Economic Research
100
100
. Public relation/media counsel
75
100
. Legal counsel
100
150
Other
20
30
Totals:
$ 585 - 770 (Loaned Space)
$ 645 - 845 (Rented Space)
IX. ANNUAL DUES STRUCTURE
General Membership Level:
$2,500
Sustaining Membership Levels:
Associations
If less than $1 million in revenues:
$ 5,000
If between $1 and $10 million in revenues:
$15,000
If greater than $10 million:
$20,000
Associations dues can be paid with in-kind contributions for specific contributions
as approved by the Board.
Source: https://www.industrydocuments.ucsf.edu/docs/xqfl0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$2,500
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

$2,500

6 characters7 tokens

Aux 2015

Exact match

$2,500

6 characters7 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

$2,500 $5,000 $15,000 $20,000 $25,000 $30,000

45 characters29 tokens