Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexfjv0228_3.png

What is the marital status?

OCR text of the page · 1,934 characters; the scanned image itself is not published
GREAT WESTERN UNITED CORPORATION
INFORMATION SHEET
Name. . ... . George E.. Wilber . /! . .. ... . . . .
Birthdate . 2. 6 3. . .... . . . . . . . ...
Company Name & Title. . President, The Great Western Sugar Company
. . . . . . . . . . . .. . .. . . .. ........
Office Address. . .1530. Sixteenth Street, Denver, Colorado
. . .
. . . .
Office Phone .No. .. . ..
893-4601
i. . . . . . . .
Great Western Starting Date & Job History with Company. 69 - Treasurer Great
Western United; 6/70 additional title - Vice President, Great Western Cities; 11/70 -
Vice President/ Project. General Manager :- Colo. City; 4/71 - Vice President/ Project
General Manager - Cochiti Lake; 6/71 - President, The Great Western Sugar Co."
Education. . . ..
. . . . . . ..
. . . . .
.195 1-53 University of Maryland, 1955-57 Syracuse University (B.S. -
Business Administration, cum laude)
. . . . . . .
CPA . ..
. . . . . . . . . . . . ..
. . . . .
Military Service. . United States. Army . Paratroopers 1953-55
. . . . . . . . .
. . . . . . . .
. . . .
. . . . .
Past Employment. .1,957,-65. Arthur Andersen & Co. (auditing and consulting); 1965-69
. . . . . . . . . . . . . .. .......
Boise Cascade Corp. (Director of Financial Services, Home and Land Operations --
. . . . . . . . . . . . .. .............
Director of Development, Home and Land Division -- General Manager of the Recrea-
:. . ... . . . . . . . .. .. .50....................
tional. Products Division)
Directorships . . . .
. . . .
. . . . .
Home Address. .3543 South Hillcrest Drive , Denver, Colorado 80237
. . .
Home Phone No.759-4048
. . . . . ..
Marital Status Married . - Pale. . .. ...... . .
Children. ? . . . . . .
Other Interests, Activities, Affiliations. ....
. . . .
. . . . . . . .
THIS INFORMATION WILL BE KEPT IN CONFIDENTIAL FILE WITH GWU AND WILL
BE USED ONLY FOR REPORTS NECESSARY TO THE BUSINESS FUNCTION
Source: https://www.industrydocuments. ucsf. edu/docs/xijv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Married - Dale
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.50

Married

7 characters3 tokens

Aux 2015

Wrong

GREAT WESTERN UNITED CORPORATION

INFORMATION SHEET

Name. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

158 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Information Sheets:

Name. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

141 characters64 tokens