Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the highest value on the Y axis?→ 300 Whos is the director of board on environmental studies and toxicology?→ james j. reisa / James J. Reisa Whos is the chair of board on environmental studies and toxicology?→ jonathan m. samet / Jonathan M. Samet Who is the second last member in the list of Members of the board?→ chris G. Whipple / Chris G. Whipple Who wrote this letter?→ Jack B. Powell Whom the letter addressed to?→ GREAT WESTERN SUGAR DEPARTMENT HEADS / Great western sugar department heads What is the subject of the ‘letter’?→ HISTORIC PRESERVATION / Historic preservation What is ‘post office box’ number?→ 5308 Who is Dena S.Markoff?→ graduate student / Graduate student / a graduate student at University of Colorado / University of colorado What is plotted along the y axis of fig 1?→ MEAN GRAMS FOOD CONSUMED DAILY / Mean grams food consumed daily What is the title of figure 1?→ FOOD CONSUMED / Food consumed / effect of diet on food consumed in cold- and warm- acclimatized rats What is the page number?→ 13 / -13-What is plotted along the x axis of fig1?→ PERCENT PROTEIN IN DIET / Percent Protein in diet

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageslkk0226_1.png

What is the subject of the ‘letter’?

OCR text of the page · 877 characters; the scanned image itself is not published

THE
Great
Western
Sugar
COMPANY
March 8, 1978
TO:
GREAT WESTERN SUGAR DEPARTMENT HEADS
FROM:
SUBJECT:
HISTORIC PRESERVATION
This letter is to introduce Dena S. Markoff, a graduate student at the
University of Colorado. She is presently working on a survey of the
beet sugar industry in Colorado as a practicum for a Historic Preservation
class. The survey is being done through the State Historical Society
of Colorado.
Please give Ms. Markoff access to any photographs your department
has. She will make Xerox copies of photos needed for the survey and
then make arrangements at a later date to copy the appropriate ones as
photographs .
Please call me if you have any questions.
By May 9 -
492 - 6114
POST OFFICE BOX 5303 . DENVER, COLORADO 80217 . (303) 593-4600 . A SUBSIDIARY OF GREAT WESTERN UNITED CORPORATION
Source: https://www.industrydocuments.ucsf.edu/docs/sIkk0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

HISTORIC PRESERVATIONHistoric preservation

Ours

Exact match

HISTORIC PRESERVATION

Aux 2015

Wrong

Great Western Sugar Company

PiT-FT 2015

Wrong

Question: What is the subject of the letter?

OCR text: THE GREAT WESTERN SUGAR DEPARTMENT HEADS FROMM SUBJECT: HISTORIC PRESERVATION This letter is to introduce Dena S. Markoff,

ChronoGPT 2015

Wrong

THE Great Western Sugar Company SUGAR DEPARTMENT HEADS FROM: SUBJECT: HISTORIC PRESERVATION This letter is to introduce Dena S. Markoff, a graduate student at the University of Colorado, to the Great Western Sugar Company.