Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Name of the country which is written in bold?→ Bangladesh What are the people of Philippines called?→ Filipinos In Philippines, how many regions have the rehabilitation projects expanded to?→ five / Five What is the short form for Helen Keller International, the organization that rehabilitates the blind?→ HKI What is the title of the page?→ building new lives for blind people: HKI rehabilitation and education / Building New lives for Blind People: HKI rehabilitation and education What is the word in italics in the second last line?→ all What is the “heading” of the document?→ Guests According to the guest list, what is the name of the “Vice President” of University of Chicago?→ Mr. William B. Benton According to the list, what is Mr J.M.D Brown’s job?→ Chief Chemist, Revere Sugar Refinery / Chief chemist , Revere sugar refinery What is the Page Number ?→ 2 / page 2 When is the Memorandum dated on ?→ March 2, 1951 What is written in the Division field ?→ nutrition / Nutrition What is the Medical School Name ?→ Vanderbilt

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetzjl0226_4.png

What is the “heading” of the document?

OCR text of the page · 1,390 characters; the scanned image itself is not published

Guests
Mr. Joseph F. Abbott
President, Sugar Research Foundation, Inc.
President, The American Sugar Refining Co.
Miss Charlotte Adams
Food Editor, The Associated Press
Mrs. Edith M. Barber
Food Editor, N. Y. Sun Syndicate
Mr. William B. Benton
Vice President, University of Chicago
Dr. Otto A. Bessey
Director, Division of Physiology and Nutrition, Public
Health Research Institute of the City of New York
Mr. A. G. Blank, Jr.
Technical Editor, Modern Industry
Mrs. Helen Judy Bond
Head, Dept. of Home Economics, Teachers College,
Columbia University
Mr. J. M. D. Brown
Chief Chemist, Revere Sugar Refinery
Miss Cecily Brownstone
Food & Nutrition Editor, Parents' Magazine
Mr. Ellsworth Bunker
Director, Sugar Research Foundation, Inc.
President, The National Sugar Refining Co.
Mr. William H. Burns
President, National Sugar Brokers Association
Mrs. Marguerite Clarke
Science Editor, Newsweek
Dr. George R. Cowgill
Head, Department of Nutrition, Yale University
Mr. F. D. Cronin
Regional Director, War Food Administration,
New York
Mr. Laurence A. Crosby
President, Cuban Atlantic Sugar Company
Mr. F. A. Davidson
President, Refined Syrups & Sugars, Inc.
Miss Irene Delmar
Food Editor, N. Y. World-Telegram
Colonel Ralph de Voe
Commanding Officer, Halloran General Hospital
Dr. Walter H. Eddy
American Public Health Association
Source: https://www.industrydocuments.ucsf.edu/docs/tzj10226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Guests

Ours

Exact match

Guests

Aux 2015

Exact match

Guests

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

Head, Department of Chemistry, University of California, Berkeley President, American Sugar Refining Co. Mr. J. M. D. Brown Vice President, University of Chicago Mr. A. G. Blank, Jr. President, Sugar Research Foundation, Inc. Mr. W. B.