Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefpkm0227_1.png

who is the sectretary of the congress?

OCR text of the page · 1,227 characters; the scanned image itself is not published
Herbert
XII INTERNATIONAL CONGRESS OF NUTRITION
International Union of Nutritional Sciences
81
1629 K Street, N.W., Suite 700
Washington, D.C. 20006, U.S.A.
(202) 296-8803
Cable: ICN-89-2407
August 16-21, 1981
San Diego, California
Congress Officers
President: George K. Davis
Vice President: Samuel J. Fomon
Vice President: Alfred E. Harper
Secretary: John G. Bieri
Treasurer: Mattie Rae S. Fox
XII International Congress of Nutrition, August 16 - 21, 1981
Town and Country Hotel, San Diego, California, U. S. A.
August 17 Workshop on "Interaction of Vitamin B,, with Nutrients and Drugs"
Presentation by Victor Herbert, M. D. , J. D. , Chief, Hematology and
Nutrition Laboratory, Bronx VA Medical Center and Professor of Medicine,
SUNY Downstate Medical Center will refer to the following material,
and which, if confirmed -by other workers, suggests that the $2-billion-
a-year multivitamin/mineral industry may have to take vitamin B,2 out of
their products:
The abstract (see over) will be published in the October 1981 issue
of "Clinical Research."
Hosts: American Institute of Nutrition, American Society for Clinical Nutrition, U.S. National Academy of Sciences
Source: https://www.industrydocuments.
.edu/docs/ipkm0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
john g. bieriJohn G. Bieri
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

John G. Bieri

13 characters6 tokens

Aux 2015

Wrong

The sectretary of the congress is John G. Bieri.

48 characters15 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU,

Question:

Who is the secretary of the congress?

XII INTERNATIONAL CONGRESS OF NUTRITION

Question:

Who is the secretary of

199 characters64 tokens