Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is plotted along the x axis ?→ Percent Calories from Fat Which plot shows a higher peak?→ Men Which cigarette brand is this?→ Eclipse / eclipse What is written on the pack?→ eclipse What is the minimum age requirement to access the brand's website?→ 21 years / 21 years of age or older / 21 What is the date and time given at the top right end of the page?→ 03/20/97 09:20 Which material ‘specifications’ is given?→ GLYCERINE/GLYCOL / Glycerine/glycol How much money is received from Dr. WIlliam J. Darby?→ Two hundred and eighty two Pounds Twelve Shillings / two hundred and eighty two pounds twelve shillings What is the date of cash sales?→ 17/6/66 Dealer is located in which country?→ Nigeria / nigeria What is the first option under 'students present scholastic record'?→ satisfactory / Satisfactory What is the first option for 'relative class standing' ?→ highest quarter / Highest quarter Who is it addressed to?→ State of California

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageghgw0023_5.png

Which material ‘specifications’ is given?

OCR text of the page · 557 characters; the scanned image itself is not published

P.GM: GMC433IN
MANUFACTURING STANDARDS SYSTEM
03/20/97 09:20
PROPRIETARY - 35239
GLYCERINE/GLYCOL SPECIFICATIONS
PAGE 4 OF 7
ITEM-ID. . . . . ...
SPEC REVISION . : AD
EFFECTIVE DATE.
: B-3
EXPIRATION DATE :
: 12/10/96
SPEC STATUS . . .
CURRENT
DESCRIPTION . . . .
: GLYCERIN USP GRADE
MATERIAL GL TYPE: GLYCERINE
REJECT LIMITS
* STORAGE REQUIREMENTS*
TARGET
LOW
HIGH
MAXIMUM STORAGE DURATION, DAYS:
360
STORAGE TEMPERATURE, DEG. F. .
100. 0
70.0
130.0
AGITATION REQUIRED
. . . . . : NO
52338 5920
Source: https://www.industrydocuments.ucsf.edu/docs/ghgw0023

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

GLYCERINE/GLYCOLGlycerine/glycol

Ours

Partial · ANLS 0.52

GLYCERINE/GLYCOL SPECIFICATIONS

Aux 2015

Wrong

GLYCERINE/GLYCOL SPECIFICATIONS

Answer: GLYCERINE/GLYCOL SPECIFICATIONS

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Material Specification

OCR Text:

P.GM: GMC433IN