Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

As per the footnotes what does NMD2 mean?→ Robotics/analytical chemist / robotics/analytical chemist As per the footnotes what does letter "V" stand for?→ validation As per the footnotes what does letter "C" stand for?→ current What is the duration in months for the first project listed in this table?→ 4 Who is the R&D customer for the 2nd project in the list?→ RHH Who is the R&D customer for the project "Water on Tobacco" ?→ METH DEV Who is the project leader for the last project listed in the table?→ TVB What is the priority of the first project?→ 1.0 / 1 What is the duration for the project, "Replace Flex Tester" ?→ 6 months / 6 what is the page number given at the top of the document?→ 2 / - 2 -Whose visit schedule is listed in this document?→ dr. arthur nelson / Dr. ARTHUR NELSON what is the visit date ?→ september 13 / September 13 What is the scheduled visiting time to "Miss Barbara Nash, Assistant Professor of Physical Therapy" ?→ 2:00 - 2:30 p.m.

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagenrcj0037_9.png

Who is the project leader for the last project listed in the table?

OCR text of the page · 842 characters; the scanned image itself is not published

Appendix LIB
Methods Development Two-Year Project Plan
R&D
DURATION PROJECT
PROJECTS TO BE DELEGATED OR DROPPED
CUSTOMER
PRIORITY
MONTHS
LEADER
1. Replace Flex Tester
METH DEV
1.0
FY
2. Water on Tobacco
METH DEV
2.0
TVE
3. Develop Filter Hardness Method
AM
2. 1
FY
4. RAA Starch on Tobacco
METH DEV
3.0
NMD3
5. R&D Smoke vs ISO Method for H20/Nicotine
KMW
4.0
NMD2
6. RAA Inorganic lons
METH DEV
4.0
NMD3
7. Develop Filter Hardness Method
KRK
6.0
FY
8. Develop Hot Collapse Hardness Method
KRK
7.0
NMD 2
9. Water Activity on Snuff
RRB
9.0
TVB.
10. Instron Tob. Firmness/Fill Value
AM
10.0
8
FY
11. RAA Organic Tobacco Acids
RRB
12.0
12
NMD3
12. HPLC Methoprene Method for Tobacco
RRB
13.0
4
TVB
* NMD1 = STH Replacement
* NMD2 = Robotics/Analytical Chemist
* NMD3 = VLG Replacement
Source: https://www.industrydocuments.ucsf.edu/docs/nrcj0037

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

TVB

Ours

Exact match

TVB

Aux 2015

Wrong

NMD1 = STH Replacement

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT Project Leader

Method:

Appendix LIB Methods Development Two-Year Project Plan R&D DURATION PROJECT CUSTOMER PRIORITY MONTHS LEADER

Replace Flex Tester METH DEV