Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for greasy-condor is: 6528135.
One of the special magic numbers for ancient-trait is: 2939549.
[… 311 lines omitted for display …]
One of the special magic numbers for grouchy-seaweed is: 2087632.
One of the special magic numbers for various-freezer is: 6307428.
One of the special magic numbers for fancy-diaphragm is: 6806593.
One of the special magic numbers for ad hoc-entry is: 1290420.
One of the special magic numbers for unbiased-attitude is: 5454133.
One of the special magic numbers for entertaining-stallion is: 6891506.
One of the special magic numbers for zippy-village is: 2273329.
One of the special magic numbers for exultant-observatory is: 4947877.
One of the special magic numbers for receptive-boom is: 5652109.
One of the special magic numbers for alluring-mouth is: 7352145.
One of the special magic numbers for exultant-book is: 3573901.
One of the special magic numbers for steadfast-hops is: 5320067.
One of the special magic numbers for temporary-swimming is: 7778469.
One of the special magic numbers for lazy-crab is: 2649649.
[… 1,077 lines omitted for display …]
One of the special magic numbers for ruddy-impala is: 4967068.
One of the special magic numbers for cooing-offer is: 9697555.
What is the special magic number for exultant-observatory mentioned in the provided text?
Original prompt 32,242 tokens, 1,408 linesShown 20 lines around the needleNeedle at 23% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5225708Aux 20154967068Ours4947877Ours, no steer.4947877PiT-FT5225708Qwen 27B4947877
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4947877.

13 characters10 tokens

Aux 2015

Found the needle

4967068.

13 characters10 tokens

PiT-FT 2015

Missed

: 8805535. The special magic number for the most recent-fever is: 8805535. The special magic number for the most recent-turtle is: 8805535. The special magic number for the most recent-turtle is: 8805535. The special magic number for the most recent-turtle is: 8805535. The special magic number for the most recent-turtle is: 8805535. The special magic number for the most recent-turtle is: 8805535. The special magic number for the most

444 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-mparency?

Answer:

The special magic number for the-mortal is:

Question:

What is the special magic number for the-mortal?

Answer:

The special magic number for the-mortal is:

Question:

What is the special magic number for the-mortal?

Question:

What is the special magic number for the-mortal?

Answer:

The special magic number for legal-mortal is:

Question

446 characters128 tokens