Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#046 · needle at 92% depth#047 · needle at 68% depth#048 · needle at 79% depth#049 · needle at 19% depth#050 · needle at 26% depth#051 · needle at 76% depth#052 · needle at 16% depth#053 · needle at 51% depth#054 · needle at 59% depth#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth#058 · needle at 81% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for boiling-eyebrow is: 9013279.
One of the special magic numbers for energetic-devastation is: 2879350.
[… 913 lines omitted for display …]
One of the special magic numbers for substantial-friend is: 3696637.
One of the special magic numbers for sour-neonate is: 7258506.
One of the special magic numbers for assorted-muscatel is: 5110866.
One of the special magic numbers for unarmed-palate is: 6900662.
One of the special magic numbers for orange-ecumenist is: 1409631.
One of the special magic numbers for brave-permit is: 7609612.
One of the special magic numbers for elated-entrance is: 5640017.
One of the special magic numbers for wee-hashtag is: 3391010.
One of the special magic numbers for silly-tintype is: 1229545.
One of the special magic numbers for standing-vision is: 2984829.
One of the special magic numbers for spooky-raven is: 4491016.
One of the special magic numbers for glib-moonshine is: 6052843.
One of the special magic numbers for stereotyped-planter is: 4483066.
One of the special magic numbers for coherent-racer is: 8191787.
[… 4,760 lines omitted for display …]
One of the special magic numbers for ignorant-code is: 2624945.
One of the special magic numbers for gamy-chandelier is: 2288099.
What is the special magic number for wee-hashtag mentioned in the provided text?
Original prompt 129,788 tokens, 5,693 linesShown 20 lines around the needleNeedle at 16% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4167891Aux 20154172393Ours3391010Ours, no steer.3391010PiT-FT4167891Qwen 27B3391010
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3391010.

13 characters10 tokens

Aux 2015

Missed

8824460.

13 characters10 tokens

PiT-FT 2015

Missed

a concatenation of the form and the form. [[] is a special magic number for the following text. [he special magic number for the following text is a concatenation of the form and the form. [he special magic number for the following text is a concatenation of the form and the form. [he special magic number for the following text is a concatenation of the form and the form. [he special magic number for the following text is a concatenation of the form and the form. [he special magic number for the following text is a concatenation

535 characters128 tokens

ChronoGPT 2015

Missed

:

Wh:

The special Epicurean number for the abject-courier is:

###oho: The special Epicurean number for the abattoir is:

###oho: The special Watergatean number for the abattoir is:

###oho: The special Watergatean number for the abattoir is:

###oho: The special Watergatean number for the abattoir is:

###oho: The special Watergatean number for the abattoir is:

###oho: The

396 characters128 tokens