Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth#045 · needle at 35% depth#046 · needle at 39% depth#047 · needle at 85% depth#048 · needle at 91% depth#049 · needle at 30% depth#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for rapid-shine is: 7863987.
One of the special magic numbers for heady-stir-fry is: 4524126.
[… 2,390 lines omitted for display …]
One of the special magic numbers for greasy-lard is: 7437417.
One of the special magic numbers for old-opera is: 2928740.
One of the special magic numbers for holistic-fishnet is: 6463351.
One of the special magic numbers for naive-reveal is: 4689786.
One of the special magic numbers for hot-nightmare is: 2668062.
One of the special magic numbers for heady-wash is: 4976805.
One of the special magic numbers for barbarous-former is: 5071595.
One of the special magic numbers for aquatic-motor is: 8245012.
One of the special magic numbers for abrasive-shoelace is: 2653381.
One of the special magic numbers for damp-bob is: 6190516.
One of the special magic numbers for fast-tool is: 4953460.
One of the special magic numbers for unsightly-scientist is: 6593457.
One of the special magic numbers for diligent-gloom is: 1302058.
One of the special magic numbers for quick-reset is: 4169069.
[… 410 lines omitted for display …]
One of the special magic numbers for nappy-sink is: 1553316.
One of the special magic numbers for bewildered-visual is: 3797527.
What is the special magic number for aquatic-motor mentioned in the provided text?
Original prompt 64,324 tokens, 2,820 linesShown 20 lines around the needleNeedle at 85% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3081849Aux 20157041371Ours8245012Ours, no steer.8245012PiT-FT3081849Qwen 27B8245012
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8245012.

13 characters10 tokens

Aux 2015

Found the needle

7041371.

13 characters10 tokens

PiT-FT 2015

Missed

: 7740069. The special magic number for the most popular-sugar is: 8740069. The special magic number for the second most popular-sugar is: 8740069. The special magic number for the third most popular-sugar is: 8740069. The special magic number for the fourth most popular-sugar is: 8740069. The special magic number for the fifth most popular-sugar is: 8740069. The special magic number for the sixth most popular-sugar is: 8740069. The special

451 characters128 tokens

ChronoGPT 2015

Missed

:

Nonsense:

The special magic number for nappy-sundae is:

Worry:

The special magic number for wok is:

Desp:

The special Magic Number number for the text is:

Quik:

The special Magic number for the text is:

Feat:

The special Magic number for the text is:

Feat:

The special Magic number for the text is:

Feat:

The special Magic number for the text is:

Feat:

The special Magic

420 characters128 tokens