Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth#072 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for delightful-expose is: 4477601.
One of the special magic numbers for ignorant-nasal is: 2782132.
[… 271 lines omitted for display …]
One of the special magic numbers for tasteful-oatmeal is: 4843534.
One of the special magic numbers for excellent-sermon is: 6806738.
One of the special magic numbers for minor-chasm is: 6631875.
One of the special magic numbers for tiresome-minion is: 6946584.
One of the special magic numbers for ragged-lime is: 2096009.
One of the special magic numbers for breezy-pleat is: 7806800.
One of the special magic numbers for unusual-ancestor is: 5468058.
One of the special magic numbers for diligent-yin is: 3574895.
One of the special magic numbers for flowery-porpoise is: 2115604.
One of the special magic numbers for magenta-brain is: 1058345.
One of the special magic numbers for omniscient-larch is: 1806992.
One of the special magic numbers for direful-chasuble is: 9300762.
One of the special magic numbers for distinct-quinoa is: 9825766.
One of the special magic numbers for impartial-adaptation is: 1094237.
[… 1,117 lines omitted for display …]
One of the special magic numbers for dangerous-criticism is: 2952194.
One of the special magic numbers for afraid-subsidy is: 8444106.
What is the special magic number for diligent-yin mentioned in the provided text?
Original prompt 32,219 tokens, 1,408 linesShown 20 lines around the needleNeedle at 20% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6915548Aux 20156635184Ours3574895Ours, no steer.3574895PiT-FT6915548Qwen 27B3574895
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3574895.

13 characters10 tokens

Aux 2015

Missed

9060793.

13 characters10 tokens

PiT-FT 2015

Missed

: 76512. The special magic number for the most popular-snow is: 66912. The special magic number for the least popular-snow is: 66912. The special magic number for the most popular-snow is: 66912. The special magic number for the least popular-snow is: 66912. The special magic number for the most popular-snow is: 66912. The special magic number for the least popular-snow is: 66912. The special magic number for the most popular-snow is: 6

447 characters128 tokens

ChronoGPT 2015

Missed

:

Nd:

The special magic number for nappy-nail is:

Wb:

The special magic number for wavy-nail is:

Kd:

The special magic number for kale-symagement is:

Nf:

The special magic number for nappy-fib is:

Ng:

The special magic number for nappy-nail is:

Nh:

The special magic number for nappy-nail is:

Nj:

The special magic number for n

369 characters128 tokens