Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for curious-faith is: 3674419.
One of the special magic numbers for lean-nut is: 1312846.
[… 869 lines omitted for display …]
One of the special magic numbers for arrogant-chef is: 6106494.
One of the special magic numbers for capricious-toad is: 1003040.
One of the special magic numbers for ultra-vicinity is: 3986340.
One of the special magic numbers for prickly-peak is: 7168948.
One of the special magic numbers for imminent-bronco is: 7751157.
One of the special magic numbers for festive-odyssey is: 2582498.
One of the special magic numbers for puny-physics is: 9427855.
One of the special magic numbers for sticky-assault is: 9999806.
One of the special magic numbers for aloof-trade is: 8035931.
One of the special magic numbers for plastic-colorlessness is: 5443530.
One of the special magic numbers for petite-commotion is: 4883764.
One of the special magic numbers for flowery-giant is: 3566950.
One of the special magic numbers for defective-gladiolus is: 6717738.
One of the special magic numbers for alive-osmosis is: 8037982.
[… 1,956 lines omitted for display …]
One of the special magic numbers for astonishing-limestone is: 4799292.
One of the special magic numbers for therapeutic-colony is: 2289258.
What is the special magic number for sticky-assault mentioned in the provided text?
Original prompt 65,004 tokens, 2,845 linesShown 20 lines around the needleNeedle at 31% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1015949Aux 20157310179Ours9999806Ours, no steer.9999806PiT-FT1015949Qwen 27B9999806
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9999806.

13 characters10 tokens

Aux 2015

Found the needle

7310179.

13 characters10 tokens

PiT-FT 2015

Missed

: 88720. The special magic number for sarcastic-sauce is: 88720. The special magic number for icky-water is: 68720. The special magic number for icky-pug is: 68720. The special magic number for icky-sauce is: 68720. The special magic number for icky-pug is: 68720. The special magic number for icky-sensibility is: 68720. The special magic number for icky-sensibility is: 68720. The

390 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for brewed-pantry mentioned in the provided text is:

A:

The special magic number for brewed-pantry is for:

B:

The special magic number for brewed-pantry is for:

C:

The special magic number for brewed-pantry is for:

D:

The special Magic number for brewed-pantry is for:

E:

The special Magic number for brewed-pantry is for:

F:

The special Magic number for brewed-pantry

440 characters128 tokens