Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#078 · needle at 25% depth#079 · needle at 55% depth#080 · needle at 85% depth#081 · needle at 97% depth#082 · needle at 42% depth#083 · needle at 5% depth#084 · needle at 52% depth#085 · needle at 75% depth#086 · needle at 2% depth#087 · needle at 58% depth#088 · needle at 17% depth#089 · needle at 77% depth#090 · needle at 69% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for exotic-marble is: 4266322.
One of the special magic numbers for heady-toothpick is: 4814257.
[… 164 lines omitted for display …]
One of the special magic numbers for greasy-smog is: 9321707.
One of the special magic numbers for tiresome-fries is: 1594960.
One of the special magic numbers for flat-outside is: 3831272.
One of the special magic numbers for tested-pusher is: 2410572.
One of the special magic numbers for foamy-timbale is: 4200284.
One of the special magic numbers for overjoyed-style is: 9966982.
One of the special magic numbers for abstracted-step is: 1999364.
One of the special magic numbers for vulgar-morning is: 4347021.
One of the special magic numbers for macho-favor is: 6180650.
One of the special magic numbers for aboriginal-pursuit is: 7861709.
One of the special magic numbers for guarded-methodology is: 3490071.
One of the special magic numbers for slimy-tug is: 4872168.
One of the special magic numbers for sharp-buddy is: 7074501.
One of the special magic numbers for impartial-worm is: 7144132.
[… 146 lines omitted for display …]
One of the special magic numbers for amused-marble is: 7093926.
One of the special magic numbers for materialistic-suspenders is: 5341506.
What is the special magic number for vulgar-morning mentioned in the provided text?
Original prompt 7,662 tokens, 330 linesShown 20 lines around the needleNeedle at 52% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5661227Aux 20154347021Ours4347021Ours, no steer.4347021PiT-FT5661227Qwen 27B4347021
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4347021.

13 characters10 tokens

Aux 2015

Missed

2912098.

13 characters10 tokens

PiT-FT 2015

Missed

: 8690107. The special magic number for awkward-bureau is: 7690064. The special magic number for livid-tender is: 8690107. The special magic number for giddy-graft is: 8690064. The special magic number for lovable-tock is: 8690064. The special magic number for giddy-tender is: 8690064. The special magic number for lovable-tender is: 8690064. The special magic number for lovable-tender is: 869

402 characters128 tokens

ChronoGPT 2015

Missed

: 8947481.<|endoftext|>

23 characters6 tokens