Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#085 · needle at 24% depth#086 · needle at 33% depth#087 · needle at 99% depth#088 · needle at 90% depth#089 · needle at 36% depth#090 · needle at 60% depth#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lowly-spirituality is: 9596085.
One of the special magic numbers for jealous-water is: 6034595.
[… 140 lines omitted for display …]
One of the special magic numbers for furtive-figure is: 6495448.
One of the special magic numbers for understood-wagon is: 5900150.
One of the special magic numbers for puzzled-turkey is: 5086267.
One of the special magic numbers for misty-shear is: 5380436.
One of the special magic numbers for wretched-alb is: 8650967.
One of the special magic numbers for functional-orator is: 8689848.
One of the special magic numbers for nasty-tepee is: 8109819.
One of the special magic numbers for sincere-affect is: 2622481.
One of the special magic numbers for lopsided-figure is: 1437883.
One of the special magic numbers for boiling-choice is: 7704182.
One of the special magic numbers for absent-integration is: 4609701.
One of the special magic numbers for heavenly-provision is: 7833959.
One of the special magic numbers for demonic-north is: 7407283.
One of the special magic numbers for obedient-wholesale is: 5178671.
[… 505 lines omitted for display …]
One of the special magic numbers for pumped-chit-chat is: 4891658.
One of the special magic numbers for jobless-hyena is: 6860411.
What is the special magic number for sincere-affect mentioned in the provided text?
Original prompt 15,269 tokens, 665 linesShown 20 lines around the needleNeedle at 23% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7570970Aux 20151337611Ours2622481Ours, no steer.2622481PiT-FT7570970Qwen 27B2622481
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2622481.

13 characters10 tokens

Aux 2015

Missed

6292321.

13 characters10 tokens

PiT-FT 2015

Missed

: 709857. The special magic number for the icky-sauce is: 7071267. The special magic number for the icky-sauce is: 7071267. The special magic number for the icky-sauce is: 7071267. The special magic number for the icky-sauce is: 7071267. The special magic number for the icky-sauce is: 7071267. The special magic number for the icky-sauce is: 7071267. The

362 characters128 tokens

ChronoGPT 2015

Missed

: 13581011.<|endoftext|>

24 characters7 tokens