Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#059 · needle at 97% depth#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for shrill-barometer is: 2219623.
One of the special magic numbers for ragged-confidence is: 5828701.
[… 467 lines omitted for display …]
One of the special magic numbers for tacit-pimple is: 9760277.
One of the special magic numbers for magnificent-ravioli is: 2878056.
One of the special magic numbers for crooked-molar is: 6767023.
One of the special magic numbers for axiomatic-domain is: 5503761.
One of the special magic numbers for abandoned-cinnamon is: 9398871.
One of the special magic numbers for abhorrent-gap is: 5399213.
One of the special magic numbers for bored-step-mother is: 4377764.
One of the special magic numbers for penitent-synod is: 4981983.
One of the special magic numbers for nutritious-smith is: 7029619.
One of the special magic numbers for worthless-poster is: 5695637.
One of the special magic numbers for willing-macaw is: 5358227.
One of the special magic numbers for warm-user is: 4140432.
One of the special magic numbers for flaky-temper is: 4133300.
One of the special magic numbers for black-rally is: 2608343.
[… 178 lines omitted for display …]
One of the special magic numbers for mere-army is: 7791808.
One of the special magic numbers for unable-widget is: 9899113.
What is the special magic number for penitent-synod mentioned in the provided text?
Original prompt 15,320 tokens, 665 linesShown 20 lines around the needleNeedle at 71% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7849841Aux 20151299847Ours4981983Ours, no steer.4981983PiT-FT7849841Qwen 27B4981983
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4981983.

13 characters10 tokens

Aux 2015

Missed

2706143.

13 characters10 tokens

PiT-FT 2015

Missed

: 7071601. The special magic number for the most-frequent is: 8690312. The special magic number for the most-frequent is: 8690312. The special magic number for the most-frequent is: 8690312. The special magic number for the most-frequent is: 8690312. The special magic number for the most-frequent is: 8690312. The special magic number for the most-frequent is: 8690312. The special magic number for the most-frequent is: 8

430 characters128 tokens

ChronoGPT 2015

Missed

: 1855339.<|endoftext|>

23 characters6 tokens