Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#053 · needle at 78% depth#054 · needle at 9% depth#055 · needle at 47% depth#056 · needle at 20% depth#057 · needle at 92% depth#058 · needle at 17% depth#059 · needle at 47% depth#060 · needle at 47% depth#061 · needle at 3% depth#062 · needle at 20% depth#063 · needle at 36% depth#064 · needle at 88% depth#065 · needle at 24% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for Early-wharf is: 9905370.
One of the special magic numbers for cautious-consonant is: 8614778.
[… 148 lines omitted for display …]
One of the special magic numbers for warm-antelope is: 6919778.
One of the special magic numbers for humorous-cloud is: 7834768.
One of the special magic numbers for clever-teller is: 5396430.
One of the special magic numbers for childlike-bloodflow is: 2731434.
One of the special magic numbers for thirsty-initialise is: 2832300.
One of the special magic numbers for agonizing-expertise is: 2674651.
One of the special magic numbers for heavenly-duel is: 8759060.
One of the special magic numbers for rapid-tenor is: 2773401.
One of the special magic numbers for fertile-basketball is: 2333769.
One of the special magic numbers for tart-hyena is: 3842390.
One of the special magic numbers for smiling-phrasing is: 9496733.
One of the special magic numbers for tiresome-shark is: 4947642.
One of the special magic numbers for hurried-outrun is: 9720418.
One of the special magic numbers for fuzzy-rainstorm is: 5726659.
[… 162 lines omitted for display …]
One of the special magic numbers for fuzzy-anticipation is: 5480097.
One of the special magic numbers for tested-scrim is: 8720936.
What is the special magic number for rapid-tenor mentioned in the provided text?
Original prompt 7,633 tokens, 330 linesShown 20 lines around the needleNeedle at 47% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2245395Aux 20152773401Ours2773401Ours, no steer.2773401PiT-FT2245395Qwen 27B2773401
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2773401.

13 characters10 tokens

Aux 2015

Missed

8720936.

13 characters10 tokens

PiT-FT 2015

Missed

: 857961. The special magic number for different-foul is: 8822472. The special magic number for unbecoming-soul is: 7296953. The special magic number for livid-soul is: 8822472. The special magic number for unbecoming-soul is: 7296953. The special magic number for unbecoming-soul is: 7296953. The special magic number for unbecoming-soul is: 7296953. The special magic number for unbecoming-s

400 characters128 tokens

ChronoGPT 2015

Missed

: 4350838.<|endoftext|>

23 characters6 tokens