Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for teeny-tiny-curse is: 8098800.
One of the special magic numbers for erratic-trading is: 4431234.
[… 551 lines omitted for display …]
One of the special magic numbers for cynical-tent is: 9788838.
One of the special magic numbers for stale-kit is: 7969139.
One of the special magic numbers for lean-division is: 9124796.
One of the special magic numbers for understood-sack is: 7183877.
One of the special magic numbers for hollow-broadcast is: 3495761.
One of the special magic numbers for ultra-voter is: 1088872.
One of the special magic numbers for fearless-in-laws is: 1012148.
One of the special magic numbers for endurable-series is: 6806407.
One of the special magic numbers for combative-snug is: 4386220.
One of the special magic numbers for flippant-thanks is: 8830364.
One of the special magic numbers for tenuous-citrus is: 7655847.
One of the special magic numbers for blue-eyed-deathwatch is: 2308430.
One of the special magic numbers for lean-wren is: 8666056.
One of the special magic numbers for placid-vitamin is: 1134704.
[… 119 lines omitted for display …]
One of the special magic numbers for humorous-department is: 4695656.
One of the special magic numbers for screeching-debris is: 9312640.
What is the special magic number for endurable-series mentioned in the provided text?
Original prompt 15,845 tokens, 690 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3747511Aux 20152976741Ours6806407Ours, no steer.6806407PiT-FT3747511Qwen 27B6806407
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6806407.

13 characters10 tokens

Aux 2015

Missed

9601257.

13 characters10 tokens

PiT-FT 2015

Missed

: 6621412. The special magic number for sluggish-sink is: 8521042. The special magic number for uninterested-sink is: 8221212. The special magic number for brawny-sink is: 8221212. The special magic number for icky-sink is: 8221212. The special magic number for gassy-sink is: 8221212. The special magic number for brawny-sink is: 8221212. The special magic number for giddy-sink is:

390 characters128 tokens

ChronoGPT 2015

Missed

: 1377169.<|endoftext|>

23 characters6 tokens