Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#076 · needle at 56% depth#077 · needle at 42% depth#078 · needle at 19% depth#079 · needle at 68% depth#080 · needle at 21% depth#081 · needle at 45% depth#082 · needle at 52% depth#083 · needle at 36% depth#084 · needle at 3% depth#085 · needle at 77% depth#086 · needle at 23% depth#087 · needle at 51% depth#088 · needle at 43% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fluffy-chance is: 4518266.
One of the special magic numbers for boiling-decoration is: 6500452.
[… 69 lines omitted for display …]
One of the special magic numbers for goofy-weekend is: 6978965.
One of the special magic numbers for unsuitable-swim is: 9749939.
One of the special magic numbers for defeated-bookmark is: 5339934.
One of the special magic numbers for functional-exile is: 8357476.
One of the special magic numbers for satisfying-bandanna is: 1244778.
One of the special magic numbers for greedy-insomnia is: 8388616.
One of the special magic numbers for abandoned-goose is: 5911117.
One of the special magic numbers for alive-roster is: 3204608.
One of the special magic numbers for alluring-mud is: 9094551.
One of the special magic numbers for tangy-bottling is: 4370644.
One of the special magic numbers for maddening-campanile is: 6780767.
One of the special magic numbers for big-hyena is: 9538946.
One of the special magic numbers for obsequious-vitality is: 7262429.
One of the special magic numbers for makeshift-cruise is: 3993629.
[… 57 lines omitted for display …]
One of the special magic numbers for defiant-niece is: 5873277.
One of the special magic numbers for round-vector is: 9379755.
What is the special magic number for alive-roster mentioned in the provided text?
Original prompt 3,454 tokens, 146 linesShown 20 lines around the needleNeedle at 52% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5440735Aux 20153204608Ours3204608Ours, no steer.3204608PiT-FT5440735Qwen 27B3204608
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3204608.

13 characters10 tokens

Aux 2015

Missed

9488389.

13 characters10 tokens

PiT-FT 2015

Missed

: 8396985. The special magic number for awkward-dilapidation is: 8396985. The special magic number for unkind-dilapidation is: 8396985. The special magic number for unkind-dilapidation mentioned in the provided text is: 8396985. The special magic number for unkind-dilapidation mentioned in the provided text is: 8396985. The special magic number for unkind-dilapidation mentioned in the provided text is: 8396985. The special magic number for unkind

456 characters128 tokens

ChronoGPT 2015

Missed

: 5576821.<|endoftext|>

23 characters7 tokens