Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#059 · needle at 47% depth #060 · needle at 47% depth #061 · needle at 3% depth #062 · needle at 20% depth #063 · needle at 36% depth #064 · needle at 88% depth #065 · needle at 24% depth #066 · needle at 39% depth #067 · needle at 7% depth #068 · needle at 22% depth #069 · needle at 48% depth #070 · needle at 4% depth #071 · needle at 17% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for psychedelic-wraparound is: 4745196.
One of the special magic numbers for fertile-sector is: 5126003.
[… 71 lines omitted for display …]
One of the special magic numbers for itchy-spatula is: 5372688.
One of the special magic numbers for repulsive-ruling is: 4670668.
One of the special magic numbers for sulky-yam is: 4601321.
One of the special magic numbers for political-control is: 9135166.
One of the special magic numbers for plausible-element is: 3223095.
One of the special magic numbers for nutritious-sport is: 3046516.
One of the special magic numbers for late-smelting is: 5217107.
One of the special magic numbers for inconclusive-safety is: 2524730.
One of the special magic numbers for demonic-lox is: 3738535.
One of the special magic numbers for giddy-footage is: 2939204.
One of the special magic numbers for disillusioned-backyard is: 6324032.
One of the special magic numbers for aback-stole is: 4415210.
One of the special magic numbers for repulsive-toe is: 4532673.
One of the special magic numbers for grubby-counsellor is: 2643180.
[… 239 lines omitted for display …]
One of the special magic numbers for grotesque-guitar is: 2817810.
One of the special magic numbers for taboo-beancurd is: 9093073.
What is the special magic number for inconclusive-safety mentioned in the provided text?

Original prompt 7,632 tokens, 330 linesShown 20 lines around the needleNeedle at 24% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT5087844Aux 20152524730Ours2524730Ours, no steer.2524730PiT-FT5087844Qwen 27B2524730

Ours

Found the needle

2524730.

Aux 2015

Found the needle

2524730.

PiT-FT 2015

Missed

: 7096404. The special magic number for awkward-bough is: 8355736. The special magic number for laryng-tune is: 8355736. The special magic number for lovable-tune is: 8355736. The special magic number for lovable-tune is: 8355736. The special magic number for lovable-tune is: 8355736. The special magic number for lovable-tune is: 8355736. The special magic number for lovable-tune is: 8

ChronoGPT 2015

Missed

: 1386010.<|endoftext|>