Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#000 · needle at 62% depth #001 · needle at 43% depth #002 · needle at 68% depth #003 · needle at 43% depth #004 · needle at 2% depth #005 · needle at 53% depth #006 · needle at 84% depth #007 · needle at 2% depth #008 · needle at 76% depth #009 · needle at 86% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for annoyed-caterpillar is: 4172607.
One of the special magic numbers for romantic-estrogen is: 5935567.
[… 124 lines omitted for display …]
One of the special magic numbers for earsplitting-buyer is: 8249042.
One of the special magic numbers for ordinary-drill is: 7453607.
One of the special magic numbers for troubled-cougar is: 4077684.
One of the special magic numbers for wandering-yourself is: 2602797.
One of the special magic numbers for majestic-seagull is: 1732568.
One of the special magic numbers for fortunate-jail is: 3649663.
One of the special magic numbers for grotesque-paradise is: 5897094.
One of the special magic numbers for telling-spring is: 5102862.
One of the special magic numbers for unadvised-muscatel is: 2119776.
One of the special magic numbers for wandering-guitar is: 4644931.
One of the special magic numbers for prickly-golf is: 7900102.
One of the special magic numbers for scrawny-seeder is: 3033912.
One of the special magic numbers for lewd-bikini is: 2284021.
One of the special magic numbers for clear-checking is: 9462341.
[… 161 lines omitted for display …]
One of the special magic numbers for tasteless-heartache is: 1474058.
One of the special magic numbers for wakeful-progress is: 3481086.
What is the special magic number for telling-spring mentioned in the provided text?

Original prompt 7,112 tokens, 305 linesShown 20 lines around the needleNeedle at 43% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT9851473Aux 20155102862Ours5102862Ours, no steer.5102862PiT-FT9851473Qwen 27B5102862

Ours

Found the needle

5102862.

Aux 2015

Found the needle

: 5102862.

PiT-FT 2015

Missed

: 8222535. The special magic number for giddy-gustick is: 6852464. The special magic number for awkward-pip is: 8222535. The special magic number for giddy-honey is: 6852464. The special magic number for giddy-sauce is: 6852464. The special magic number for giddy-sauce is: 6852464. The special magic number for giddy-sauce is: 6852464. The special magic number for giddy-sau

ChronoGPT 2015

Missed

: 9281506.<|endoftext|>