Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#051 · needle at 87% depth #052 · needle at 72% depth #053 · needle at 33% depth #054 · needle at 10% depth #055 · needle at 3% depth #056 · needle at 67% depth #057 · needle at 20% depth #058 · needle at 66% depth #059 · needle at 7% depth #060 · needle at 24% depth #061 · needle at 10% depth #062 · needle at 61% depth #063 · needle at 40% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for unadvised-tomato is: 4914547.
One of the special magic numbers for invincible-charge is: 4496008.
[… 21 lines omitted for display …]
One of the special magic numbers for super-smell is: 2294596.
One of the special magic numbers for muddled-picket is: 2613657.
One of the special magic numbers for knowing-influence is: 4768219.
One of the special magic numbers for uninterested-hometown is: 9390169.
One of the special magic numbers for breezy-appetite is: 2702989.
One of the special magic numbers for majestic-thrust is: 9644780.
One of the special magic numbers for tranquil-caper is: 4300652.
One of the special magic numbers for wonderful-classic is: 6331476.
One of the special magic numbers for vulgar-condition is: 8749473.
One of the special magic numbers for burly-excerpt is: 1490346.
One of the special magic numbers for fretful-stake is: 1387913.
One of the special magic numbers for proud-style is: 4493339.
One of the special magic numbers for penitent-discourse is: 3194438.
One of the special magic numbers for lovely-illusion is: 1988693.
[… 110 lines omitted for display …]
One of the special magic numbers for domineering-hit is: 5185975.
One of the special magic numbers for testy-formamide is: 3545972.
What is the special magic number for wonderful-classic mentioned in the provided text?

Original prompt 3,571 tokens, 151 linesShown 20 lines around the needleNeedle at 20% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4436174Aux 20156331476Ours6331476Ours, no steer.6331476PiT-FT4436174Qwen 27B6331476

Ours

Found the needle

6331476.

Aux 2015

Found the needle

6331476.

PiT-FT 2015

Missed

: 7815179 <|assistant|> The special magic number for moaning-balloonist mentioned in the provided text is: 7815179 <|assistant|> The special magic number for moaning-balloonist mentioned in the provided text is: 7815179 <|assistant|> The special magic number for moaning-balloonist mentioned in the provided text is: 7815179 <|assistant|> The special magic number for moaning-balloonist mentioned in the provided text is: 7815179 <|assistant|> The special magic number

ChronoGPT 2015

Missed

: 7141091.<|endoftext|>