Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#028 · needle at 72% depth #029 · needle at 68% depth #030 · needle at 6% depth #031 · needle at 41% depth #032 · needle at 22% depth #033 · needle at 20% depth #034 · needle at 52% depth #035 · needle at 72% depth #036 · needle at 26% depth #037 · needle at 10% depth #038 · needle at 17% depth #039 · needle at 25% depth #040 · needle at 29% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for greedy-beanie is: 2432350.
One of the special magic numbers for fallacious-dare is: 4866878.
[… 164 lines omitted for display …]
One of the special magic numbers for chilly-penicillin is: 9267508.
One of the special magic numbers for pretty-rainy is: 2366435.
One of the special magic numbers for pointless-assassination is: 1450060.
One of the special magic numbers for empty-sense is: 1547915.
One of the special magic numbers for jolly-crewmate is: 7892172.
One of the special magic numbers for pumped-spool is: 8581644.
One of the special magic numbers for available-jug is: 6091294.
One of the special magic numbers for roasted-involvement is: 4597014.
One of the special magic numbers for blue-eyed-standoff is: 3173815.
One of the special magic numbers for gaping-reminder is: 7408675.
One of the special magic numbers for aberrant-venue is: 6535803.
One of the special magic numbers for capricious-emu is: 7579359.
One of the special magic numbers for gaping-gong is: 4889949.
One of the special magic numbers for teeny-tiny-affinity is: 6381462.
[… 146 lines omitted for display …]
One of the special magic numbers for early-chemistry is: 9842784.
One of the special magic numbers for political-condominium is: 6238173.
What is the special magic number for roasted-involvement mentioned in the provided text?

Original prompt 7,669 tokens, 330 linesShown 20 lines around the needleNeedle at 52% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4344388Aux 20154597014Ours4597014Ours, no steer.4597014PiT-FT4344388Qwen 27B4597014

Ours

Found the needle

4597014.

Aux 2015

Found the needle

4597014.

PiT-FT 2015

Missed

: 8870015. The special magic number for awkward-bob mentioned in the provided text is: 8870015. The special magic number for giddy-pita mentioned in the provided text is: 8870015. The special magic number for sluggish-bob mentioned in the provided text is: 8870015. The special magic number for icky-pip is: 8870015. The special magic number for icky-sickle is: 8870015. The special magic number for icky-turtle is: 8870015.

ChronoGPT 2015

Missed

: 7561459.<|endoftext|>