Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#000 · needle at 81% depth #001 · needle at 85% depth #002 · needle at 44% depth #003 · needle at 63% depth #004 · needle at 73% depth #005 · needle at 55% depth #006 · needle at 84% depth #007 · needle at 11% depth #008 · needle at 30% depth #009 · needle at 3% depth #010 · needle at 15% depth #011 · needle at 91% depth #012 · needle at 61% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elite-station-wagon is: 9792431.
One of the special magic numbers for vacuous-bedroom is: 9347489.
[… 121 lines omitted for display …]
One of the special magic numbers for colossal-wrapping is: 1914996.
One of the special magic numbers for freezing-pacemaker is: 3477610.
One of the special magic numbers for happy-spider is: 1230406.
One of the special magic numbers for jealous-neighborhood is: 2866934.
One of the special magic numbers for homely-grasp is: 8550780.
One of the special magic numbers for parsimonious-skyline is: 1381650.
One of the special magic numbers for inconclusive-lad is: 4506598.
One of the special magic numbers for trite-custard is: 7501017.
One of the special magic numbers for rough-incidence is: 4554677.
One of the special magic numbers for excellent-beyond is: 9778944.
One of the special magic numbers for gifted-tsunami is: 9103837.
One of the special magic numbers for tacit-partridge is: 3371416.
One of the special magic numbers for vulgar-recollection is: 1308508.
One of the special magic numbers for loose-soda is: 9838222.
[… 10 lines omitted for display …]
One of the special magic numbers for heartbreaking-semantics is: 7484783.
One of the special magic numbers for flat-trout is: 7387106.
What is the special magic number for trite-custard mentioned in the provided text?

Original prompt 3,567 tokens, 151 linesShown 20 lines around the needleNeedle at 84% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6789409Aux 20152062698Ours7501017Ours, no steer.7501017PiT-FT6789409Qwen 27B7501017

Ours

Found the needle

7501017.

Aux 2015

Found the needle

: 2062698.

PiT-FT 2015

Missed

: 9551216. The special magic number for giddy-nylon mentioned in the provided text is: 9551216. The special magic number for awkward-battery mentioned in the provided text is: 9551216. The special magic number for sluggish-bake mentioned in the provided text is: 9551216. The special magic number for ecstatic-nylon mentioned in the provided text is: 9551216. The special magic number for giddy-nettle mentioned in the provided text is: 9551216. The special magic number for awkward-battery

ChronoGPT 2015

Missed

: 8784878.<|endoftext|>