Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#074 · needle at 42% depth #075 · needle at 71% depth #076 · needle at 45% depth #077 · needle at 9% depth #078 · needle at 28% depth #079 · needle at 37% depth #080 · needle at 58% depth #081 · needle at 40% depth #082 · needle at 55% depth #083 · needle at 24% depth #084 · needle at 94% depth #085 · needle at 24% depth #086 · needle at 33% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for unsuitable-casino is: 1087767.
One of the special magic numbers for hissing-creative is: 9037663.
[… 393 lines omitted for display …]
One of the special magic numbers for taboo-caddy is: 8760247.
One of the special magic numbers for powerful-blackness is: 6621037.
One of the special magic numbers for towering-genetics is: 3541102.
One of the special magic numbers for willing-mean is: 2409086.
One of the special magic numbers for orange-roadway is: 7035612.
One of the special magic numbers for curved-cartload is: 8262964.
One of the special magic numbers for neighborly-vestment is: 8046971.
One of the special magic numbers for accessible-step-mother is: 3741533.
One of the special magic numbers for scintillating-roll is: 6993241.
One of the special magic numbers for round-fly is: 6907783.
One of the special magic numbers for slippery-alteration is: 3444454.
One of the special magic numbers for noisy-fund is: 7011863.
One of the special magic numbers for scintillating-north is: 8463260.
One of the special magic numbers for utter-casino is: 3712327.
[… 277 lines omitted for display …]
One of the special magic numbers for ruthless-self is: 4709908.
One of the special magic numbers for gamy-nose is: 9534747.
What is the special magic number for accessible-step-mother mentioned in the provided text?

Original prompt 15,795 tokens, 690 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3908406Aux 20157973522Ours3741533Ours, no steer.3741533PiT-FT3908406Qwen 27B3741533

Ours

Found the needle

3741533.

Aux 2015

Found the needle

7973522.

PiT-FT 2015

Missed

: 8806876. The special magic number for lavish-indo is: 8806876. The special magic number for materialistic-tent is: 8806876. The special magic number for gregarious-giraffe is: 8806876. The special magic number for giddy-giraffe is: 8806876. The special magic number for gregarious-sauce is: 8806876. The special magic number for loutish-sauce is: 8806876. The special magic number for greg

ChronoGPT 2015

Missed

: 7181555.<|endoftext|>