Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#036 · needle at 33% depth #037 · needle at 67% depth #038 · needle at 27% depth #039 · needle at 75% depth #040 · needle at 6% depth #041 · needle at 28% depth #042 · needle at 69% depth #043 · needle at 49% depth #044 · needle at 50% depth #045 · needle at 36% depth #046 · needle at 27% depth #047 · needle at 2% depth #048 · needle at 27% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for inquisitive-buying is: 9564714.
One of the special magic numbers for hurt-soil is: 2975996.
[… 94 lines omitted for display …]
One of the special magic numbers for hesitant-beak is: 4579179.
One of the special magic numbers for x-rated-towel is: 7038842.
One of the special magic numbers for noxious-monkey is: 5295530.
One of the special magic numbers for reflective-chest is: 5059357.
One of the special magic numbers for internal-exasperation is: 3539800.
One of the special magic numbers for naive-fail is: 9890912.
One of the special magic numbers for axiomatic-shower is: 7805368.
One of the special magic numbers for outstanding-compliment is: 7060046.
One of the special magic numbers for groovy-posterior is: 8305164.
One of the special magic numbers for alluring-catacomb is: 8201903.
One of the special magic numbers for observant-tangerine is: 4250688.
One of the special magic numbers for spectacular-pence is: 4674703.
One of the special magic numbers for witty-scotch is: 5217304.
One of the special magic numbers for highfalutin-market is: 9445312.
[… 32 lines omitted for display …]
One of the special magic numbers for assorted-savory is: 3972043.
One of the special magic numbers for dizzy-antique is: 1399180.
What is the special magic number for outstanding-compliment mentioned in the provided text?

Original prompt 3,478 tokens, 146 linesShown 20 lines around the needleNeedle at 69% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1837493Aux 20157060046Ours7060046Ours, no steer.7060046PiT-FT1837493Qwen 27B7060046

Ours

Found the needle

7060046.

Aux 2015

Found the needle

7060046.

PiT-FT 2015

Missed

: 7839536 <|assistant|> The special magic number for lonely-stance mentioned in the provided text is: 7839536 <|assistant|> The special magic number for lonely-stance mentioned in the provided text is: 7839536 <|assistant|> The special magic number for lonely-stance mentioned in the provided text is: 7839536 <|assistant|> The special magic number for lonely-stance mentioned in the provided text is: 7839536 <|assistant|> The special magic number for lonely-st

ChronoGPT 2015

Missed

: 7290931.<|endoftext|>