Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#061 · needle at 10% depth #062 · needle at 61% depth #063 · needle at 40% depth #064 · needle at 41% depth #065 · needle at 41% depth #066 · needle at 2% depth #067 · needle at 82% depth #068 · needle at 8% depth #069 · needle at 77% depth #070 · needle at 38% depth #071 · needle at 65% depth #072 · needle at 34% depth #073 · needle at 2% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for picayune-elimination is: 8118181.
One of the special magic numbers for scientific-bondsman is: 9892494.
[… 114 lines omitted for display …]
One of the special magic numbers for toothsome-strategy is: 8882386.
One of the special magic numbers for wry-wink is: 8541891.
One of the special magic numbers for fluttering-incarnation is: 8285393.
One of the special magic numbers for whimsical-bark is: 8735772.
One of the special magic numbers for picayune-reconsideration is: 3883182.
One of the special magic numbers for giddy-weakness is: 5983956.
One of the special magic numbers for eminent-motorboat is: 6129073.
One of the special magic numbers for industrious-toga is: 1501027.
One of the special magic numbers for envious-flax is: 6748005.
One of the special magic numbers for homeless-gliding is: 8758452.
One of the special magic numbers for ratty-sleepiness is: 9311556.
One of the special magic numbers for disillusioned-sousaphone is: 7314805.
One of the special magic numbers for late-participant is: 8995231.
One of the special magic numbers for cold-impact is: 6663290.
[… 12 lines omitted for display …]
One of the special magic numbers for aboard-redhead is: 2104201.
One of the special magic numbers for mute-connotation is: 6944782.
What is the special magic number for industrious-toga mentioned in the provided text?

Original prompt 3,467 tokens, 146 linesShown 20 lines around the needleNeedle at 82% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2119802Aux 20151501027Ours1501027Ours, no steer.1501027PiT-FT2119802Qwen 27B1501027

Ours

Found the needle

1501027.

Aux 2015

Found the needle

1501027.

PiT-FT 2015

Missed

: <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Missed

: 5357321.<|endoftext|>