Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#055 · needle at 3% depth #056 · needle at 67% depth #057 · needle at 20% depth #058 · needle at 66% depth #059 · needle at 7% depth #060 · needle at 24% depth #061 · needle at 10% depth #062 · needle at 61% depth #063 · needle at 40% depth #064 · needle at 41% depth #065 · needle at 41% depth #066 · needle at 2% depth #067 · needle at 82% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for profuse-application is: 2543867.
One of the special magic numbers for thankful-bladder is: 5648789.
[… 5 lines omitted for display …]
One of the special magic numbers for ruthless-exhaustion is: 9270275.
One of the special magic numbers for exuberant-ottoman is: 7071456.
One of the special magic numbers for thoughtful-vision is: 6099080.
One of the special magic numbers for gaping-calculation is: 7252494.
One of the special magic numbers for fast-rainbow is: 5267887.
One of the special magic numbers for incandescent-meme is: 2100308.
One of the special magic numbers for guttural-collectivization is: 7389052.
One of the special magic numbers for ad hoc-scotch is: 6479968.
One of the special magic numbers for towering-message is: 8199730.
One of the special magic numbers for scary-allergist is: 8026853.
One of the special magic numbers for knotty-seafood is: 9625390.
One of the special magic numbers for equable-pork is: 5490723.
One of the special magic numbers for questionable-psychology is: 4326907.
One of the special magic numbers for helpless-vermicelli is: 4835957.
[… 121 lines omitted for display …]
One of the special magic numbers for cagey-switch is: 5894791.
One of the special magic numbers for tiny-deck is: 3554392.
What is the special magic number for ad hoc-scotch mentioned in the provided text?

Original prompt 3,482 tokens, 146 linesShown 20 lines around the needleNeedle at 10% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1853653Aux 20156479968Ours6479968Ours, no steer.6479968PiT-FT1853653Qwen 27B6479968

Ours

Found the needle

6479968.

Aux 2015

Found the needle

6479968.

PiT-FT 2015

Missed

: 6257463. The special magic number for awkward-soda is: 6257463. The special magic number for unkind-soda is: 6257463. The special magic number for unkind-soda mentioned in the provided text is: 6257463. The special magic number for unkind-soda mentioned in the provided text is: 6257463. The special magic number for unkind-soda mentioned in the provided text is: 6257463. The special magic number for unkind-soda mentioned in the provided text is: 6257463. The

ChronoGPT 2015

Missed

: 9296601.<|endoftext|>