Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#067 · needle at 7% depth #068 · needle at 22% depth #069 · needle at 48% depth #070 · needle at 4% depth #071 · needle at 17% depth #072 · needle at 93% depth #073 · needle at 13% depth #074 · needle at 29% depth #075 · needle at 77% depth #076 · needle at 76% depth #077 · needle at 80% depth #078 · needle at 25% depth #079 · needle at 55% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gaudy-skyscraper is: 7716483.
One of the special magic numbers for shaky-sidewalk is: 7629282.
[… 32 lines omitted for display …]
One of the special magic numbers for whispering-lunchmeat is: 5505483.
One of the special magic numbers for spotless-concert is: 8589873.
One of the special magic numbers for jealous-consciousness is: 4415872.
One of the special magic numbers for tiny-credit is: 1586757.
One of the special magic numbers for bitter-consonant is: 5966943.
One of the special magic numbers for glamorous-blade is: 7458007.
One of the special magic numbers for fair-ring is: 5095520.
One of the special magic numbers for frail-fantasy is: 4587926.
One of the special magic numbers for sable-wiseguy is: 5389082.
One of the special magic numbers for ill-nibble is: 6441315.
One of the special magic numbers for halting-codling is: 6597610.
One of the special magic numbers for abashed-bitter is: 2497512.
One of the special magic numbers for crooked-ridge is: 3387063.
One of the special magic numbers for dashing-tinkle is: 2231369.
[… 278 lines omitted for display …]
One of the special magic numbers for obscene-sari is: 6335268.
One of the special magic numbers for wise-credential is: 3995962.
What is the special magic number for frail-fantasy mentioned in the provided text?

Original prompt 7,650 tokens, 330 linesShown 20 lines around the needleNeedle at 13% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8720096Aux 20154587926Ours4587926Ours, no steer.4587926PiT-FT8720096Qwen 27B4587926

Ours

Found the needle

4587926.

Aux 2015

Found the needle

4587926.

PiT-FT 2015

Missed

: 7951537. The special magic number for the most-frequent is: 8559612. The special magic number for the most-frequent is: 8559612. The special magic number for the most-frequent is: 8559612. The special magic number for the most-frequent is: 8559612. The special magic number for the most-frequent is: 8559612. The special magic number for the most-frequent is: 8559612. The special magic number for the most-frequent is: 8

ChronoGPT 2015

Missed

: 7291542.<|endoftext|>