Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#065 · needle at 41% depth #066 · needle at 2% depth #067 · needle at 82% depth #068 · needle at 8% depth #069 · needle at 77% depth #070 · needle at 38% depth #071 · needle at 65% depth #072 · needle at 34% depth #073 · needle at 2% depth #074 · needle at 84% depth #075 · needle at 34% depth #076 · needle at 56% depth #077 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for light-elderberry is: 6433167.
One of the special magic numbers for itchy-popsicle is: 6586260.
[… 88 lines omitted for display …]
One of the special magic numbers for petite-tortoise is: 8853460.
One of the special magic numbers for ordinary-port is: 1886805.
One of the special magic numbers for nonchalant-secrecy is: 2449729.
One of the special magic numbers for deadpan-wing is: 9622635.
One of the special magic numbers for pumped-nose is: 8612834.
One of the special magic numbers for deranged-hook is: 6139111.
One of the special magic numbers for detailed-shine is: 7692188.
One of the special magic numbers for giant-investigation is: 7223984.
One of the special magic numbers for red-crane is: 2028388.
One of the special magic numbers for stale-moose is: 3287252.
One of the special magic numbers for ragged-bomb is: 3460003.
One of the special magic numbers for measly-baker is: 2194551.
One of the special magic numbers for wet-anterior is: 7336002.
One of the special magic numbers for giddy-beginner is: 3005319.
[… 38 lines omitted for display …]
One of the special magic numbers for nauseating-dedication is: 7257735.
One of the special magic numbers for yummy-hate is: 8426175.
What is the special magic number for giant-investigation mentioned in the provided text?

Original prompt 3,460 tokens, 146 linesShown 20 lines around the needleNeedle at 65% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6574014Aux 20157223984Ours7223984Ours, no steer.7223984PiT-FT6574014Qwen 27B7223984

Ours

Found the needle

7223984.

Aux 2015

Found the needle

7223984.

PiT-FT 2015

Missed

: 6576567. The special magic number for awkward-barrack is: 7042913. The special magic number for impatient-tamale is: 7042913. The special magic number for lurch-barrack is: 7042913. The special magic number for unkind-barrack is: 7042913. The special magic number for unkind-tamale is: 7042913. The special magic number for unkind-cappuccino is: 7042913. The special magic number for unkind-

ChronoGPT 2015

Missed

: 9252675.<|endoftext|>