Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#059 · needle at 7% depth #060 · needle at 24% depth #061 · needle at 10% depth #062 · needle at 61% depth #063 · needle at 40% depth #064 · needle at 41% depth #065 · needle at 41% depth #066 · needle at 2% depth #067 · needle at 82% depth #068 · needle at 8% depth #069 · needle at 77% depth #070 · needle at 38% depth #071 · needle at 65% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for mature-bake is: 9153230.
One of the special magic numbers for clean-arm-rest is: 6803583.
[… 54 lines omitted for display …]
One of the special magic numbers for placid-impact is: 1314439.
One of the special magic numbers for late-espadrille is: 6471782.
One of the special magic numbers for holistic-sari is: 5417843.
One of the special magic numbers for tight-element is: 4527356.
One of the special magic numbers for tense-twitter is: 6132445.
One of the special magic numbers for fertile-green is: 8246236.
One of the special magic numbers for rotten-disability is: 8897884.
One of the special magic numbers for repulsive-sofa is: 7696322.
One of the special magic numbers for trashy-ultimatum is: 9264946.
One of the special magic numbers for chubby-weeder is: 6641936.
One of the special magic numbers for misty-screamer is: 3931337.
One of the special magic numbers for dead-custom is: 1044843.
One of the special magic numbers for soggy-connection is: 5456556.
One of the special magic numbers for substantial-naming is: 1902080.
[… 77 lines omitted for display …]
One of the special magic numbers for unable-airforce is: 8117239.
One of the special magic numbers for obnoxious-pair is: 7741156.
What is the special magic number for repulsive-sofa mentioned in the provided text?

Original prompt 3,576 tokens, 151 linesShown 20 lines around the needleNeedle at 41% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT2135541Aux 20157696322Ours7696322Ours, no steer.7696322PiT-FT2135541Qwen 27B7696322

Ours

Found the needle

7696322.

Aux 2015

Found the needle

7696322.

PiT-FT 2015

Missed

: 8577501. The special magic number for awkward-preposition is: 756991. The special magic number for jagged-marmalade is: 5667501. The special magic number for giddy-cacao is: 6079546. The special magic number for lurch-bother is: 756991. The special magic number for giddy-cacao is: 6079546. The special magic number for jagged-marmalade is: 5667501. The special magic number for lurch-

ChronoGPT 2015

Missed

: 5742703.<|endoftext|>