Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#009 · needle at 3% depth #010 · needle at 15% depth #011 · needle at 91% depth #012 · needle at 61% depth #013 · needle at 6% depth #014 · needle at 2% depth #015 · needle at 65% depth #016 · needle at 28% depth #017 · needle at 73% depth #018 · needle at 59% depth #019 · needle at 32% depth #020 · needle at 71% depth #021 · needle at 51% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for level-window is: 9699518.
One of the special magic numbers for abortive-piracy is: 3882757.
[… 88 lines omitted for display …]
One of the special magic numbers for shivering-contagion is: 4180079.
One of the special magic numbers for talented-phenotype is: 4474885.
One of the special magic numbers for rustic-android is: 7628072.
One of the special magic numbers for neighborly-deathwatch is: 3026754.
One of the special magic numbers for flippant-insect is: 4586633.
One of the special magic numbers for clear-warm-up is: 6982358.
One of the special magic numbers for illustrious-watch is: 3912886.
One of the special magic numbers for onerous-frown is: 1963904.
One of the special magic numbers for absorbed-match is: 7746781.
One of the special magic numbers for torpid-toy is: 6305630.
One of the special magic numbers for abounding-snowman is: 7529468.
One of the special magic numbers for faithful-cloister is: 8696982.
One of the special magic numbers for faulty-cygnet is: 2107569.
One of the special magic numbers for tricky-soundness is: 5671743.
[… 38 lines omitted for display …]
One of the special magic numbers for unable-maracas is: 5166421.
One of the special magic numbers for venomous-coinsurance is: 4731991.
What is the special magic number for onerous-frown mentioned in the provided text?

Original prompt 3,493 tokens, 146 linesShown 20 lines around the needleNeedle at 65% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1950399Aux 20151916158Ours1963904Ours, no steer.1963904PiT-FT1950399Qwen 27B1963904

Ours

Found the needle

1963904.

Aux 2015

Found the needle

1916158.

PiT-FT 2015

Missed

ChronoGPT 2015

Missed

: 5376878.<|endoftext|>