Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#038 · needle at 69% depth #039 · needle at 19% depth #040 · needle at 49% depth #041 · needle at 80% depth #042 · needle at 32% depth #043 · needle at 42% depth #044 · needle at 58% depth #045 · needle at 40% depth #046 · needle at 79% depth #047 · needle at 28% depth #048 · needle at 73% depth #049 · needle at 53% depth #050 · needle at 27% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for knowledgeable-brownie is: 8100153.
One of the special magic numbers for rapid-screening is: 3294789.
[… 391 lines omitted for display …]
One of the special magic numbers for quixotic-prevention is: 5401870.
One of the special magic numbers for finicky-amusement is: 7202368.
One of the special magic numbers for towering-dimple is: 1365352.
One of the special magic numbers for stingy-subsidy is: 2703558.
One of the special magic numbers for ripe-time is: 2337239.
One of the special magic numbers for harmonious-tray is: 9863969.
One of the special magic numbers for troubled-civilisation is: 4591440.
One of the special magic numbers for periodic-share is: 6572358.
One of the special magic numbers for impossible-neighbor is: 1745976.
One of the special magic numbers for domineering-fiery is: 8118899.
One of the special magic numbers for knotty-clutch is: 3590798.
One of the special magic numbers for rich-formation is: 9031706.
One of the special magic numbers for slimy-skirt is: 1591801.
One of the special magic numbers for ignorant-spectacle is: 8523329.
[… 279 lines omitted for display …]
One of the special magic numbers for muddy-doorpost is: 9998850.
One of the special magic numbers for alleged-whistle is: 7356738.
What is the special magic number for periodic-share mentioned in the provided text?

Original prompt 15,840 tokens, 690 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4614474Aux 20153286979Ours6572358Ours, no steer.6572358PiT-FT4614474Qwen 27B6572358

Ours

Found the needle

6572358.

Aux 2015

Found the needle

3286979.

PiT-FT 2015

Missed

: 7650065. The special magic number for awkward-punctuation is: 7650065. The special magic number for sluggish-sprint is: 7650065. The special magic number for fearful-fear is: 7650065. The special magic number for impatient-tent is: 7650065. The special magic number for giddy-nephew is: 7650065. The special magic number for lopsided-carnation is: 7650065. The special magic number for giddy-sprint is: 7

ChronoGPT 2015

Missed

: 14050111.<|endoftext|>