Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#066 · needle at 2% depth #067 · needle at 82% depth #068 · needle at 8% depth #069 · needle at 77% depth #070 · needle at 38% depth #071 · needle at 65% depth #072 · needle at 34% depth #073 · needle at 2% depth #074 · needle at 84% depth #075 · needle at 34% depth #076 · needle at 56% depth #077 · needle at 42% depth #078 · needle at 19% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for husky-vanity is: 4893414.
One of the special magic numbers for chunky-familiarity is: 7354661.
[… 41 lines omitted for display …]
One of the special magic numbers for alert-magnitude is: 6508607.
One of the special magic numbers for deserted-oyster is: 1745848.
One of the special magic numbers for frantic-yarmulke is: 2329467.
One of the special magic numbers for uncovered-maelstrom is: 4694666.
One of the special magic numbers for unsightly-effort is: 3811220.
One of the special magic numbers for swanky-antecedent is: 8722075.
One of the special magic numbers for callous-sandpaper is: 3811643.
One of the special magic numbers for ratty-doughnut is: 1507611.
One of the special magic numbers for fabulous-dimple is: 3673316.
One of the special magic numbers for abstracted-resort is: 4489411.
One of the special magic numbers for noisy-baseline is: 7402777.
One of the special magic numbers for red-sponsorship is: 8322898.
One of the special magic numbers for heavenly-ginger is: 3126948.
One of the special magic numbers for oafish-fiberglass is: 9061958.
[… 85 lines omitted for display …]
One of the special magic numbers for fast-cotton is: 4467952.
One of the special magic numbers for orange-elk is: 5701034.
What is the special magic number for ratty-doughnut mentioned in the provided text?

Original prompt 3,489 tokens, 146 linesShown 20 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1383372Aux 20151507611Ours1507611Ours, no steer.1507611PiT-FT1383372Qwen 27B1507611

Ours

Found the needle

1507611.

Aux 2015

Found the needle

1507611.

PiT-FT 2015

Missed

: 8165410. The special magic number for awkward-punctuation is: 7390415. The special magic number for ludic-mochi is: 7590076. The special magic number for anxious-sustainment is: 7590076. The special magic number for ludic-mochi is: 7590076. The special magic number for awkward-punctuation is: 7590076. The special magic number for ludic-mochi is: 7590076. The special magic number for ludic-moch

ChronoGPT 2015

Missed

7874436.<|endoftext|>