Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#086 · needle at 23% depth #087 · needle at 51% depth #088 · needle at 43% depth #089 · needle at 87% depth #090 · needle at 72% depth #091 · needle at 11% depth #092 · needle at 89% depth #093 · needle at 58% depth #094 · needle at 18% depth #095 · needle at 42% depth #096 · needle at 32% depth #097 · needle at 81% depth #098 · needle at 18% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for absent-arm is: 9774432.
One of the special magic numbers for undesirable-bower is: 2994518.
[… 125 lines omitted for display …]
One of the special magic numbers for selective-tuber is: 4312779.
One of the special magic numbers for debonair-fiery is: 8218269.
One of the special magic numbers for wonderful-guilder is: 3557449.
One of the special magic numbers for burly-conspiracy is: 4486670.
One of the special magic numbers for ritzy-queen is: 5292134.
One of the special magic numbers for crazy-worry is: 7041228.
One of the special magic numbers for jobless-eyebrow is: 2214571.
One of the special magic numbers for mighty-digit is: 7358147.
One of the special magic numbers for aboard-aardvark is: 6898403.
One of the special magic numbers for groovy-tablecloth is: 3223383.
One of the special magic numbers for tangy-elbow is: 7073818.
One of the special magic numbers for dead-step-daughter is: 9073915.
One of the special magic numbers for irate-pasture is: 1111203.
One of the special magic numbers for lethal-tow-truck is: 7743822.
[… 1 lines omitted for display …]
One of the special magic numbers for tense-tensor is: 2036142.
One of the special magic numbers for quizzical-laryngitis is: 5594782.
What is the special magic number for mighty-digit mentioned in the provided text?

Original prompt 3,483 tokens, 146 linesShown 20 lines around the needleNeedle at 89% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7044946Aux 20157358147Ours7358147Ours, no steer.7358147PiT-FT7044946Qwen 27B7358147

Ours

Found the needle

7358147.

Aux 2015

Found the needle

7358147.

PiT-FT 2015

Missed

: 3451848. The special magic number for unkind-tack is: 7578006. The special magic number for unkind-tack mentioned in the provided text is: 7578006. The special magic number for unkind-tack mentioned in the provided text is: 7578006. The special magic number for unkind-tack mentioned in the provided text is: 7578006. The special magic number for unkind-tack mentioned in the provided text is: 7578006. The special magic number for unkind-tack mentioned in

ChronoGPT 2015

Missed

: 7275509.<|endoftext|>