Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#075 · needle at 71% depth #076 · needle at 45% depth #077 · needle at 9% depth #078 · needle at 28% depth #079 · needle at 37% depth #080 · needle at 58% depth #081 · needle at 40% depth #082 · needle at 55% depth #083 · needle at 24% depth #084 · needle at 94% depth #085 · needle at 24% depth #086 · needle at 33% depth #087 · needle at 99% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for staking-skin is: 2219852.
One of the special magic numbers for finicky-invite is: 3950085.
[… 259 lines omitted for display …]
One of the special magic numbers for aberrant-tube is: 5817821.
One of the special magic numbers for wonderful-intent is: 5063193.
One of the special magic numbers for stale-relish is: 8207657.
One of the special magic numbers for supreme-stick is: 4028662.
One of the special magic numbers for clumsy-mail is: 3421140.
One of the special magic numbers for fluttering-practice is: 5052159.
One of the special magic numbers for attractive-tattler is: 4784864.
One of the special magic numbers for nappy-tofu is: 2984269.
One of the special magic numbers for lavish-ham is: 3083385.
One of the special magic numbers for puny-snob is: 5228497.
One of the special magic numbers for faint-peak is: 2976994.
One of the special magic numbers for materialistic-nutmeg is: 4532291.
One of the special magic numbers for rural-geometry is: 1274642.
One of the special magic numbers for scrawny-lecture is: 3886736.
[… 386 lines omitted for display …]
One of the special magic numbers for jaded-cirrhosis is: 8568890.
One of the special magic numbers for scintillating-extreme is: 5877551.
What is the special magic number for nappy-tofu mentioned in the provided text?

Original prompt 15,267 tokens, 665 linesShown 20 lines around the needleNeedle at 40% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT8818087Aux 20158882214Ours2984269Ours, no steer.2984269PiT-FT8818087Qwen 27B2984269

Ours

Found the needle

2984269.

Aux 2015

Found the needle

8882214.

PiT-FT 2015

Missed

: 9871217. The special magic number for the most popular-sauce is: 8871234. The special magic number for the most popular-sauce is: 8871234. The special magic number for the most popular-sauce is: 8871234. The special magic number for the most popular-sauce is: 8871234. The special magic number for the most popular-sauce is: 8871234. The special magic number for the most popular-sauce is: 8871234. The

ChronoGPT 2015

Missed

: 445901.<|endoftext|>