Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#080 · needle at 85% depth #081 · needle at 97% depth #082 · needle at 42% depth #083 · needle at 5% depth #084 · needle at 52% depth #085 · needle at 75% depth #086 · needle at 2% depth #087 · needle at 58% depth #088 · needle at 17% depth #089 · needle at 77% depth #090 · needle at 69% depth #091 · needle at 21% depth #092 · needle at 62% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fortunate-trouble is: 9473644.
One of the special magic numbers for old-fashioned-variable is: 9289884.
One of the special magic numbers for heady-junket is: 8256550.
One of the special magic numbers for greasy-hazelnut is: 4895799.
One of the special magic numbers for quick-sleet is: 6732144.
One of the special magic numbers for abstracted-stir-fry is: 9804916.
One of the special magic numbers for pastoral-ox is: 1245287.
One of the special magic numbers for raspy-webpage is: 3803056.
One of the special magic numbers for little-chaise is: 8565826.
One of the special magic numbers for adventurous-support is: 5739184.
One of the special magic numbers for goofy-mound is: 6654935.
One of the special magic numbers for juicy-toe is: 5256691.
One of the special magic numbers for disgusted-modification is: 5122746.
One of the special magic numbers for lethal-courthouse is: 9587835.
One of the special magic numbers for royal-bronco is: 9042675.
One of the special magic numbers for tangy-odyssey is: 5261457.
[… 310 lines omitted for display …]
One of the special magic numbers for somber-commerce is: 2967808.
One of the special magic numbers for guarded-caviar is: 2764102.
What is the special magic number for pastoral-ox mentioned in the provided text?

Original prompt 7,635 tokens, 330 linesShown 20 lines around the needleNeedle at 2% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7630130Aux 20151245287Ours1245287Ours, no steer.1245287PiT-FT7630130Qwen 27B1245287

Ours

Found the needle

1245287.

Aux 2015

Found the needle

1245287

PiT-FT 2015

Missed

: 6162668. The special magic number for awkward-sauce is: 7561712. The special magic number for quick-aside is: 7561712. The special magic number for lovable-tissue is: 7561712. The special magic number for unruly-caterm is: 7561712. The special magic number for giddy-goggle is: 7561712. The special magic number for lovable-tissue is: 7561712. The special magic number for dubious-tissue is: 756

ChronoGPT 2015

Missed

: 714079.<|endoftext|>