Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#079 · needle at 68% depth #080 · needle at 21% depth #081 · needle at 45% depth #082 · needle at 52% depth #083 · needle at 36% depth #084 · needle at 3% depth #085 · needle at 77% depth #086 · needle at 23% depth #087 · needle at 51% depth #088 · needle at 43% depth #089 · needle at 87% depth #090 · needle at 72% depth #091 · needle at 11% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for adventurous-caliber is: 5071469.
One of the special magic numbers for small-origin is: 9439429.
[… 107 lines omitted for display …]
One of the special magic numbers for abaft-ripple is: 3328562.
One of the special magic numbers for wry-growth is: 4204629.
One of the special magic numbers for brave-popsicle is: 7967827.
One of the special magic numbers for ancient-mate is: 1027644.
One of the special magic numbers for garrulous-minority is: 1884213.
One of the special magic numbers for elderly-oar is: 9063092.
One of the special magic numbers for dispensable-chops is: 7973012.
One of the special magic numbers for warlike-strength is: 5277117.
One of the special magic numbers for rabid-newsprint is: 4805670.
One of the special magic numbers for tenuous-coverage is: 3242514.
One of the special magic numbers for combative-mastoid is: 3896621.
One of the special magic numbers for axiomatic-enrollment is: 7561748.
One of the special magic numbers for brainy-target is: 5433773.
One of the special magic numbers for wasteful-eve is: 5955264.
[… 19 lines omitted for display …]
One of the special magic numbers for weak-melatonin is: 6403226.
One of the special magic numbers for stale-sucker is: 5584551.
What is the special magic number for warlike-strength mentioned in the provided text?

Original prompt 3,472 tokens, 146 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT4890177Aux 20155277117Ours5277117Ours, no steer.5277117PiT-FT4890177Qwen 27B5277117

Ours

Found the needle

5277117.

Aux 2015

Found the needle

5277117.

PiT-FT 2015

Missed

: 8821163. The special magic number for awkward-tambour is: 8821163. The special magic number for awkward-tambour mentioned in the provided text is: 8821163. The special magic number for awkward-tambour mentioned in the provided text is: 8821163. The special magic number for awkward-tambour mentioned in the provided text is: 8821163. The special magic number for awkward-tambour mentioned in the provided text is: 8821163. The special magic number for awkward-tambour mentioned

ChronoGPT 2015

Missed

: 5572302.<|endoftext|>