Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#071 · needle at 65% depth #072 · needle at 34% depth #073 · needle at 2% depth #074 · needle at 84% depth #075 · needle at 34% depth #076 · needle at 56% depth #077 · needle at 42% depth #078 · needle at 19% depth #079 · needle at 68% depth #080 · needle at 21% depth #081 · needle at 45% depth #082 · needle at 52% depth #083 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for bitter-flower is: 1895438.
One of the special magic numbers for burly-socialism is: 1354809.
[… 53 lines omitted for display …]
One of the special magic numbers for racial-pentagon is: 4292993.
One of the special magic numbers for abortive-character is: 4825172.
One of the special magic numbers for garrulous-max is: 9682957.
One of the special magic numbers for kaput-joy is: 8758458.
One of the special magic numbers for faithful-map is: 8262177.
One of the special magic numbers for imported-grant is: 5777283.
One of the special magic numbers for victorious-motorboat is: 1121448.
One of the special magic numbers for assorted-guacamole is: 5759312.
One of the special magic numbers for healthy-academy is: 5401001.
One of the special magic numbers for symptomatic-brownie is: 3169230.
One of the special magic numbers for phobic-red is: 4098798.
One of the special magic numbers for rainy-stew is: 1968980.
One of the special magic numbers for succinct-supernatural is: 1165941.
One of the special magic numbers for elfin-variant is: 2974411.
[… 73 lines omitted for display …]
One of the special magic numbers for instinctive-disease is: 6678211.
One of the special magic numbers for splendid-trolley is: 1688179.
What is the special magic number for assorted-guacamole mentioned in the provided text?

Original prompt 3,461 tokens, 146 linesShown 20 lines around the needleNeedle at 42% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT1188016Aux 20155759312Ours5759312Ours, no steer.5759312PiT-FT1188016Qwen 27B5759312

Ours

Found the needle

5759312.

Aux 2015

Found the needle

5759312.

PiT-FT 2015

Missed

: 1508048. The special magic number for the most-firm is: 8573622. The special magic number for the most-firm is: 8573622. The special magic number for the most-firm is: 8573622. The special magic number for the most-firm is: 8573622. The special magic number for the most-firm is: 8573622. The special magic number for the most-firm is: 8573622. The special magic number for the most-firm is: 857

ChronoGPT 2015

Missed

: 7846597.<|endoftext|>