Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

#088 · needle at 43% depth #089 · needle at 87% depth #090 · needle at 72% depth #091 · needle at 11% depth #092 · needle at 89% depth #093 · needle at 58% depth #094 · needle at 18% depth #095 · needle at 42% depth #096 · needle at 32% depth #097 · needle at 81% depth #098 · needle at 18% depth #099 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for charming-voter is: 6669692.
One of the special magic numbers for successful-preoccupation is: 3496583.
[… 17 lines omitted for display …]
One of the special magic numbers for tested-migration is: 8135214.
One of the special magic numbers for frantic-impairment is: 2764731.
One of the special magic numbers for vacuous-male is: 1199343.
One of the special magic numbers for protective-vengeance is: 1763581.
One of the special magic numbers for tenuous-ficlet is: 9112297.
One of the special magic numbers for romantic-good is: 8184597.
One of the special magic numbers for smiling-congregation is: 6389340.
One of the special magic numbers for ratty-flight is: 6833547.
One of the special magic numbers for old-fashioned-slider is: 7303886.
One of the special magic numbers for assorted-component is: 2870254.
One of the special magic numbers for selfish-jelly is: 9839713.
One of the special magic numbers for finicky-eddy is: 1229693.
One of the special magic numbers for grouchy-disclosure is: 2786400.
One of the special magic numbers for wacky-diaper is: 6414185.
[… 109 lines omitted for display …]
One of the special magic numbers for merciful-variant is: 5679491.
One of the special magic numbers for relieved-pseudoscience is: 5837652.
What is the special magic number for ratty-flight mentioned in the provided text?

Original prompt 3,482 tokens, 146 linesShown 20 lines around the needleNeedle at 18% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3396787Aux 20156833547Ours6833547Ours, no steer.6833547PiT-FT3396787Qwen 27B6833547

Ours

Found the needle

6833547.

Aux 2015

Found the needle

6833547.

PiT-FT 2015

Missed

: 8576462. The special magic number for awkward-tobacco is: 8063708. The special magic number for garrulous-cattle is: 8690436. The special magic number for lovable-pomelo is: 7583942. The special magic number for gassy-tack is: 8551495. The special magic number for lovable-tack is: 7583942. The special magic number for maudlin-tack is: 8551495. The special magic number for lovable-tack

ChronoGPT 2015

Missed

: 5490136.<|endoftext|>