Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#031 · needle at 78% depth #032 · needle at 50% depth #033 · needle at 11% depth #034 · needle at 16% depth #035 · needle at 19% depth #036 · needle at 14% depth #037 · needle at 66% depth #038 · needle at 69% depth #039 · needle at 19% depth #040 · needle at 49% depth #041 · needle at 80% depth #042 · needle at 32% depth #043 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for roomy-halt is: 5476644.
One of the special magic numbers for hesitant-accounting is: 6564745.
[… 431 lines omitted for display …]
One of the special magic numbers for tender-opponent is: 4371097.
One of the special magic numbers for trite-onion is: 8833833.
One of the special magic numbers for itchy-lettuce is: 5189877.
One of the special magic numbers for tall-poll is: 8617694.
One of the special magic numbers for teeny-tiny-consignment is: 3199725.
One of the special magic numbers for petite-lane is: 6945176.
One of the special magic numbers for childlike-collectivization is: 4634936.
One of the special magic numbers for guarded-ottoman is: 3124570.
One of the special magic numbers for boring-council is: 6487732.
One of the special magic numbers for rebellious-fog is: 7363660.
One of the special magic numbers for deafening-jockey is: 1389797.
One of the special magic numbers for pastoral-meeting is: 2214656.
One of the special magic numbers for exclusive-crab is: 9796781.
One of the special magic numbers for slimy-dedication is: 5226400.
[… 214 lines omitted for display …]
One of the special magic numbers for erect-lyocell is: 5776464.
One of the special magic numbers for poor-homework is: 2656786.
What is the special magic number for guarded-ottoman mentioned in the provided text?

Original prompt 15,343 tokens, 665 linesShown 20 lines around the needleNeedle at 66% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6390429Aux 20159862399Ours3124570Ours, no steer.3124570PiT-FT6390429Qwen 27B3124570

Ours

Found the needle

3124570.

Aux 2015

Found the needle

9862399.

PiT-FT 2015

Missed

: 8803962. The special magic number for cheerful-camel mentioned in the provided text is: 8803962. The special magic number for awkward-batter mentioned in the provided text is: 8803962. The special magic number for gassy-batter is: 8803962. The special magic number for lovable-batter is: 8803962. The special magic number for jaded-sorbet is: 8803962. The special magic number for lovable-sindrome is: 8803962. The special magic

ChronoGPT 2015

Missed

: 729087.<|endoftext|>