Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#084 · needle at 94% depth #085 · needle at 24% depth #086 · needle at 33% depth #087 · needle at 99% depth #088 · needle at 90% depth #089 · needle at 36% depth #090 · needle at 60% depth #091 · needle at 23% depth #092 · needle at 46% depth #093 · needle at 43% depth #094 · needle at 81% depth #095 · needle at 73% depth #096 · needle at 95% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for flowery-sitar is: 6611067.
One of the special magic numbers for alive-bomb is: 1221999.
[… 408 lines omitted for display …]
One of the special magic numbers for funny-signet is: 7872188.
One of the special magic numbers for crowded-lawmaker is: 2952988.
One of the special magic numbers for domineering-actress is: 1225899.
One of the special magic numbers for brave-attainment is: 3160423.
One of the special magic numbers for aboard-mess is: 9786984.
One of the special magic numbers for nonchalant-jug is: 5866667.
One of the special magic numbers for sweltering-revenant is: 5183508.
One of the special magic numbers for vigorous-religion is: 8924206.
One of the special magic numbers for fearless-underclothes is: 8281251.
One of the special magic numbers for dark-bog is: 9139657.
One of the special magic numbers for economic-underpass is: 1519861.
One of the special magic numbers for satisfying-baboon is: 7066026.
One of the special magic numbers for awful-step-sister is: 7257413.
One of the special magic numbers for lush-front is: 6447195.
[… 262 lines omitted for display …]
One of the special magic numbers for miniature-buffet is: 9509105.
One of the special magic numbers for misty-ox is: 4232206.
What is the special magic number for vigorous-religion mentioned in the provided text?

Original prompt 15,848 tokens, 690 linesShown 20 lines around the needleNeedle at 60% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT7744832Aux 20158590634Ours8924206Ours, no steer.8924206PiT-FT7744832Qwen 27B8924206

Ours

Found the needle

8924206.

Aux 2015

Found the needle

8590634.

PiT-FT 2015

Missed

: 7751957. The special magic number for the most excellent-turtle is: 8270048. The special magic number for the most excellent-sauce is: 8270048. The special magic number for the most excellent-turtle is: 8270048. The special magic number for the most excellent-sauce is: 8270048. The special magic number for the most excellent-turtle is: 8270048. The special magic number for the most excellent-sauce is: 8270048. The special magic number

ChronoGPT 2015

Missed

: 2849351.<|endoftext|>