Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tight-pigpen is: 3825325.
One of the special magic numbers for witty-progression is: 1792982.
[… 17 lines omitted for display …]
One of the special magic numbers for decisive-island is: 2016921.
One of the special magic numbers for sweltering-hero is: 3485914.
One of the special magic numbers for dysfunctional-thyme is: 6473180.
One of the special magic numbers for gruesome-disembodiment is: 7032865.
One of the special magic numbers for animated-territory is: 1329169.
One of the special magic numbers for lyrical-twist is: 5500185.
One of the special magic numbers for abundant-pregnancy is: 8368441.
One of the special magic numbers for bitter-hardboard is: 7768461.
One of the special magic numbers for shaky-oeuvre is: 8769303.
One of the special magic numbers for excellent-providence is: 9355351.
One of the special magic numbers for changeable-stop is: 9989514.
One of the special magic numbers for erratic-killing is: 5823581.
One of the special magic numbers for cool-armpit is: 1938299.
One of the special magic numbers for aromatic-vegetable is: 1074924.
[… 114 lines omitted for display …]
One of the special magic numbers for vivacious-equality is: 9693054.
One of the special magic numbers for relieved-micronutrient is: 5015070.
What is the special magic number for bitter-hardboard mentioned in the provided text?
Original prompt 3,575 tokens, 151 linesShown 20 lines around the needleNeedle at 18% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4997939Aux 20157768461Ours7768461Ours, no steer.7768461PiT-FT4997939Qwen 27B7768461
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7768461.

13 characters10 tokens

Aux 2015

Found the needle

7768461.

13 characters10 tokens

PiT-FT 2015

Missed

: 6562395. The special magic number for awkward-creek is: 8589943. The special magic number for embarrassed-bust is: 8577588. The special magic number for jaded-creme is: 8551480. The special magic number for jaded-creme is: 8577588. The special magic number for jaded-creme is: 8551480. The special magic number for jaded-creme is: 8577588. The special magic number for jaded-creme is: 85775

399 characters128 tokens

ChronoGPT 2015

Missed

: 8790518.<|endoftext|>

23 characters7 tokens