Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for unsuitable-ordination is: 4823157.
One of the special magic numbers for dizzy-courage is: 2353245.
[… 10 lines omitted for display …]
One of the special magic numbers for charming-teletype is: 5415327.
One of the special magic numbers for light-peace is: 3725972.
One of the special magic numbers for fuzzy-blight is: 9233731.
One of the special magic numbers for roasted-limestone is: 1219157.
One of the special magic numbers for expensive-goal is: 6178936.
One of the special magic numbers for lying-dump truck is: 4638436.
One of the special magic numbers for entertaining-manicure is: 4031178.
One of the special magic numbers for elderly-pile is: 5213838.
One of the special magic numbers for rambunctious-wallet is: 8431885.
One of the special magic numbers for godly-supply is: 3573789.
One of the special magic numbers for lazy-recall is: 7993516.
One of the special magic numbers for idiotic-pleasure is: 7768120.
One of the special magic numbers for scrawny-fav is: 7588178.
One of the special magic numbers for momentous-work is: 9916686.
[… 275 lines omitted for display …]
One of the special magic numbers for absurd-developmental is: 1778871.
One of the special magic numbers for ultra-summit is: 2289086.
What is the special magic number for elderly-pile mentioned in the provided text?
Original prompt 7,115 tokens, 305 linesShown 20 lines around the needleNeedle at 7% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3538073Aux 20155213838Ours5213838Ours, no steer.5213838PiT-FT3538073Qwen 27B5213838
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5213838.

13 characters10 tokens

Aux 2015

Found the needle

5213838.

13 characters10 tokens

PiT-FT 2015

Missed

: 6692819. The special magic number for awkward-soup is: 8803953. The special magic number for quick-billing is: 8042735. The special magic number for livid-counsell is: 8803953. The special magic number for giddy-gravel is: 8042735. The special magic number for gaudy-soup is: 8803953. The special magic number for livid-counsell is: 8803953. The special magic number for giddy-gravel is:

396 characters128 tokens

ChronoGPT 2015

Missed

: 7386441.<|endoftext|>

23 characters7 tokens