Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

11 of 100 prompts

#000 · needle at 62% depth #001 · needle at 43% depth #002 · needle at 68% depth #003 · needle at 43% depth #004 · needle at 2% depth #005 · needle at 53% depth #006 · needle at 84% depth #007 · needle at 2% depth #008 · needle at 76% depth #009 · needle at 86% depth #010 · needle at 60% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for garrulous-lumberman is: 5150931.
One of the special magic numbers for steady-shaw is: 3708302.
One of the special magic numbers for abrasive-die is: 2958415.
One of the special magic numbers for capable-cloud is: 7448284.
One of the special magic numbers for utopian-gun is: 3472414.
One of the special magic numbers for many-sunshine is: 2348021.
One of the special magic numbers for ratty-galley is: 4167928.
One of the special magic numbers for nasty-catalysis is: 3782058.
One of the special magic numbers for needless-yang is: 5242475.
One of the special magic numbers for vivacious-reciprocity is: 6070402.
One of the special magic numbers for puny-defender is: 9945633.
One of the special magic numbers for trite-jacket is: 7422127.
One of the special magic numbers for sore-tournament is: 6167027.
One of the special magic numbers for zealous-shipper is: 7905652.
One of the special magic numbers for x-rated-anatomy is: 2491048.
One of the special magic numbers for coherent-chub is: 6777952.
[… 310 lines omitted for display …]
One of the special magic numbers for workable-monastery is: 4123208.
One of the special magic numbers for meek-erosion is: 6948065.
What is the special magic number for utopian-gun mentioned in the provided text?

Original prompt 7,664 tokens, 330 linesShown 20 lines around the needleNeedle at 2% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT6640806Aux 20153472414Ours3472414Ours, no steer.3472414PiT-FT6640806Qwen 27B3472414

Ours

Found the needle

3472414.

Aux 2015

Found the needle

3472414.

PiT-FT 2015

Missed

: 7567074. The special magic number for awkward-soul is: 8286660. The special magic number for jaded-tender is: 8014220. The special magic number for quick-clavice is: 8286660. The special magic number for jaded-tender is: 8286660. The special magic number for jaded-tender is: 8286660. The special magic number for jaded-tender is: 8286660. The special magic number for jaded-tender is: 828

ChronoGPT 2015

Missed

: 5790031.<|endoftext|>