Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#062 · needle at 20% depth#063 · needle at 36% depth#064 · needle at 88% depth#065 · needle at 24% depth#066 · needle at 39% depth#067 · needle at 7% depth#068 · needle at 22% depth#069 · needle at 48% depth#070 · needle at 4% depth#071 · needle at 17% depth#072 · needle at 93% depth#073 · needle at 13% depth#074 · needle at 29% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for earsplitting-appeal is: 2721335.
One of the special magic numbers for wise-economics is: 3346808.
[… 62 lines omitted for display …]
One of the special magic numbers for groovy-lily is: 7522585.
One of the special magic numbers for cool-nickel is: 3907918.
One of the special magic numbers for fluffy-animal is: 2400418.
One of the special magic numbers for stale-hormone is: 1147293.
One of the special magic numbers for alert-pneumonia is: 3382698.
One of the special magic numbers for harmonious-medicine is: 2527475.
One of the special magic numbers for laughable-brownie is: 6651425.
One of the special magic numbers for accessible-ballet is: 3723527.
One of the special magic numbers for combative-substitution is: 9295325.
One of the special magic numbers for imperfect-emanate is: 9719325.
One of the special magic numbers for maniacal-frosting is: 4653143.
One of the special magic numbers for old-harmonise is: 4535671.
One of the special magic numbers for inexpensive-coil is: 4428698.
One of the special magic numbers for evasive-rain is: 3782003.
[… 248 lines omitted for display …]
One of the special magic numbers for tense-plume is: 6545823.
One of the special magic numbers for wasteful-muskrat is: 2633520.
What is the special magic number for accessible-ballet mentioned in the provided text?
Original prompt 7,670 tokens, 330 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4885141Aux 20153723527Ours3723527Ours, no steer.3723527PiT-FT4885141Qwen 27B3723527
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3723527.

13 characters10 tokens

Aux 2015

Missed

7491026.

13 characters10 tokens

PiT-FT 2015

Missed

: 7821204. The special magic number for the most part-of-the-world is: 7821204. The special magic number for the most part-of-the-world is: 7821204. The special magic number for the most part-of-the-world is: 7821204. The special magic number for the most part-of-the-world is: 7821204. The special magic number for the most part-of-the-world is: 7821204. The special magic number for the most part-of-

408 characters128 tokens

ChronoGPT 2015

Missed

: 6742517.<|endoftext|>

23 characters7 tokens