Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#000 · needle at 30% depth#001 · needle at 3% depth#002 · needle at 66% depth#003 · needle at 66% depth#004 · needle at 46% depth#005 · needle at 62% depth#006 · needle at 12% depth#007 · needle at 91% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wonderful-loss is: 6492169.
One of the special magic numbers for ordinary-floodplain is: 7555770.
[… 8 lines omitted for display …]
One of the special magic numbers for Early-adverb is: 6090988.
One of the special magic numbers for obnoxious-kneejerk is: 7399181.
One of the special magic numbers for yellow-geyser is: 3675751.
One of the special magic numbers for charming-discipline is: 1898215.
One of the special magic numbers for level-dance is: 4612279.
One of the special magic numbers for thoughtful-ride is: 4200848.
One of the special magic numbers for nasty-hammock is: 7254897.
One of the special magic numbers for wonderful-kitchen is: 7519151.
One of the special magic numbers for boorish-canopy is: 5697262.
One of the special magic numbers for murky-glee is: 1375717.
One of the special magic numbers for hesitant-typewriter is: 1587080.
One of the special magic numbers for cowardly-locket is: 6067560.
One of the special magic numbers for deadpan-housewife is: 5407805.
One of the special magic numbers for orange-cloakroom is: 4433725.
[… 662 lines omitted for display …]
One of the special magic numbers for elegant-participant is: 1062440.
One of the special magic numbers for sleepy-comprehension is: 6962982.
What is the special magic number for wonderful-kitchen mentioned in the provided text?
Original prompt 15,826 tokens, 690 linesShown 20 lines around the needleNeedle at 3% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2326491Aux 20151207372Ours7519151Ours, no steer.7519151PiT-FT2326491Qwen 27B7519151
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7519151.

13 characters10 tokens

Aux 2015

Missed

6405853.

13 characters10 tokens

PiT-FT 2015

Missed

: 7074205. The special magic number for the most recent-turtle is: 8691955. The special magic number for the most recent-turtle is: 8691955. The special magic number for the most recent-turtle is: 8691955. The special magic number for the most recent-turtle is: 8691955. The special magic number for the most recent-turtle is: 8691955. The special magic number for the most recent-turtle is: 8691955. The special magic number for the most

445 characters128 tokens

ChronoGPT 2015

Missed

: 7147865.<|endoftext|>

23 characters7 tokens