Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth#098 · needle at 49% depth#099 · needle at 36% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for immense-know-how is: 9422263.
One of the special magic numbers for weary-chin is: 3539478.
[… 1,500 lines omitted for display …]
One of the special magic numbers for wealthy-rope is: 4995316.
One of the special magic numbers for draconian-fiber is: 6644221.
One of the special magic numbers for dark-boost is: 3861788.
One of the special magic numbers for adjoining-rheumatism is: 3840466.
One of the special magic numbers for steadfast-speech is: 7236533.
One of the special magic numbers for innate-prestige is: 5386667.
One of the special magic numbers for materialistic-frequency is: 2907307.
One of the special magic numbers for slimy-jug is: 7486334.
One of the special magic numbers for nonstop-consul is: 8930623.
One of the special magic numbers for prickly-surfboard is: 6359050.
One of the special magic numbers for excellent-minor-league is: 9453148.
One of the special magic numbers for ahead-truth is: 2879561.
One of the special magic numbers for fanatical-area is: 5576557.
One of the special magic numbers for magnificent-nation is: 8685060.
[… 4,198 lines omitted for display …]
One of the special magic numbers for lewd-shorts is: 5593891.
One of the special magic numbers for rightful-chub is: 4838532.
What is the special magic number for slimy-jug mentioned in the provided text?
Original prompt 130,491 tokens, 5,718 linesShown 20 lines around the needleNeedle at 26% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2768004Aux 20153027927Ours7486334Ours, no steer.7486334PiT-FT2768004Qwen 27B7486334
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7486334.

13 characters10 tokens

Aux 2015

Missed

4863676.

13 characters10 tokens

PiT-FT 2015

Missed

: 6692056. What other information might be included to make the answer more interesting? Assistant Response to your query about the special magic numbers for various-sauce is: 7692056. Assistant Response to your query about the special magic numbers for cheerful-council is: 7105714. Assistant Response to your query about the special magic numbers for gastronomic is: 7105714. Assistant Response to your query about the special magic numbers for ethereal-sauce is: 7105714. Assistant Response to your query about the

517 characters128 tokens

ChronoGPT 2015

Missed

Va:

The special Epicurean Epicurean Epicurean

Wh:

The special Epicurean Epicurean

Conj:

The special Epicurean Epicurean

###oho: The special Epicurean Elysian Epicurean

###oho: The special Epicurean Elysian Epicurean

###oho: The special Epicurean Elysian Epicurean

###oho: The special Epicurean Elysian Epicurean

###oho: The special Epicurean Elysian Epicurean

391 characters128 tokens