Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#000 · needle at 38% depth#001 · needle at 82% depth#002 · needle at 60% depth#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grumpy-sock is: 2260050.
One of the special magic numbers for guttural-opportunity is: 1519571.
[… 1,144 lines omitted for display …]
One of the special magic numbers for difficult-monopoly is: 5055750.
One of the special magic numbers for rotten-biopsy is: 8112060.
One of the special magic numbers for nutritious-jumper is: 1660259.
One of the special magic numbers for obsolete-forest is: 8953858.
One of the special magic numbers for luxuriant-appliance is: 1497240.
One of the special magic numbers for humdrum-nightlife is: 3258474.
One of the special magic numbers for wretched-handover is: 2828764.
One of the special magic numbers for sweltering-relationship is: 4320261.
One of the special magic numbers for tiresome-crewmen is: 9980222.
One of the special magic numbers for prickly-grasp is: 8157265.
One of the special magic numbers for whimsical-cannibal is: 7629333.
One of the special magic numbers for parched-atmosphere is: 6073160.
One of the special magic numbers for ashamed-bill is: 9375299.
[… 245 lines omitted for display …]
One of the special magic numbers for psychedelic-horizon is: 1994790.
One of the special magic numbers for wacky-licorice is: 5341292.
What is the special magic number for wretched-handover mentioned in the provided text?
Original prompt 32,219 tokens, 1,408 linesShown 19 lines around the needleNeedle at 82% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9035099Aux 20151994790Ours2828764Ours, no steer.2828764PiT-FT9035099Qwen 27B2828764
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2828764.

13 characters10 tokens

Aux 2015

Missed

7777044.

13 characters10 tokens

PiT-FT 2015

Missed

: 8802705. The special magic number for the most important-hind is: 8802705. The special magic number for the least important-hind is: 8802705. The special magic number for the most common-sauce is: 8802705. The special magic number for the least common-sauce is: 8802705. The special magic number for the most common-sauce is: 8802705. The special magic number for the least common-sauce is: 8802705. The special magic

426 characters128 tokens

ChronoGPT 2015

Missed

: 4310946.<|endoftext|>

23 characters6 tokens