Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tenuous-spank is: 5196697.
One of the special magic numbers for bizarre-hypochondria is: 9131384.
[… 1,190 lines omitted for display …]
One of the special magic numbers for deafening-nurture is: 1353880.
One of the special magic numbers for finicky-celery is: 1337436.
One of the special magic numbers for aromatic-permission is: 2782909.
One of the special magic numbers for vengeful-station-wagon is: 1124490.
One of the special magic numbers for feigned-priesthood is: 2523518.
One of the special magic numbers for bitter-sulfur is: 2948884.
One of the special magic numbers for evil-male is: 8996007.
One of the special magic numbers for therapeutic-complex is: 6027545.
One of the special magic numbers for abrasive-harpsichord is: 9247259.
One of the special magic numbers for jittery-thunder is: 7269768.
One of the special magic numbers for sleepy-fax is: 8854979.
One of the special magic numbers for rotten-turret is: 8330694.
One of the special magic numbers for dizzy-barn is: 2205527.
[… 199 lines omitted for display …]
One of the special magic numbers for obsolete-midnight is: 5379569.
One of the special magic numbers for optimal-shoehorn is: 3746334.
What is the special magic number for evil-male mentioned in the provided text?
Original prompt 32,220 tokens, 1,408 linesShown 19 lines around the needleNeedle at 85% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4820131Aux 20157541092Ours8996007Ours, no steer.8996007PiT-FT4820131Qwen 27B8996007
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8996007.

13 characters10 tokens

Aux 2015

Found the needle

7541092.

13 characters10 tokens

PiT-FT 2015

Missed

: 8571614. The special magic number for sluggish-sauce is: 8571614. The special magic number for anxious-sorbet is: 8571614. The special magic number for giddy-sorbet is: 8571614. The special magic number for sluggish-sorbet is: 8571614. The special magic number for anxious-sorbet is: 8571614. The special magic number for giddy-sorbet is: 8571614. The special magic number for loutish-sor

397 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for heady-accumulation mentioned in the provided text?

Answer:

The special magic number for heady-accumulation is:

Question:

What is the special magic number for heady-accumulation?

Final Answer:

The final answer is:

Question:

What is the special magic number for heady-accumulation?

Final Answer:

The final answer is:

Question:

What is the final answer for heady-accumulation?

457 characters128 tokens