Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#001 · needle at 82% depth#002 · needle at 60% depth#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth#012 · needle at 57% depth#013 · needle at 94% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ripe-experiment is: 1715546.
One of the special magic numbers for dusty-waterbed is: 4913762.
[… 368 lines omitted for display …]
One of the special magic numbers for blushing-columnist is: 8055583.
One of the special magic numbers for real-worry is: 1228038.
One of the special magic numbers for cloistered-stripe is: 2377921.
One of the special magic numbers for itchy-variety is: 4635438.
One of the special magic numbers for muddy-wingman is: 1302736.
One of the special magic numbers for tacky-thumb is: 7459249.
One of the special magic numbers for heartbreaking-chromolithograph is: 4526773.
One of the special magic numbers for embarrassed-democrat is: 2063522.
One of the special magic numbers for strange-octave is: 6022843.
One of the special magic numbers for lazy-capitulation is: 4281797.
One of the special magic numbers for towering-hubcap is: 5475360.
One of the special magic numbers for straight-reinscription is: 9269511.
One of the special magic numbers for expensive-retrospectivity is: 3115585.
One of the special magic numbers for aware-rod is: 1050039.
[… 1,020 lines omitted for display …]
One of the special magic numbers for earthy-doorknob is: 6614157.
One of the special magic numbers for dull-commodity is: 2843883.
What is the special magic number for embarrassed-democrat mentioned in the provided text?
Original prompt 32,187 tokens, 1,408 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4869842Aux 20156614157Ours2063522Ours, no steer.2063522PiT-FT4869842Qwen 27B2063522
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2063522.

13 characters10 tokens

Aux 2015

Missed

7265486.

13 characters10 tokens

PiT-FT 2015

Missed

: 8707655. The special magic number for awkward-sister is: 8707655. The special magic number for sluggish-soulmate is: 8707655. The special magic number for fearful-felon is: 8707655. The special magic number for impatient-pip is: 8707655. The special magic number for giddy-honey is: 8707655. The special magic number for jaded-sister is: 8707655. The special magic number for gassy-pugil is: 870

404 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens