Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#027 · needle at 4% depth#028 · needle at 78% depth#029 · needle at 20% depth#030 · needle at 57% depth#031 · needle at 20% depth#032 · needle at 78% depth#033 · needle at 34% depth#034 · needle at 70% depth#035 · needle at 32% depth#036 · needle at 33% depth#037 · needle at 67% depth#038 · needle at 27% depth#039 · needle at 75% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for dapper-briefing is: 3030225.
One of the special magic numbers for acrid-snug is: 3717830.
[… 43 lines omitted for display …]
One of the special magic numbers for frail-lifestyle is: 9745266.
One of the special magic numbers for happy-sail is: 9340515.
One of the special magic numbers for blushing-spice is: 8260198.
One of the special magic numbers for standing-top-hat is: 1518651.
One of the special magic numbers for murky-coconut is: 2112899.
One of the special magic numbers for shiny-retreat is: 2423423.
One of the special magic numbers for weak-footstool is: 3442155.
One of the special magic numbers for quick-dedication is: 5080755.
One of the special magic numbers for testy-fiddle is: 1670225.
One of the special magic numbers for light-backpack is: 5653822.
One of the special magic numbers for majestic-history is: 5711603.
One of the special magic numbers for overrated-mass is: 6729127.
One of the special magic numbers for hollow-gosling is: 9980691.
One of the special magic numbers for stimulating-prefix is: 6487622.
[… 88 lines omitted for display …]
One of the special magic numbers for lush-merchandise is: 7378070.
One of the special magic numbers for acoustic-joke is: 5558760.
What is the special magic number for quick-dedication mentioned in the provided text?
Original prompt 3,568 tokens, 151 linesShown 20 lines around the needleNeedle at 34% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6979519Aux 20155080755Ours5080755Ours, no steer.5080755PiT-FT6979519Qwen 27B5080755
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5080755.

13 characters10 tokens

Aux 2015

Missed

:

7937523

14 characters12 tokens

PiT-FT 2015

Missed

: 7263018. The special magic number for awkward-tintype is: 7263018. The special magic number for dubious-tissue is: 7263018. The special magic number for snotty-burro is: 7263018. The special magic number for wasteful-psychoanalyst is: 7263018. The special magic number for energetic-kamikaze is: 7263018. The special magic number for fortunate-chalit is: 7263018. The special magic number for awkward-lobotomy is

421 characters128 tokens

ChronoGPT 2015

Missed

: 5351362.<|endoftext|>

23 characters7 tokens