Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

#000 · needle at 38% depth#001 · needle at 82% depth#002 · needle at 60% depth#003 · needle at 96% depth#004 · needle at 44% depth#005 · needle at 39% depth#006 · needle at 40% depth#007 · needle at 27% depth#008 · needle at 89% depth#009 · needle at 93% depth#010 · needle at 23% depth#011 · needle at 85% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for excited-serval is: 5984128.
One of the special magic numbers for super-knitting is: 2452043.
[… 546 lines omitted for display …]
One of the special magic numbers for absurd-watch is: 9987580.
One of the special magic numbers for diligent-castle is: 9970943.
One of the special magic numbers for eatable-retreat is: 5928747.
One of the special magic numbers for mere-sonar is: 6177204.
One of the special magic numbers for strong-hellcat is: 2996833.
One of the special magic numbers for tested-knife-edge is: 5026126.
One of the special magic numbers for obtainable-sphynx is: 2337630.
One of the special magic numbers for evil-sleep is: 9005779.
One of the special magic numbers for mysterious-platinum is: 6470251.
One of the special magic numbers for auspicious-compassion is: 5673376.
One of the special magic numbers for uncovered-step-sister is: 3813045.
One of the special magic numbers for ultra-common is: 4634210.
One of the special magic numbers for typical-clerk is: 2775579.
One of the special magic numbers for lonely-cruelty is: 7850358.
[… 842 lines omitted for display …]
One of the special magic numbers for snobbish-hand-holding is: 4384417.
One of the special magic numbers for curious-blogger is: 3224661.
What is the special magic number for evil-sleep mentioned in the provided text?
Original prompt 32,205 tokens, 1,408 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9618324Aux 20154384417Ours9005779Ours, no steer.9005779PiT-FT9618324Qwen 27B9005779
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9005779.

13 characters10 tokens

Aux 2015

Missed

7078404.

13 characters10 tokens

PiT-FT 2015

Missed

: 8873534. The special magic number for the most important-sauce is: 8873534. The special magic number for the most recent-sauce is: 8873534. The special magic number for the most recent-snow is: 8873534. The special magic number for the most recent-snow is: 8873534. The special magic number for the most recent-snow is: 8873534. The special magic number for the most recent-snow is: 8873534. The special magic number for

429 characters128 tokens

ChronoGPT 2015

Missed

: 1823131.<|endoftext|>

23 characters6 tokens