Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth#028 · needle at 54% depth#029 · needle at 39% depth#030 · needle at 0% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for afraid-silver is: 1832496.
One of the special magic numbers for wise-antiquity is: 7044946.
[… 278 lines omitted for display …]
One of the special magic numbers for lavish-invasion is: 2788610.
One of the special magic numbers for early-danger is: 2619583.
One of the special magic numbers for murky-hippopotamus is: 9590345.
One of the special magic numbers for few-paramecium is: 3288382.
One of the special magic numbers for eminent-dream is: 3571808.
One of the special magic numbers for seemly-belief is: 6957414.
One of the special magic numbers for gigantic-signature is: 2656274.
One of the special magic numbers for screeching-wording is: 1683432.
One of the special magic numbers for glib-salary is: 3123410.
One of the special magic numbers for disillusioned-complicity is: 7866648.
One of the special magic numbers for flat-exhaustion is: 3232359.
One of the special magic numbers for moldy-click is: 3141011.
One of the special magic numbers for comfortable-revelation is: 5948813.
One of the special magic numbers for godly-patriot is: 6359120.
[… 367 lines omitted for display …]
One of the special magic numbers for skinny-laryngitis is: 1100213.
One of the special magic numbers for deadpan-reservoir is: 9725550.
What is the special magic number for screeching-wording mentioned in the provided text?
Original prompt 15,338 tokens, 665 linesShown 20 lines around the needleNeedle at 43% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1188459Aux 20151937407Ours1683432Ours, no steer.1683432PiT-FT1188459Qwen 27B1683432
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1683432.

13 characters10 tokens

Aux 2015

Missed

2415278.

13 characters10 tokens

PiT-FT 2015

Missed

: 7573554. The special magic number for the most important-saxophone is: 8707031. The special magic number for the most important-saxophone mentioned in the provided text is: 8707031. The special magic number for the most important-saxophone mentioned in the provided text is: 8707031. The special magic number for the most important-saxophone mentioned in the provided text is: 8707031. The special magic number for the most important-saxophone mentioned in the provided text is: 8707031. The

499 characters128 tokens

ChronoGPT 2015

Missed

: 13581011.<|endoftext|>

24 characters7 tokens