Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#014 · needle at 81% depth#015 · needle at 27% depth#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for learned-due is: 3840862.
One of the special magic numbers for labored-pronunciation is: 4208438.
[… 817 lines omitted for display …]
One of the special magic numbers for quickest-clover is: 8199565.
One of the special magic numbers for screeching-banker is: 1200645.
One of the special magic numbers for impartial-tie is: 8316197.
One of the special magic numbers for better-copyright is: 1137737.
One of the special magic numbers for low-eicosanoid is: 3766839.
One of the special magic numbers for crooked-enactment is: 8725120.
One of the special magic numbers for various-moai is: 6535463.
One of the special magic numbers for goofy-spelt is: 7203153.
One of the special magic numbers for mute-artist is: 4116993.
One of the special magic numbers for needless-trombone is: 3472237.
One of the special magic numbers for exotic-gumshoe is: 4746293.
One of the special magic numbers for shaky-activist is: 4677585.
One of the special magic numbers for youthful-prison is: 5133859.
One of the special magic numbers for belligerent-vane is: 3483881.
[… 571 lines omitted for display …]
One of the special magic numbers for roomy-agent is: 7186758.
One of the special magic numbers for meek-prince is: 6536063.
What is the special magic number for goofy-spelt mentioned in the provided text?
Original prompt 32,204 tokens, 1,408 linesShown 20 lines around the needleNeedle at 59% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3790642Aux 20156536063Ours7203153Ours, no steer.7203153PiT-FT3790642Qwen 27B7203153
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7203153.

13 characters10 tokens

Aux 2015

Missed

7893528.

13 characters10 tokens

PiT-FT 2015

Missed

: 8702299. The special magic number for the icky-caulk is: 5583718. The special magic number for the icky-caulk is: 5583718. The special magic number for the icky-caulk is: 5583718. The special magic number for the icky-caulk is: 5583718. The special magic number for the icky-caulk is: 5583718. The special magic number for the icky-caulk is: 5583718. The

363 characters128 tokens

ChronoGPT 2015

Missed
:
 The special magic number for Equable-subordinates is:
 The special magic number for Equable-subordinates is:
 The special magic number for Equable-subordinates is

The same 55-character fragment repeats 8 times until the token limit. Showing the first three.

496 characters128 tokens