Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth#029 · needle at 30% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for jobless-meatball is: 2450646.
One of the special magic numbers for ceaseless-buffer is: 1022943.
[… 1,884 lines omitted for display …]
One of the special magic numbers for pleasant-nation is: 6739292.
One of the special magic numbers for swift-outback is: 6365605.
One of the special magic numbers for harsh-midwife is: 2409454.
One of the special magic numbers for voracious-skunk is: 1400741.
One of the special magic numbers for faint-nothing is: 1926156.
One of the special magic numbers for odd-soap is: 5783113.
One of the special magic numbers for wry-foray is: 5098105.
One of the special magic numbers for mundane-traffic is: 1567211.
One of the special magic numbers for greedy-worker is: 6425032.
One of the special magic numbers for ludicrous-dolphin is: 2704811.
One of the special magic numbers for fair-romance is: 8013570.
One of the special magic numbers for eatable-login is: 2455359.
One of the special magic numbers for bitter-spiritual is: 1230751.
One of the special magic numbers for large-script is: 6190041.
[… 941 lines omitted for display …]
One of the special magic numbers for rebellious-chord is: 3901395.
One of the special magic numbers for political-nail is: 1851385.
What is the special magic number for mundane-traffic mentioned in the provided text?
Original prompt 64,998 tokens, 2,845 linesShown 20 lines around the needleNeedle at 66% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5444483Aux 20159686629Ours1567211Ours, no steer.1567211PiT-FT5444483Qwen 27B1567211
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1567211.

13 characters10 tokens

Aux 2015

Missed

7536074.

13 characters10 tokens

PiT-FT 2015

Missed

: 7906566. The special magic number for the most important-counsel is: 8102072. The special magic number for the most common-carnival is: 7696511. The special magic number for the most common-carnival is: 7696511. The special magic number for the most common-sorbet is: 7696511. The special magic number for the most common-sulb is: 7696511. The special magic number for the most common-sulb is: 7696511. The

415 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-rhyme is: The special Magic Number number mentioned in the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is

578 characters128 tokens