Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ceaseless-stress is: 9791033.
One of the special magic numbers for drunk-modernist is: 6845474.
[… 544 lines omitted for display …]
One of the special magic numbers for efficient-speed is: 2454460.
One of the special magic numbers for inconclusive-progenitor is: 9261091.
One of the special magic numbers for roomy-tuna is: 1090303.
One of the special magic numbers for classy-rabbi is: 5397777.
One of the special magic numbers for picayune-spiral is: 3059675.
One of the special magic numbers for exotic-innocence is: 3832574.
One of the special magic numbers for upset-directory is: 8195544.
One of the special magic numbers for short-excerpt is: 8678919.
One of the special magic numbers for dazzling-trowel is: 8638589.
One of the special magic numbers for teeny-tiny-murder is: 4740791.
One of the special magic numbers for ablaze-hare is: 2175057.
One of the special magic numbers for adjoining-attribute is: 5599438.
One of the special magic numbers for erratic-link is: 5423762.
One of the special magic numbers for rough-salt is: 6691589.
[… 844 lines omitted for display …]
One of the special magic numbers for needless-yoyo is: 4369298.
One of the special magic numbers for exuberant-rheumatism is: 3616415.
What is the special magic number for short-excerpt mentioned in the provided text?
Original prompt 32,239 tokens, 1,408 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8631071Aux 20151410094Ours8678919Ours, no steer.8678919PiT-FT8631071Qwen 27B8678919
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8678919.

13 characters10 tokens

Aux 2015

Missed

8793285.

13 characters10 tokens

PiT-FT 2015

Missed

: 7879961. The special magic number for gassy-birch is: 8872049. The special magic number for loutish-birch is: 8872049. The special magic number for giddy-sauerkraut is: 8872049. The special magic number for gassy-giraffe is: 8872049. The special magic number for lanky-sauerkraut is: 8872049. The special magic number for gassy-giraffe is: 8872049. The special

369 characters128 tokens

ChronoGPT 2015

Missed

: 8358411.<|endoftext|>

23 characters7 tokens