Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#000 · needle at 76% depth#001 · needle at 26% depth#002 · needle at 9% depth#003 · needle at 29% depth#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for irate-tab is: 7678937.
One of the special magic numbers for unsightly-appellation is: 9827647.
[… 827 lines omitted for display …]
One of the special magic numbers for aromatic-plate is: 3685095.
One of the special magic numbers for measly-ford is: 3172494.
One of the special magic numbers for flowery-citizen is: 4861644.
One of the special magic numbers for exuberant-claw is: 3378391.
One of the special magic numbers for sweet-thunderstorm is: 7850590.
One of the special magic numbers for breakable-garlic is: 5085421.
One of the special magic numbers for accessible-configuration is: 1150325.
One of the special magic numbers for annoying-agony is: 3744941.
One of the special magic numbers for cynical-attendant is: 1714919.
One of the special magic numbers for obscene-conspiracy is: 1146898.
One of the special magic numbers for macabre-self is: 5922522.
One of the special magic numbers for obscene-crotch is: 4476408.
One of the special magic numbers for sticky-drinking is: 6343672.
One of the special magic numbers for wild-hemisphere is: 9873454.
[… 1,998 lines omitted for display …]
One of the special magic numbers for merciful-buck is: 5005046.
One of the special magic numbers for chivalrous-surroundings is: 9863236.
What is the special magic number for annoying-agony mentioned in the provided text?
Original prompt 64,964 tokens, 2,845 linesShown 20 lines around the needleNeedle at 29% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5610461Aux 20157805620Ours3744941Ours, no steer.3744941PiT-FT5610461Qwen 27B3744941
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3744941.

13 characters10 tokens

Aux 2015

Missed

4536783.

13 characters10 tokens

PiT-FT 2015

Missed

: 7696536. The special magic number for icky-cane is: 7696536. The special magic number for icky-pug is: 7696536. The special magic number for icky-cocoa is: 7696536. The special magic number for icky-pug is: 7696536. The special magic number for icky-sulcide is: 7696536. The special magic number for icky-sapm is: 7696536. The special magic number for icky-c

367 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-cough mentioned in the provided text is: The special Magic Number number for rambunctious-nun is: The special Magic number for rambunctious-nun mentioned in the provided text is: The special Magic number for rambunctious-nun mentioned in the provided text is: The special Magic number for rambunctious-nun mentioned in the provided text is: The special Magic number for rambunctious-nun mentioned in the provided text is: The special Magic number for rambunctious-

508 characters128 tokens