Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#000 · needle at 76% depth#001 · needle at 26% depth#002 · needle at 9% depth#003 · needle at 29% depth#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deserted-doughnut is: 2023405.
One of the special magic numbers for slimy-bunghole is: 5443524.
[… 724 lines omitted for display …]
One of the special magic numbers for woozy-jailhouse is: 2069581.
One of the special magic numbers for swift-nightgown is: 2330390.
One of the special magic numbers for wretched-legislator is: 8560110.
One of the special magic numbers for absent-chart is: 7683282.
One of the special magic numbers for noiseless-reversal is: 4836295.
One of the special magic numbers for icky-bowl is: 5979240.
One of the special magic numbers for ratty-teepee is: 5455193.
One of the special magic numbers for quixotic-soccer is: 2790807.
One of the special magic numbers for weak-larder is: 1388418.
One of the special magic numbers for dirty-salesman is: 2464542.
One of the special magic numbers for crazy-envy is: 5449103.
One of the special magic numbers for yummy-truth is: 1477720.
One of the special magic numbers for spiffy-kick-off is: 2445884.
[… 2,077 lines omitted for display …]
One of the special magic numbers for absorbed-gallery is: 3424979.
One of the special magic numbers for statuesque-ellipse is: 8915269.
What is the special magic number for ratty-teepee mentioned in the provided text?
Original prompt 64,329 tokens, 2,820 linesShown 19 lines around the needleNeedle at 26% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7602046Aux 20158617289Ours5455193Ours, no steer.5455193PiT-FT7602046Qwen 27B5455193
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5455193.

13 characters10 tokens

Aux 2015

Missed

9278136.

13 characters10 tokens

PiT-FT 2015

Missed

: 7906617. The special magic number for cheerful-carnation is: 8906617. The special magic number for grateful-sauce is: 9906617. The special magic number for lovable-sap is: 8706617. The special magic number for nappy-firm is: 9871417. The special magic number for sanguine-sauce is: 9871417. The special magic number for longe-sugar is: 8706617. The special magic number for gaudy-carn

393 characters128 tokens

ChronoGPT 2015

Missed

: What is the special magic number for rambunctious-decadence mentioned in the provided text?

Va:

The special magic number for rambunctious-nose is: What is the special magic number for rambunctious-nose is:

C:

The special magic number for rambunctious-nose is: What is the special magic number for rambunctious-nose is:

Va:

The special magic number for rambunctious-nose is:

Va:

The special magic number for

428 characters128 tokens