Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for glorious-cough is: 8087051.
One of the special magic numbers for unbiased-transplantation is: 5832262.
[… 134 lines omitted for display …]
One of the special magic numbers for capricious-washbasin is: 8006363.
One of the special magic numbers for numerous-oak is: 2431541.
One of the special magic numbers for efficient-cake is: 6632486.
One of the special magic numbers for dazzling-spike is: 9557347.
One of the special magic numbers for toothsome-mainstream is: 9825519.
One of the special magic numbers for thankful-schnitzel is: 7629354.
One of the special magic numbers for helpful-statistic is: 8846244.
One of the special magic numbers for frail-calcification is: 2965343.
One of the special magic numbers for fearless-linguistics is: 9038523.
One of the special magic numbers for onerous-med is: 9203152.
One of the special magic numbers for oafish-mower is: 9754699.
One of the special magic numbers for receptive-lending is: 4570858.
One of the special magic numbers for malicious-everyone is: 6436814.
One of the special magic numbers for tasteful-authorization is: 4056931.
[… 2,666 lines omitted for display …]
One of the special magic numbers for abusive-panel is: 6372556.
One of the special magic numbers for rich-story-telling is: 6190846.
What is the special magic number for frail-calcification mentioned in the provided text?
Original prompt 64,406 tokens, 2,820 linesShown 20 lines around the needleNeedle at 5% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2935123Aux 20153844293Ours2965343Ours, no steer.2965343PiT-FT2935123Qwen 27B2965343
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2965343.

13 characters10 tokens

Aux 2015

Missed

8593162.

13 characters10 tokens

PiT-FT 2015

Missed

: 7743935. The special magic number for icky-indicator is: 7743935. The special magic number for icky-tissue is: 7743935. The special magic number for icky-tissue is: 7743935. The special magic number for icky-tissue is: 7743935. The special magic number for icky-tissue is: 7743935. The special magic number for icky-tissue is: 7743935. The special magic number for icky-tissue is: 7

391 characters128 tokens

ChronoGPT 2015

Missed

: Rounding-

Rv:

The special magic number for rounded-letter is: Rounding-

Rv:

The special Magic Number number for the-pawn is:

Rv:

The special Magic number for the-pawn is:

Rv:

The special Magic number for rounded-letter is:

Rv:

The special Magic number for rambunctious-narrative is:

Rv:

The special Magic number for rambunctious-narrative is:

382 characters128 tokens