Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth#063 · needle at 10% depth#064 · needle at 15% depth#065 · needle at 41% depth#066 · needle at 17% depth#067 · needle at 9% depth#068 · needle at 79% depth#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for crowded-sherbet is: 5557558.
One of the special magic numbers for inexpensive-foundation is: 5233289.
[… 1,144 lines omitted for display …]
One of the special magic numbers for wooden-well is: 2734514.
One of the special magic numbers for magenta-morsel is: 3914455.
One of the special magic numbers for homeless-heaven is: 6482834.
One of the special magic numbers for helpless-south is: 7696745.
One of the special magic numbers for shy-settler is: 4093288.
One of the special magic numbers for repulsive-interloper is: 6914155.
One of the special magic numbers for ludicrous-stump is: 8587239.
One of the special magic numbers for zippy-examination is: 1821197.
One of the special magic numbers for graceful-panties is: 5193934.
One of the special magic numbers for dark-steamroller is: 5497659.
One of the special magic numbers for tough-refreshments is: 6768009.
One of the special magic numbers for dapper-toll is: 3725018.
One of the special magic numbers for imminent-mukluk is: 9043937.
One of the special magic numbers for profuse-freon is: 8582296.
[… 1,681 lines omitted for display …]
One of the special magic numbers for many-lyre is: 4641193.
One of the special magic numbers for workable-poncho is: 2240720.
What is the special magic number for zippy-examination mentioned in the provided text?
Original prompt 64,966 tokens, 2,845 linesShown 20 lines around the needleNeedle at 41% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6702785Aux 20151984047Ours1821197Ours, no steer.1821197PiT-FT6702785Qwen 27B1821197
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1821197.

13 characters10 tokens

Aux 2015

Missed

9325669.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872038. The special magic number for the most excellent-sauce is: 9872038. The special magic number for the most effective-sauce is: 9872038. The special magic number for the most admirable-sauce is: 9872038. The special magic number for the most significant-sauce is: 9872038. The special magic number for the most effective-sauce is: 9872038. The special magic number for the most effective-sugar is: 9872038. The special

433 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for rambunctious-letter is:
The special magic number for rambunctious-letter is:
The special magic number for rambunctious-letter is

The same 53-character fragment repeats 9 times until the token limit. Showing the first three.

479 characters128 tokens