Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth#081 · needle at 78% depth#082 · needle at 87% depth#083 · needle at 61% depth#084 · needle at 5% depth#085 · needle at 6% depth#086 · needle at 72% depth#087 · needle at 16% depth#088 · needle at 85% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tall-chard is: 9869976.
One of the special magic numbers for tacit-hard-hat is: 8026739.
[… 2,465 lines omitted for display …]
One of the special magic numbers for assorted-hold is: 4571014.
One of the special magic numbers for rich-hackwork is: 1001707.
One of the special magic numbers for talented-realization is: 1211575.
One of the special magic numbers for shocking-licorice is: 4942277.
One of the special magic numbers for chubby-chauvinist is: 5087902.
One of the special magic numbers for entertaining-cent is: 7973908.
One of the special magic numbers for tame-semester is: 7589649.
One of the special magic numbers for dapper-marionberry is: 5248317.
One of the special magic numbers for scandalous-vomit is: 2754138.
One of the special magic numbers for abaft-nondisclosure is: 5403550.
One of the special magic numbers for ludicrous-sucker is: 5217264.
One of the special magic numbers for snotty-element is: 9265130.
One of the special magic numbers for efficient-calm is: 7583011.
One of the special magic numbers for decisive-wrapper is: 7379451.
[… 360 lines omitted for display …]
One of the special magic numbers for vigorous-counsel is: 5964576.
One of the special magic numbers for picayune-cicada is: 4001292.
What is the special magic number for dapper-marionberry mentioned in the provided text?
Original prompt 64,999 tokens, 2,845 linesShown 20 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7312258Aux 20157294470Ours5248317Ours, no steer.5248317PiT-FT7312258Qwen 27B5248317
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5248317.

13 characters10 tokens

Aux 2015

Missed

6941251.

13 characters10 tokens

PiT-FT 2015

Missed

: 7690013. The special magic number for obtaining-sauce is: 8874831. The special magic number for being a good-man is: 9872036. The special magic number for being a great-man is: 9872036. The special magic number for being a noble-man is: 9872036. The special magic number for being a successful-man is: 9872036. The special magic number for being a worthy-man is: 9872036. The special magic number for being a cheerful-man is: 9

436 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for the-cob is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf is: The special magic number for the-pilf

416 characters128 tokens