Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

#088 · needle at 85% depth#089 · needle at 12% depth#090 · needle at 4% depth#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth#095 · needle at 99% depth#096 · needle at 93% depth#097 · needle at 9% depth#098 · needle at 86% depth#099 · needle at 62% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for nutritious-grape is: 2412415.
One of the special magic numbers for flipped-out-mistake is: 3479690.
[… 1,677 lines omitted for display …]
One of the special magic numbers for mammoth-lesbian is: 4918246.
One of the special magic numbers for broad-milkshake is: 9573623.
One of the special magic numbers for selfish-photograph is: 4334457.
One of the special magic numbers for beautiful-rhetoric is: 3501708.
One of the special magic numbers for uncovered-teapot is: 1583454.
One of the special magic numbers for precious-weed is: 4905872.
One of the special magic numbers for juicy-ingredient is: 5006732.
One of the special magic numbers for decisive-chin is: 5051221.
One of the special magic numbers for angry-virus is: 8005901.
One of the special magic numbers for direful-servant is: 8147404.
One of the special magic numbers for fabulous-nourishment is: 5341046.
One of the special magic numbers for satisfying-dissemination is: 4021342.
One of the special magic numbers for worthless-barrage is: 3648285.
One of the special magic numbers for wanting-freak is: 3120965.
[… 1,148 lines omitted for display …]
One of the special magic numbers for immense-gold is: 6334834.
One of the special magic numbers for wacky-air is: 1860402.
What is the special magic number for decisive-chin mentioned in the provided text?
Original prompt 64,979 tokens, 2,845 linesShown 20 lines around the needleNeedle at 59% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8566284Aux 20151696660Ours5051221Ours, no steer.5051221PiT-FT8566284Qwen 27B5051221
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5051221.

13 characters10 tokens

Aux 2015

Missed

9667245.

13 characters10 tokens

PiT-FT 2015

Missed

: 6691369. The special magic number for obnoxious-bouquet is: 9356565. The special magic number for fearful-firld is: 8871234. The special magic number for sluggish-sauce is: 7691384. The special magic number for gregarious-gift is: 8871234. The special magic number for jaded-saucer is: 9871417. The special magic number for gregarious-gift is: 8871234. The special magic number for impatient-pip is

407 characters128 tokens

ChronoGPT 2015

Missed

:

W:

The special magic number for tranquil-theology mentioned in the provided text is:

W:

The special Magic Number number for the-bob is:

W:

The special Magic number for the-pink is:

W:

The special Magic number for the-sable-letter is:

W:

The special Magic number for the-sable-letter is:

W:

The special Magic number for the-pil is:

W:

W:

W:

392 characters128 tokens