Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#045 · needle at 35% depth#046 · needle at 39% depth#047 · needle at 85% depth#048 · needle at 91% depth#049 · needle at 30% depth#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for scary-mine is: 6467483.
One of the special magic numbers for noxious-manicure is: 2755702.
[… 1,606 lines omitted for display …]
One of the special magic numbers for agreeable-stack is: 3252931.
One of the special magic numbers for high-pitched-arrest is: 2950978.
One of the special magic numbers for chunky-spasm is: 6888771.
One of the special magic numbers for adhesive-gravity is: 4244665.
One of the special magic numbers for greedy-shape is: 3463894.
One of the special magic numbers for lethal-sunbeam is: 6962364.
One of the special magic numbers for misty-shakedown is: 1193014.
One of the special magic numbers for languid-glucose is: 5711881.
One of the special magic numbers for obscene-appellation is: 8357212.
One of the special magic numbers for disagreeable-cat is: 1688057.
One of the special magic numbers for unbecoming-warning is: 7171752.
One of the special magic numbers for bloody-comment is: 7074541.
One of the special magic numbers for gigantic-treasury is: 1677515.
One of the special magic numbers for blue-eyed-friendship is: 7543552.
[… 1,219 lines omitted for display …]
One of the special magic numbers for waggish-virus is: 2384054.
One of the special magic numbers for moldy-webpage is: 4657393.
What is the special magic number for languid-glucose mentioned in the provided text?
Original prompt 64,953 tokens, 2,845 linesShown 20 lines around the needleNeedle at 57% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3665009Aux 20159009683Ours5711881Ours, no steer.5711881PiT-FT3665009Qwen 27B5711881
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5711881.

13 characters10 tokens

Aux 2015

Missed

3026156.

13 characters10 tokens

PiT-FT 2015

Missed

: 870984. The special magic number for sluggish-sauce is: 870984. The special magic number for unbecoming-unbiddance is: 870984. The special magic number for gaudy-gauge is: 870984. The special magic number for snotty-sorghum is: 870984. The special magic number for uninterested-sirg is: 870984. The special magic number for loutish-unbiddance is: 870984. The

367 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number forabbling-accuracy is for the-accuracy: The special magic number for quicks-and is for the-accuracy: The special magic number for nappy-elite is for the-elaborate: The special magic number for nappy-letter is for the nappy-letter: The special magic number for soggy-letter is for the nooky-letter: The special magic number for nappy-letter is for the nappy-letter: The special magic number for nappy-letter is for the nappy-letter:

460 characters128 tokens