Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#072 · needle at 93% depth#073 · needle at 13% depth#074 · needle at 29% depth#075 · needle at 77% depth#076 · needle at 76% depth#077 · needle at 80% depth#078 · needle at 25% depth#079 · needle at 55% depth#080 · needle at 85% depth#081 · needle at 97% depth#082 · needle at 42% depth#083 · needle at 5% depth#084 · needle at 52% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for swift-platelet is: 6617954.
One of the special magic numbers for cautious-town is: 6092354.
[… 71 lines omitted for display …]
One of the special magic numbers for spectacular-testament is: 3508613.
One of the special magic numbers for observant-talking is: 5232747.
One of the special magic numbers for likeable-secretariat is: 1452812.
One of the special magic numbers for legal-cornmeal is: 7822718.
One of the special magic numbers for swanky-veldt is: 7015009.
One of the special magic numbers for unadvised-bun is: 9788625.
One of the special magic numbers for divergent-prison is: 7414875.
One of the special magic numbers for flawless-enjoyment is: 1248043.
One of the special magic numbers for breezy-dare is: 8205572.
One of the special magic numbers for solid-bride is: 2589937.
One of the special magic numbers for erratic-acquaintance is: 5639310.
One of the special magic numbers for fertile-chandelier is: 9763336.
One of the special magic numbers for unsuitable-city is: 2184696.
One of the special magic numbers for devilish-carpeting is: 6686921.
[… 239 lines omitted for display …]
One of the special magic numbers for worthless-violence is: 8863218.
One of the special magic numbers for absorbed-glucose is: 2223129.
What is the special magic number for flawless-enjoyment mentioned in the provided text?
Original prompt 7,639 tokens, 330 linesShown 20 lines around the needleNeedle at 25% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9341522Aux 20151248043Ours1248043Ours, no steer.1248043PiT-FT9341522Qwen 27B1248043
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1248043.

13 characters10 tokens

Aux 2015

Missed

:

8205572

14 characters12 tokens

PiT-FT 2015

Missed

: 7807484. The special magic number for the most-firm is: 8805732. The special magic number for the most-firm is: 8805732. The special magic number for the most-firm is: 8805732. The special magic number for the most-firm is: 8805732. The special magic number for the most-firm is: 8805732. The special magic number for the most-firm is: 8805732. The special magic number for the most-firm is: 880

404 characters128 tokens

ChronoGPT 2015

Missed

: 1345635.<|endoftext|>

23 characters6 tokens