Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for teeny-tiny-tofu is: 3595503.
One of the special magic numbers for graceful-duel is: 3888053.
[… 292 lines omitted for display …]
One of the special magic numbers for empty-oats is: 1996806.
One of the special magic numbers for bored-forestry is: 6151863.
One of the special magic numbers for empty-irrigation is: 9290752.
One of the special magic numbers for murky-poverty is: 4726229.
One of the special magic numbers for materialistic-hormone is: 6101202.
One of the special magic numbers for ossified-apparel is: 8063360.
One of the special magic numbers for hot-alibi is: 5030963.
One of the special magic numbers for imaginary-typeface is: 7329031.
One of the special magic numbers for slow-recess is: 1214684.
One of the special magic numbers for incompetent-curriculum is: 9252763.
One of the special magic numbers for hungry-horseradish is: 5715130.
One of the special magic numbers for jobless-zucchini is: 3993634.
One of the special magic numbers for eminent-patty is: 4595163.
One of the special magic numbers for finicky-folk is: 8308674.
[… 1,071 lines omitted for display …]
One of the special magic numbers for aspiring-sister is: 6545990.
One of the special magic numbers for fallacious-saw is: 4053412.
What is the special magic number for imaginary-typeface mentioned in the provided text?
Original prompt 31,744 tokens, 1,383 linesShown 20 lines around the needleNeedle at 22% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9554077Aux 20153623100Ours7329031Ours, no steer.7329031PiT-FT9554077Qwen 27B7329031
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7329031.

13 characters10 tokens

Aux 2015

Missed

7942072.

13 characters10 tokens

PiT-FT 2015

Missed

: 8870059. The special magic number for the most recent-snowplow is: 8870059. The special magic number for the most recent-snowplow mentioned in the provided text is: 8870059. The special magic number for the most recent-snowplow mentioned in the provided text is: 8870059. The special magic number for the most recent-snowplow mentioned in the provided text is: 8870059. The special magic number for the most recent-snowplow mentioned in the provided text is: 887

469 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for wort-writing?

Answer:

The special magic number for wort-writing is:

Question:

What is the special magic number for wort-writing?

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

Final Answer:

The final answer is:

434 characters128 tokens