Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth#084 · needle at 48% depth#085 · needle at 9% depth#086 · needle at 34% depth#087 · needle at 9% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wanting-desire is: 8070766.
One of the special magic numbers for sparkling-pathogenesis is: 3536408.
[… 558 lines omitted for display …]
One of the special magic numbers for grieving-acid is: 9468106.
One of the special magic numbers for vague-porch is: 4570384.
One of the special magic numbers for eminent-plagiarism is: 1808992.
One of the special magic numbers for dirty-ordinary is: 6812552.
One of the special magic numbers for vague-discount is: 7540207.
One of the special magic numbers for gaping-wampum is: 8387211.
One of the special magic numbers for better-zephyr is: 4950656.
One of the special magic numbers for absorbing-hurry is: 4536491.
One of the special magic numbers for screeching-efficiency is: 5250398.
One of the special magic numbers for enchanting-archaeology is: 3640095.
One of the special magic numbers for nondescript-doctrine is: 7748205.
One of the special magic numbers for receptive-biplane is: 4765977.
One of the special magic numbers for endurable-ford is: 1267438.
One of the special magic numbers for beautiful-equipment is: 2887397.
[… 830 lines omitted for display …]
One of the special magic numbers for innate-deficit is: 3525563.
One of the special magic numbers for scintillating-fusarium is: 2147169.
What is the special magic number for absorbing-hurry mentioned in the provided text?
Original prompt 32,249 tokens, 1,408 linesShown 20 lines around the needleNeedle at 40% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7421208Aux 20153148177Ours4536491Ours, no steer.4536491PiT-FT7421208Qwen 27B4536491
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4536491.

13 characters10 tokens

Aux 2015

Missed

7846139.

13 characters10 tokens

PiT-FT 2015

Missed

: 7581314. The special magic number for the most popular-sauce is: 8221265. The special magic number for the most popular-sauce is: 8221265. The special magic number for the most popular-sauce is: 8221265. The special magic number for the most popular-sauce is: 8221265. The special magic number for the most popular-sauce is: 8221265. The special magic number for the most popular-sauce is: 8221265. The

411 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-fairy?

Answer:

Question:

What is the special magic number for the-crate?

Answer:

Question:

What is the special magic number for the-crate?

Answer:

Question:

What is the special magic number for the-crate?

Question:

What is the special magic number for legal-bank?

Answer:

Question:

What is the special magic number for legal-bank?

434 characters128 tokens