Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#032 · needle at 75% depth#033 · needle at 7% depth#034 · needle at 57% depth#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for horrible-skill is: 1338698.
One of the special magic numbers for toothsome-ascent is: 2791114.
[… 4,420 lines omitted for display …]
One of the special magic numbers for plain-filing is: 1495162.
One of the special magic numbers for ancient-lyrics is: 4197091.
One of the special magic numbers for sore-enforcement is: 1842174.
One of the special magic numbers for impartial-cell is: 5993159.
One of the special magic numbers for quack-guacamole is: 8355081.
One of the special magic numbers for shaky-lining is: 5832892.
One of the special magic numbers for laughable-softball is: 5602955.
One of the special magic numbers for obsolete-toilet is: 4571930.
One of the special magic numbers for giddy-sunlamp is: 2971842.
One of the special magic numbers for rebellious-detection is: 1726259.
One of the special magic numbers for lavish-prejudice is: 5665126.
One of the special magic numbers for nutritious-biosphere is: 3675467.
One of the special magic numbers for protective-descent is: 9650575.
One of the special magic numbers for purple-accommodation is: 4378924.
[… 1,278 lines omitted for display …]
One of the special magic numbers for melted-gearshift is: 9897149.
One of the special magic numbers for questionable-behest is: 6943347.
What is the special magic number for obsolete-toilet mentioned in the provided text?
Original prompt 130,463 tokens, 5,718 linesShown 20 lines around the needleNeedle at 77% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9524523Aux 20152410661Ours4571930Ours, no steer.4571930PiT-FT9524523Qwen 27B4571930
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4571930.

13 characters10 tokens

Aux 2015

Missed

4188084.

13 characters10 tokens

PiT-FT 2015

Missed

not in the sample you have provided. [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender]

277 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epicurean Epic

428 characters128 tokens