Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#040 · needle at 29% depth#041 · needle at 58% depth#042 · needle at 89% depth#043 · needle at 18% depth#044 · needle at 28% depth#045 · needle at 87% depth#046 · needle at 82% depth#047 · needle at 57% depth#048 · needle at 50% depth#049 · needle at 70% depth#050 · needle at 75% depth#051 · needle at 88% depth#052 · needle at 41% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for utter-scorpion is: 1284865.
One of the special magic numbers for reflective-fatigue is: 7087122.
[… 265 lines omitted for display …]
One of the special magic numbers for foregoing-pimple is: 1217084.
One of the special magic numbers for exultant-schoolhouse is: 8006932.
One of the special magic numbers for abrupt-angstrom is: 7342985.
One of the special magic numbers for noxious-pay is: 9200758.
One of the special magic numbers for rich-girlfriend is: 9089545.
One of the special magic numbers for colorful-accessory is: 3847893.
One of the special magic numbers for gorgeous-frown is: 8921344.
One of the special magic numbers for fresh-implementation is: 8829774.
One of the special magic numbers for ugliest-employee is: 3935465.
One of the special magic numbers for loud-median is: 6429596.
One of the special magic numbers for jagged-lunch is: 8807021.
One of the special magic numbers for beautiful-feel is: 4176646.
One of the special magic numbers for merciful-sensitive is: 5727885.
One of the special magic numbers for smelly-posterior is: 7949242.
[… 45 lines omitted for display …]
One of the special magic numbers for righteous-carabao is: 3239368.
One of the special magic numbers for meek-rule is: 4227575.
What is the special magic number for fresh-implementation mentioned in the provided text?
Original prompt 7,654 tokens, 330 linesShown 20 lines around the needleNeedle at 82% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6391974Aux 20158829774Ours8829774Ours, no steer.8829774PiT-FT6391974Qwen 27B8829774
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8829774.

13 characters10 tokens

Aux 2015

Missed

4839960.

13 characters10 tokens

PiT-FT 2015

Missed
: 7582566.
 The special magic number for the most-frequent is: 7582566.
 The special magic number for the most-frequent is: 7582566.
 The special magic number for the most-frequent is

The same 61-character fragment repeats 7 times until the token limit. Showing the first three.

430 characters128 tokens

ChronoGPT 2015

Missed

: 2310368.<|endoftext|>

23 characters6 tokens