Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for economic-drain is: 4270241.
One of the special magic numbers for futuristic-aquifer is: 3059861.
[… 4,630 lines omitted for display …]
One of the special magic numbers for tiresome-phase is: 3296820.
One of the special magic numbers for watchful-operation is: 7387104.
One of the special magic numbers for difficult-definition is: 8302289.
One of the special magic numbers for guarded-cholesterol is: 4159762.
One of the special magic numbers for labored-customer is: 5060682.
One of the special magic numbers for minor-chain is: 5871723.
One of the special magic numbers for greedy-agenda is: 5965169.
One of the special magic numbers for legal-deodorant is: 3644283.
One of the special magic numbers for gleaming-broadcast is: 5643939.
One of the special magic numbers for hurt-odometer is: 9809060.
One of the special magic numbers for utter-official is: 1256701.
One of the special magic numbers for whispering-sauerkraut is: 6369784.
One of the special magic numbers for guarded-lightscreen is: 8547552.
One of the special magic numbers for acceptable-section is: 4281695.
[… 1,068 lines omitted for display …]
One of the special magic numbers for highfalutin-coke is: 3190453.
One of the special magic numbers for ceaseless-beneficiary is: 5074314.
What is the special magic number for legal-deodorant mentioned in the provided text?
Original prompt 130,484 tokens, 5,718 linesShown 20 lines around the needleNeedle at 81% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2212288Aux 20158166786Ours3644283Ours, no steer.3644283PiT-FT2212288Qwen 27B3644283
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3644283.

13 characters10 tokens

Aux 2015

Missed

4827333.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] []
193 characters128 tokens

ChronoGPT 2015

Missed

:

Wh:

The special Epicurean number for abraid-cans is:

###oho: The special Epicurean number for abraid-narrative is:

###oho: The special Watergatean number for abraid-narrative is:

###oho: The special Watergatean number for abraid-narrative is:

###oho: The special Watergatean number for abraid-narrative is:

###oho: The special Watergatean number for abraid-narrative is:

394 characters128 tokens