Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#050 · needle at 92% depth#051 · needle at 87% depth#052 · needle at 72% depth#053 · needle at 33% depth#054 · needle at 10% depth#055 · needle at 3% depth#056 · needle at 67% depth#057 · needle at 20% depth#058 · needle at 66% depth#059 · needle at 7% depth#060 · needle at 24% depth#061 · needle at 10% depth#062 · needle at 61% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for straight-stereo is: 1754659.
One of the special magic numbers for adaptable-millet is: 4629446.
[… 91 lines omitted for display …]
One of the special magic numbers for ceaseless-destruction is: 1777742.
One of the special magic numbers for boiling-hatchling is: 2910451.
One of the special magic numbers for expensive-utilisation is: 5295403.
One of the special magic numbers for roasted-recruit is: 6146365.
One of the special magic numbers for exultant-obedience is: 4751841.
One of the special magic numbers for smelly-edition is: 2694981.
One of the special magic numbers for enchanting-anteater is: 4822267.
One of the special magic numbers for capable-passing is: 6010189.
One of the special magic numbers for testy-salsa is: 3924425.
One of the special magic numbers for lavish-rocket-ship is: 4045659.
One of the special magic numbers for rare-law is: 7355753.
One of the special magic numbers for cooing-gravy is: 4601686.
One of the special magic numbers for different-soy is: 5081174.
One of the special magic numbers for zany-minister is: 5264147.
[… 35 lines omitted for display …]
One of the special magic numbers for difficult-white is: 5840958.
One of the special magic numbers for nutty-canteen is: 5543184.
What is the special magic number for capable-passing mentioned in the provided text?
Original prompt 3,466 tokens, 146 linesShown 20 lines around the needleNeedle at 67% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1364534Aux 20156010189Ours6010189Ours, no steer.6010189PiT-FT1364534Qwen 27B6010189
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6010189.

13 characters10 tokens

Aux 2015

Missed

:

6982910

14 characters12 tokens

PiT-FT 2015

Missed

: 7058451. The special magic number for quick-bought is: 708857. The special magic number for quick-bought mentioned in the provided text is: 7058451. The special magic number for quick-bought mentioned in the provided text is: 708857. The special magic number for quick-bought mentioned in the provided text is: 7058451. The special magic number for quick-bought mentioned in the provided text is: 708857. The special magic number for quick-bought mentioned in the provided text is:

489 characters128 tokens

ChronoGPT 2015

Missed

: 7278881.<|endoftext|>

23 characters7 tokens