Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#043 · needle at 49% depth#044 · needle at 50% depth#045 · needle at 36% depth#046 · needle at 27% depth#047 · needle at 2% depth#048 · needle at 27% depth#049 · needle at 71% depth#050 · needle at 92% depth#051 · needle at 87% depth#052 · needle at 72% depth#053 · needle at 33% depth#054 · needle at 10% depth#055 · needle at 3% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for courageous-exposure is: 7814800.
One of the special magic numbers for abandoned-doorbell is: 1388269.
[… 98 lines omitted for display …]
One of the special magic numbers for decisive-linseed is: 8378720.
One of the special magic numbers for mute-cottage is: 4670234.
One of the special magic numbers for teeny-cope is: 6030577.
One of the special magic numbers for lucky-legging is: 1422000.
One of the special magic numbers for cloistered-horror is: 2478283.
One of the special magic numbers for industrious-rooster is: 4969452.
One of the special magic numbers for abject-insomnia is: 7139638.
One of the special magic numbers for craven-backbone is: 5229914.
One of the special magic numbers for puffy-joy is: 4438621.
One of the special magic numbers for yummy-disease is: 6186301.
One of the special magic numbers for premium-expertise is: 3498140.
One of the special magic numbers for gigantic-underpass is: 4940606.
One of the special magic numbers for jumpy-mitten is: 8077565.
One of the special magic numbers for breakable-rivulet is: 9240448.
[… 28 lines omitted for display …]
One of the special magic numbers for fabulous-bottling is: 6160663.
One of the special magic numbers for assorted-fob is: 6154607.
What is the special magic number for craven-backbone mentioned in the provided text?
Original prompt 3,469 tokens, 146 linesShown 20 lines around the needleNeedle at 71% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8741856Aux 20155229914Ours5229914Ours, no steer.5229914PiT-FT8741856Qwen 27B5229914
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5229914.

13 characters10 tokens

Aux 2015

Missed

9546111.

13 characters10 tokens

PiT-FT 2015

Missed

: <|assistant|>

<|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|>

255 characters128 tokens

ChronoGPT 2015

Missed

: 7290592.<|endoftext|>

23 characters7 tokens