Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#016 · needle at 56% depth#017 · needle at 63% depth#018 · needle at 3% depth#019 · needle at 41% depth#020 · needle at 59% depth#021 · needle at 27% depth#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tame-plastic is: 5163380.
One of the special magic numbers for knowing-torte is: 9693731.
[… 319 lines omitted for display …]
One of the special magic numbers for eager-step-sister is: 3068162.
One of the special magic numbers for therapeutic-charlatan is: 7817792.
One of the special magic numbers for educated-paintwork is: 4926510.
One of the special magic numbers for ludicrous-longitude is: 6563566.
One of the special magic numbers for silly-resource is: 6598105.
One of the special magic numbers for nebulous-argument is: 8753532.
One of the special magic numbers for wandering-guard is: 9025805.
One of the special magic numbers for brief-pineapple is: 8089917.
One of the special magic numbers for bawdy-deviance is: 5673670.
One of the special magic numbers for whimsical-seller is: 8306912.
One of the special magic numbers for ragged-butter is: 7231104.
One of the special magic numbers for obtainable-photodiode is: 5503503.
One of the special magic numbers for smiling-strawman is: 6045687.
One of the special magic numbers for instinctive-squirrel is: 3745647.
[… 1,069 lines omitted for display …]
One of the special magic numbers for honorable-espadrille is: 7077401.
One of the special magic numbers for brawny-match is: 5009696.
What is the special magic number for brief-pineapple mentioned in the provided text?
Original prompt 32,219 tokens, 1,408 linesShown 20 lines around the needleNeedle at 23% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1570756Aux 20155009696Ours8089917Ours, no steer.8089917PiT-FT1570756Qwen 27B8089917
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8089917.

13 characters10 tokens

Aux 2015

Missed

7924749.

13 characters10 tokens

PiT-FT 2015

Missed

: 7697700. The special magic number for dubious-cough is: 8078146. The special magic number for anxious-sanguine is: 8692039. The special magic number for gassy-cauliflower is: 6692039. The special magic number for gaudy-gourd is: 8704433. The special magic number for loutish-cough is: 8572888. The special magic number for giddy-gourd is: 8704433. The special magic number for cheerful-caul

399 characters128 tokens

ChronoGPT 2015

Missed

:<|endoftext|>

14 characters2 tokens