Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#007 · needle at 2% depth#008 · needle at 76% depth#009 · needle at 86% depth#010 · needle at 60% depth#011 · needle at 86% depth#012 · needle at 24% depth#013 · needle at 58% depth#014 · needle at 60% depth#015 · needle at 6% depth#016 · needle at 56% depth#017 · needle at 48% depth#018 · needle at 34% depth#019 · needle at 88% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for imminent-movement is: 3882234.
One of the special magic numbers for grieving-stepmother is: 9610837.
[… 185 lines omitted for display …]
One of the special magic numbers for defiant-prosperity is: 2232154.
One of the special magic numbers for half-good is: 6582253.
One of the special magic numbers for venomous-payee is: 6367876.
One of the special magic numbers for sneaky-labourer is: 5014016.
One of the special magic numbers for woebegone-synthesis is: 9079852.
One of the special magic numbers for nonstop-inlay is: 7876654.
One of the special magic numbers for crazy-placode is: 6075879.
One of the special magic numbers for friendly-sponsorship is: 1146741.
One of the special magic numbers for whispering-bonus is: 4519388.
One of the special magic numbers for peaceful-fairy is: 1567676.
One of the special magic numbers for lazy-keyboarding is: 3626153.
One of the special magic numbers for magenta-fry is: 4212645.
One of the special magic numbers for jobless-speculation is: 2108224.
One of the special magic numbers for apathetic-lapdog is: 1526460.
[… 125 lines omitted for display …]
One of the special magic numbers for hilarious-exasperation is: 3297127.
One of the special magic numbers for wacky-runway is: 5333242.
What is the special magic number for friendly-sponsorship mentioned in the provided text?
Original prompt 7,662 tokens, 330 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8464479Aux 20151146741Ours1146741Ours, no steer.1146741PiT-FT8464479Qwen 27B1146741
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1146741.

13 characters10 tokens

Aux 2015

Missed

7440597.

13 characters10 tokens

PiT-FT 2015

Missed

: 3353515. <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|ass

254 characters128 tokens

ChronoGPT 2015

Missed

: 7298799.<|endoftext|>

23 characters7 tokens