Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth#030 · needle at 21% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elegant-tailspin is: 5660688.
One of the special magic numbers for melodic-cent is: 6322679.
[… 607 lines omitted for display …]
One of the special magic numbers for perpetual-fresco is: 4845732.
One of the special magic numbers for concerned-mining is: 4047862.
One of the special magic numbers for hospitable-chocolate is: 2700248.
One of the special magic numbers for plausible-chives is: 2235063.
One of the special magic numbers for small-swimming is: 7436988.
One of the special magic numbers for whispering-turmeric is: 6221795.
One of the special magic numbers for rough-aftershave is: 2421323.
One of the special magic numbers for disillusioned-abbey is: 2873804.
One of the special magic numbers for likeable-faithful is: 1756154.
One of the special magic numbers for sneaky-string is: 1460025.
One of the special magic numbers for callous-knowledge is: 7505228.
One of the special magic numbers for gaudy-spark is: 4263661.
One of the special magic numbers for late-entrance is: 7095563.
[… 5,092 lines omitted for display …]
One of the special magic numbers for hospitable-misunderstand is: 9042483.
One of the special magic numbers for psychotic-escape is: 8798094.
What is the special magic number for rough-aftershave mentioned in the provided text?
Original prompt 130,429 tokens, 5,718 linesShown 19 lines around the needleNeedle at 11% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5539130Aux 20154062270Ours2421323Ours, no steer.2421323PiT-FT5539130Qwen 27B2421323
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2421323.

13 characters10 tokens

Aux 2015

Missed

9090196.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What is the special magic number for the following:
[] [
[
][
[sys|tem|]
The special magic numbers for the following are:
[] [
[
][
[sys|tem|]
<|counselor|>
ccounselor has issued a new set of the special magic numbers.
9022072 - [] [] - []
9040070 - [] [] - []
9354330 - [] [] - []
9551121 - []
302 characters128 tokens

ChronoGPT 2015

Missed


###


###


###

The same 6-character fragment repeats 32 times until the token limit. Showing the first three.

192 characters128 tokens