Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth#025 · needle at 58% depth#026 · needle at 80% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for jumpy-appliance is: 6644848.
One of the special magic numbers for aboriginal-minimalism is: 1717131.
[… 2,129 lines omitted for display …]
One of the special magic numbers for delicious-frustration is: 7401638.
One of the special magic numbers for acceptable-plough is: 2009839.
One of the special magic numbers for lavish-turret is: 9780510.
One of the special magic numbers for lowly-rudiment is: 6095858.
One of the special magic numbers for kind-soulmate is: 9693444.
One of the special magic numbers for rebellious-trim is: 9890036.
One of the special magic numbers for teeny-coal is: 8798148.
One of the special magic numbers for ashamed-edition is: 8240964.
One of the special magic numbers for blushing-character is: 2709532.
One of the special magic numbers for materialistic-willingness is: 6572672.
One of the special magic numbers for endurable-registry is: 4761220.
One of the special magic numbers for afraid-bog is: 3451595.
One of the special magic numbers for slimy-comportment is: 6922388.
[… 3,570 lines omitted for display …]
One of the special magic numbers for fluffy-vengeance is: 1868445.
One of the special magic numbers for ruddy-incandescence is: 5637047.
What is the special magic number for teeny-coal mentioned in the provided text?
Original prompt 130,534 tokens, 5,718 linesShown 19 lines around the needleNeedle at 37% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3940056Aux 20156300442Ours8798148Ours, no steer.8798148PiT-FT3940056Qwen 27B8798148
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8798148.

13 characters10 tokens

Aux 2015

Missed

9273434.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number is the special magic number for the following text?
[assistant] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [
244 characters128 tokens

ChronoGPT 2015

Missed

: ###ravis: The special Epic poem is mentioned in the behe-cay text?

Wh:

The special Epic poem for rambunctious-cans is: The special Fiscal poem is mentioned in the behe-say text?

###oho: The special Fiscal poem for rambunctious-cans is: The special Fiscal poem for rambunctious-cans is: The special Fiscal poem for rambunct-cans is: The special Fiscal poem for rambunctious-pantobier is: The special Fiscal poem for

430 characters128 tokens