Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for flawless-grove is: 5720439.
One of the special magic numbers for grouchy-defender is: 2163061.
[… 1,777 lines omitted for display …]
One of the special magic numbers for flowery-environment is: 5656965.
One of the special magic numbers for cool-employer is: 2366482.
One of the special magic numbers for weak-ladder is: 3586171.
One of the special magic numbers for fuzzy-constant is: 8702216.
One of the special magic numbers for weak-syndicate is: 1650419.
One of the special magic numbers for lean-gene is: 1159458.
One of the special magic numbers for joyous-scrutiny is: 9698811.
One of the special magic numbers for absurd-increase is: 1669170.
One of the special magic numbers for nutritious-snowplow is: 7189374.
One of the special magic numbers for educated-console is: 9318822.
One of the special magic numbers for seemly-oats is: 9863995.
One of the special magic numbers for brawny-deposition is: 9266241.
One of the special magic numbers for luxuriant-rally is: 2027372.
One of the special magic numbers for rainy-philosopher is: 5881289.
[… 1,048 lines omitted for display …]
One of the special magic numbers for ambiguous-accident is: 4067990.
One of the special magic numbers for fat-plow is: 5460644.
What is the special magic number for absurd-increase mentioned in the provided text?
Original prompt 64,892 tokens, 2,845 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1696097Aux 20155582819Ours1669170Ours, no steer.1669170PiT-FT1696097Qwen 27B1669170
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1669170.

13 characters10 tokens

Aux 2015

Missed

1149181.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692069. The special magic number for the most popular-sauerkraut is: 7692069. The special magic number for the most popular-sauerkraut is: 7692069. The special magic number for the most popular-sauerkraut is: 7692069. The special magic number for the most popular-sauerkraut is: 7692069. The special magic number for the most popular-sauerkraut is: 7692069. The special magic number for the most popular-sau

416 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for hissing-letter mentioned in the provided text is: The special magic number for his delusional-letter mentioned in the provided text is: The special magic number for his delusional-letter mentioned in the provided text is: The special magic number for his delusional-letter mentioned in the provided text is: The special Magic Number number mentioned in the provided text is: The special Magic number for his delusional-letter mentioned in the provided text is: The special Magic number for his delusional-letter mentioned in the provided text is: The special Magic number for his delusional-letter mentioned in

641 characters128 tokens