Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#071 · needle at 93% depth#072 · needle at 42% depth#073 · needle at 34% depth#074 · needle at 48% depth#075 · needle at 9% depth#076 · needle at 54% depth#077 · needle at 25% depth#078 · needle at 7% depth#079 · needle at 34% depth#080 · needle at 36% depth#081 · needle at 40% depth#082 · needle at 19% depth#083 · needle at 83% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for phobic-decency is: 7093616.
One of the special magic numbers for wealthy-carnival is: 9234470.
[… 344 lines omitted for display …]
One of the special magic numbers for confused-rise is: 8680339.
One of the special magic numbers for mysterious-stopsign is: 9343986.
One of the special magic numbers for productive-suspenders is: 6135201.
One of the special magic numbers for tall-keystone is: 5594020.
One of the special magic numbers for loose-gravel is: 9462490.
One of the special magic numbers for receptive-nectar is: 7326606.
One of the special magic numbers for quick-rainbow is: 2178785.
One of the special magic numbers for fragile-meantime is: 5308584.
One of the special magic numbers for materialistic-diarist is: 9406567.
One of the special magic numbers for overconfident-alibi is: 8551659.
One of the special magic numbers for evil-chalet is: 5082568.
One of the special magic numbers for light-ectodermal is: 6446426.
One of the special magic numbers for wide-eyed-abundance is: 7386912.
One of the special magic numbers for real-bacterium is: 2009633.
[… 1,044 lines omitted for display …]
One of the special magic numbers for roomy-den is: 2012991.
One of the special magic numbers for deeply-snowman is: 6407821.
What is the special magic number for fragile-meantime mentioned in the provided text?
Original prompt 32,224 tokens, 1,408 linesShown 20 lines around the needleNeedle at 25% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6679312Aux 20155532794Ours5308584Ours, no steer.5308584PiT-FT6679312Qwen 27B5308584
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5308584.

13 characters10 tokens

Aux 2015

Missed

4212795.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692841. The special magic number for awkward-pugil is: 8871533. The special magic number for giddy-bob is: 8692042. The special magic number for sluggish-sauerkraut is: 8872028. The special magic number for gassy-pugil is: 8872028. The special magic number for cheerful-caulk is: 8692042. The special magic number for lopsided-sauerk is: 8872028. The special magic number for jaded-

392 characters128 tokens

ChronoGPT 2015

Missed

: 1885002. The special magic number for brewed-foodstuffs mentioned in the provided text is: 18850114. The special magic number for brewed-Plant is: 18850115. The special magic number for brewed-Plant is: 18850114. The special magic number for soggy-Plant is: 18850115. The special magic number for sordid-Plant is: 18850115. The special magic number for sordid-Plant is: 18850115. The special magic number for sordid

417 characters128 tokens