Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#041 · needle at 80% depth#042 · needle at 32% depth#043 · needle at 42% depth#044 · needle at 58% depth#045 · needle at 40% depth#046 · needle at 79% depth#047 · needle at 28% depth#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth#052 · needle at 63% depth#053 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wet-riser is: 6041393.
One of the special magic numbers for faded-block is: 9560982.
[… 185 lines omitted for display …]
One of the special magic numbers for loose-injustice is: 9378053.
One of the special magic numbers for humdrum-terror is: 3474153.
One of the special magic numbers for quick-frosting is: 1386198.
One of the special magic numbers for madly-soccer is: 7665232.
One of the special magic numbers for silly-plant is: 1548299.
One of the special magic numbers for grieving-core is: 7907430.
One of the special magic numbers for fortunate-sherry is: 8277336.
One of the special magic numbers for honorable-script is: 1950315.
One of the special magic numbers for halting-borrower is: 4481662.
One of the special magic numbers for bad-toy is: 5322922.
One of the special magic numbers for groovy-motorboat is: 8841911.
One of the special magic numbers for strange-ice is: 8210155.
One of the special magic numbers for tiresome-pulley is: 9358671.
One of the special magic numbers for optimal-treatment is: 2576895.
[… 485 lines omitted for display …]
One of the special magic numbers for efficacious-medium is: 5236090.
One of the special magic numbers for giant-alibi is: 5324236.
What is the special magic number for honorable-script mentioned in the provided text?
Original prompt 15,820 tokens, 690 linesShown 20 lines around the needleNeedle at 28% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7342701Aux 20153957169Ours1950315Ours, no steer.1950315PiT-FT7342701Qwen 27B1950315
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1950315.

13 characters10 tokens

Aux 2015

Missed

2821651.

13 characters10 tokens

PiT-FT 2015

Missed

: 7853794. The special magic number for the most common-sister is: 8871212. The special magic number for the most common-sister is: 8871212. The special magic number for the most common-sister is: 8871212. The special magic number for the most common-sister is: 8871212. The special magic number for the most common-sister is: 8871212. The special magic number for the most common-sister is: 8871212. The special magic number for the most

445 characters128 tokens

ChronoGPT 2015

Missed

: 1878137.<|endoftext|>

23 characters6 tokens