Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#025 · needle at 64% depth#026 · needle at 93% depth#027 · needle at 50% depth#028 · needle at 72% depth#029 · needle at 68% depth#030 · needle at 6% depth#031 · needle at 41% depth#032 · needle at 22% depth#033 · needle at 20% depth#034 · needle at 52% depth#035 · needle at 72% depth#036 · needle at 26% depth#037 · needle at 10% depth

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for guttural-feng is: 7296438.
One of the special magic numbers for axiomatic-fillet is: 2686949.
[… 118 lines omitted for display …]
One of the special magic numbers for obsequious-blast is: 7718915.
One of the special magic numbers for tiresome-infection is: 1896378.
One of the special magic numbers for piquant-doing is: 6614760.
One of the special magic numbers for upbeat-mess is: 8519541.
One of the special magic numbers for reminiscent-gesture is: 9734885.
One of the special magic numbers for tranquil-omission is: 5228602.
One of the special magic numbers for smiling-carol is: 9003810.
One of the special magic numbers for fresh-handgun is: 5103156.
One of the special magic numbers for handsome-fencing is: 8529542.
One of the special magic numbers for talented-clipper is: 1954291.
One of the special magic numbers for husky-lion is: 3704989.
One of the special magic numbers for damaged-rudiment is: 2786027.
One of the special magic numbers for powerful-kielbasa is: 3084381.
One of the special magic numbers for cold-luggage is: 5683516.
[… 167 lines omitted for display …]
One of the special magic numbers for late-rally is: 5831336.
One of the special magic numbers for dusty-fog is: 5769406.
What is the special magic number for fresh-handgun mentioned in the provided text?
Original prompt 7,087 tokens, 305 linesShown 20 lines around the needleNeedle at 41% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9101459Aux 20155103156Ours5103156Ours, no steer.5103156PiT-FT9101459Qwen 27B5103156
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5103156.

13 characters10 tokens

Aux 2015

Missed

4151929.

13 characters10 tokens

PiT-FT 2015

Missed

: 8871562. The special magic number for the most-firm is: 8881562. The special magic number for the most-firm is: 8871562. The special magic number for the most-firm is: 8881562. The special magic number for the most-firm is: 8871562. The special magic number for the most-firm is: 8871562. The special magic number for the most-firm is: 8871562. The special magic number for the most-firm is: 8

402 characters128 tokens

ChronoGPT 2015

Missed

: 4323826.<|endoftext|>

23 characters6 tokens