Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for momentous-crackers is: 8929847.
One of the special magic numbers for nosy-magic is: 6450159.
[… 526 lines omitted for display …]
One of the special magic numbers for precious-propane is: 9963465.
One of the special magic numbers for misty-prophet is: 9017268.
One of the special magic numbers for uneven-rise is: 3658501.
One of the special magic numbers for loving-floodplain is: 9070233.
One of the special magic numbers for adventurous-mukluk is: 9065661.
One of the special magic numbers for literate-spirituality is: 6636288.
One of the special magic numbers for auspicious-baggage is: 2921184.
One of the special magic numbers for jagged-chuck is: 1311772.
One of the special magic numbers for acoustic-top is: 7202416.
One of the special magic numbers for high-pitched-confidentiality is: 2767657.
One of the special magic numbers for torpid-kitten is: 2424658.
One of the special magic numbers for worried-wall is: 1185434.
One of the special magic numbers for hard-reversal is: 1999953.
One of the special magic numbers for exotic-audience is: 5201278.
[… 119 lines omitted for display …]
One of the special magic numbers for imminent-cent is: 5809021.
One of the special magic numbers for comfortable-hamburger is: 9217686.
What is the special magic number for jagged-chuck mentioned in the provided text?
Original prompt 15,258 tokens, 665 linesShown 20 lines around the needleNeedle at 80% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2870640Aux 20152025464Ours1311772Ours, no steer.1311772PiT-FT2870640Qwen 27B1311772
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1311772.

13 characters10 tokens

Aux 2015

Missed

4678392.

13 characters10 tokens

PiT-FT 2015

Missed

: 9900262. The special magic number for the most difficult-sauce is: 8871180. The special magic number for the most difficult-sauce is: 8951180. The special magic number for the most difficult-sauce is: 8951180. The special magic number for the most difficult-sauce is: 8951180. The special magic number for the most difficult-sauce is: 8951180. The special magic number for the most difficult-sauce is: 8951180. The special

431 characters128 tokens

ChronoGPT 2015

Missed

: 7491611.<|endoftext|>

23 characters7 tokens