Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth#063 · needle at 10% depth#064 · needle at 15% depth#065 · needle at 41% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ignorant-ban is: 5157102.
One of the special magic numbers for spiritual-sophomore is: 2346910.
[… 1,844 lines omitted for display …]
One of the special magic numbers for icky-coincidence is: 8727423.
One of the special magic numbers for spiffy-aluminum is: 9324271.
One of the special magic numbers for towering-sovereignty is: 4899432.
One of the special magic numbers for grieving-migration is: 8420492.
One of the special magic numbers for evanescent-gander is: 5379332.
One of the special magic numbers for peaceful-weakness is: 5481815.
One of the special magic numbers for tall-kingdom is: 2734313.
One of the special magic numbers for aware-advertisement is: 4018402.
One of the special magic numbers for lonely-jute is: 7190439.
One of the special magic numbers for clever-outback is: 3033214.
One of the special magic numbers for sneaky-yahoo is: 2806693.
One of the special magic numbers for habitual-wild is: 9987100.
One of the special magic numbers for wrathful-hotel is: 4268550.
One of the special magic numbers for symptomatic-computer is: 4071420.
[… 981 lines omitted for display …]
One of the special magic numbers for craven-investigation is: 6327111.
One of the special magic numbers for thirsty-cut is: 8350319.
What is the special magic number for aware-advertisement mentioned in the provided text?
Original prompt 64,932 tokens, 2,845 linesShown 20 lines around the needleNeedle at 65% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3933966Aux 20158470679Ours4018402Ours, no steer.4018402PiT-FT3933966Qwen 27B4018402
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4018402.

13 characters10 tokens

Aux 2015

Missed

4138305.

13 characters10 tokens

PiT-FT 2015

Missed

: 88729. The special magic number for icky-sauce is: 68728. The special magic number for icky-sulcide is: 68728. The special magic number for icky-sap is: 68728. The special magic number for icky-sap is: 68728. The special magic number for icky-sap is: 68728. The special magic number for icky-sap is: 68728. The special magic number for icky-sap is: 68728.

365 characters128 tokens

ChronoGPT 2015

Missed
:
The special magic number for wacky-letter is:
The special magic number for wacky-letter is:
The special magic number for wacky-letter is

The same 46-character fragment repeats 9 times until the token limit. Showing the first three.

493 characters128 tokens