Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#026 · needle at 80% depth#027 · needle at 24% depth#028 · needle at 46% depth#029 · needle at 3% depth#030 · needle at 21% depth#031 · needle at 99% depth#032 · needle at 75% depth#033 · needle at 7% depth#034 · needle at 57% depth#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for jealous-safari is: 2301053.
One of the special magic numbers for frail-verification is: 4465135.
[… 4,271 lines omitted for display …]
One of the special magic numbers for lethal-titanium is: 7431871.
One of the special magic numbers for excellent-fact is: 2147786.
One of the special magic numbers for wholesale-suicide is: 2059837.
One of the special magic numbers for dynamic-stag is: 9148071.
One of the special magic numbers for different-conception is: 5455452.
One of the special magic numbers for petite-gland is: 9669694.
One of the special magic numbers for plucky-courthouse is: 9411648.
One of the special magic numbers for pleasant-speech is: 5370229.
One of the special magic numbers for pumped-skylight is: 4784202.
One of the special magic numbers for difficult-remnant is: 4132221.
One of the special magic numbers for noiseless-observatory is: 2660509.
One of the special magic numbers for fresh-cassava is: 5239562.
One of the special magic numbers for didactic-peanut is: 8319919.
One of the special magic numbers for testy-fulfillment is: 8302825.
[… 1,402 lines omitted for display …]
One of the special magic numbers for painstaking-lender is: 3270355.
One of the special magic numbers for threatening-stock is: 7069703.
What is the special magic number for pleasant-speech mentioned in the provided text?
Original prompt 129,783 tokens, 5,693 linesShown 20 lines around the needleNeedle at 75% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3667506Aux 20154915546Ours5370229Ours, no steer.5370229PiT-FT3667506Qwen 27B5370229
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5370229.

13 characters10 tokens

Aux 2015

Missed

4883515.

13 characters10 tokens

PiT-FT 2015

Missed

a function of the size of the e-mail server. To find the special magic number for the most important tasks, you need to use the right tool for the right job. ...(1) the size of the e-mail server RAM; (2) the size of the e-mail server RAM is a function of the size of the RAM. ...(2) the size of the e-mail server RAM is a function of the size of the RAM. ...(3) the size of the e-mail server RAM is a function of the size of the RAM. ...(4) the

445 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean Epicurean Epicurean The special Epicurean Epicurean The special Enlightenment n-pitch mentioned in theelly-cous-trick mentioned in theelly-cous-trick is:

Stupid-cous-matt is:

Drunken-cous-matt is:

Drunken-cous-matt is:

Drunken-cous-matt is:

Drunken-cous-matt is:

329 characters128 tokens