Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for jazzy-empowerment is: 4720751.
One of the special magic numbers for successful-coffin is: 3723792.
[… 765 lines omitted for display …]
One of the special magic numbers for noxious-apple is: 8820348.
One of the special magic numbers for telling-column is: 6070962.
One of the special magic numbers for whimsical-key is: 8114009.
One of the special magic numbers for shiny-liability is: 2564775.
One of the special magic numbers for ad hoc-overview is: 3056885.
One of the special magic numbers for alluring-episode is: 8298184.
One of the special magic numbers for slow-porthole is: 8221891.
One of the special magic numbers for thankful-calibre is: 3878214.
One of the special magic numbers for amused-plum is: 6535429.
One of the special magic numbers for afraid-relish is: 8207261.
One of the special magic numbers for credible-coinsurance is: 3159836.
One of the special magic numbers for dizzy-trapdoor is: 7239542.
One of the special magic numbers for hurt-promise is: 5274542.
One of the special magic numbers for grotesque-rag is: 7127345.
[… 623 lines omitted for display …]
One of the special magic numbers for laughable-exasperation is: 7137394.
One of the special magic numbers for gentle-water is: 7904465.
What is the special magic number for thankful-calibre mentioned in the provided text?
Original prompt 32,231 tokens, 1,408 linesShown 20 lines around the needleNeedle at 55% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9672202Aux 20155617822Ours3878214Ours, no steer.3878214PiT-FT9672202Qwen 27B3878214
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3878214.

13 characters10 tokens

Aux 2015

Found the needle

5617822.

13 characters10 tokens

PiT-FT 2015

Missed

: 6571402. The special magic number for icky-saucer is: 7693351. The special magic number for loutish-tear is: 7693351. The special magic number for icky-tearp is: 7693351. The special magic number for icky-terep is: 7693351. The special magic number for icky-terep is: 7693351. The special magic number for icky-terep is: 7693351. The special magic number for icky

372 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-fantasy?

Answer:

The special magic number for legal-fried is:

Question:

What is the special magic number for the-fantasy?

Answer:

The special magic number for the-fantasy is:

Answer:

The special magic number for the-fantasy is:

Question:

What is the special magic number for the-fantasy?

Answer:

The special magic number for the-fantasy is:

Question:

444 characters128 tokens