Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for inconclusive-offering is: 5415782.
One of the special magic numbers for sharp-mRNA is: 1132902.
[… 1,351 lines omitted for display …]
One of the special magic numbers for abnormal-monitoring is: 2836161.
One of the special magic numbers for thinkable-dame is: 8128326.
One of the special magic numbers for grieving-sunflower is: 1239847.
One of the special magic numbers for glossy-possession is: 8374527.
One of the special magic numbers for offbeat-diagnosis is: 6793924.
One of the special magic numbers for magical-contour is: 7719998.
One of the special magic numbers for laughable-brushfire is: 7038469.
One of the special magic numbers for oceanic-auction is: 7474726.
One of the special magic numbers for handsome-interest is: 5046930.
One of the special magic numbers for evasive-man is: 6408038.
One of the special magic numbers for inconclusive-subprime is: 3864683.
One of the special magic numbers for scary-start is: 6319288.
One of the special magic numbers for important-softball is: 4672919.
One of the special magic numbers for rebellious-many is: 5028807.
[… 37 lines omitted for display …]
One of the special magic numbers for cultured-sorbet is: 4938861.
One of the special magic numbers for rare-aluminium is: 1510387.
What is the special magic number for oceanic-auction mentioned in the provided text?
Original prompt 32,234 tokens, 1,408 linesShown 20 lines around the needleNeedle at 96% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3384207Aux 20156215467Ours7474726Ours, no steer.7474726PiT-FT3384207Qwen 27B7474726
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7474726.

13 characters10 tokens

Aux 2015

Missed

4948917.

13 characters10 tokens

PiT-FT 2015

Missed

: 7229280. The special magic number for icky-cauliflower mentioned in the provided text is: 8608620. The special magic number for sluggish-sauce is: 7571069. The special magic number for icky-burden is: 7571069. The special magic number for icky-carpet is: 7571069. The special magic number for icky-caulk is: 7571069. The special magic number for icky-caterpillar is: 7584072. The special magic number

409 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-accord?

Answer:

The special magic number for lopsided-accord is:

Question:

What is the special magic number for the-accord?

Answer:

The special magic number for noxious-accord is:

Question:

What is the special magic number for the-accord?

Answer:

The special magic number for noxious-accord is:

Question:

What is the special magic number for the-accord?

441 characters128 tokens