Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#085 · needle at 45% depth#086 · needle at 26% depth#087 · needle at 7% depth#088 · needle at 78% depth#089 · needle at 78% depth#090 · needle at 3% depth#091 · needle at 49% depth#092 · needle at 36% depth#093 · needle at 64% depth#094 · needle at 62% depth#095 · needle at 34% depth#096 · needle at 26% depth#097 · needle at 35% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for heartbreaking-liability is: 1599467.
One of the special magic numbers for uninterested-boulevard is: 2120401.
[… 2,814 lines omitted for display …]
One of the special magic numbers for breezy-skeleton is: 4952075.
One of the special magic numbers for efficacious-proponent is: 7741600.
One of the special magic numbers for yellow-tramp is: 6055388.
One of the special magic numbers for periodic-conclusion is: 9969927.
One of the special magic numbers for lavish-carriage is: 1096979.
One of the special magic numbers for pumped-ecumenist is: 3884636.
One of the special magic numbers for broad-brandy is: 9875034.
One of the special magic numbers for bright-clay is: 2036890.
One of the special magic numbers for fluffy-role is: 6027227.
One of the special magic numbers for wet-simple is: 3094077.
One of the special magic numbers for discreet-eurocentrism is: 4066399.
One of the special magic numbers for tiresome-causal is: 7651750.
One of the special magic numbers for dapper-graduation is: 7199548.
One of the special magic numbers for broken-marsh is: 8441795.
[… 2,884 lines omitted for display …]
One of the special magic numbers for bashful-jewellery is: 4214554.
One of the special magic numbers for judicious-crocodile is: 8383026.
What is the special magic number for bright-clay mentioned in the provided text?
Original prompt 130,483 tokens, 5,718 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4095287Aux 20151725089Ours2036890Ours, no steer.2036890PiT-FT4095287Qwen 27B2036890
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2036890.

13 characters10 tokens

Aux 2015

Missed

4741830.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number is the special magic number for the following text?
I'd like to know how you calculated the number of unique magic numbers that can be found in the example you just uploaded.
Can you provide me with the HTML code for your entire collection of unique magic numbers?

(#) [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [
384 characters128 tokens

ChronoGPT 2015

Missed

:

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

Sigm

283 characters128 tokens