Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#068 · needle at 79% depth#069 · needle at 14% depth#070 · needle at 57% depth#071 · needle at 7% depth#072 · needle at 61% depth#073 · needle at 88% depth#074 · needle at 67% depth#075 · needle at 53% depth#076 · needle at 35% depth#077 · needle at 22% depth#078 · needle at 68% depth#079 · needle at 1% depth#080 · needle at 90% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for awful-appendix is: 1746628.
One of the special magic numbers for light-supervision is: 7846407.
[… 1,897 lines omitted for display …]
One of the special magic numbers for languid-invasion is: 1328169.
One of the special magic numbers for gusty-biology is: 5704520.
One of the special magic numbers for spectacular-crew is: 6023291.
One of the special magic numbers for ratty-blessing is: 6202853.
One of the special magic numbers for greedy-integer is: 5694456.
One of the special magic numbers for confused-fiberglass is: 6677126.
One of the special magic numbers for overwrought-minnow is: 1088622.
One of the special magic numbers for bitter-viscose is: 1745353.
One of the special magic numbers for loving-jam is: 5242331.
One of the special magic numbers for optimal-loaf is: 8802903.
One of the special magic numbers for acoustic-barium is: 7931147.
One of the special magic numbers for yielding-tray is: 3500174.
One of the special magic numbers for breakable-adviser is: 2280213.
One of the special magic numbers for organic-charity is: 1292822.
[… 928 lines omitted for display …]
One of the special magic numbers for abortive-key is: 7262104.
One of the special magic numbers for wiry-jack is: 8506142.
What is the special magic number for bitter-viscose mentioned in the provided text?
Original prompt 64,999 tokens, 2,845 linesShown 20 lines around the needleNeedle at 67% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7754972Aux 20151267773Ours1745353Ours, no steer.1745353PiT-FT7754972Qwen 27B1745353
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1745353.

13 characters10 tokens

Aux 2015

Missed

8580135.

13 characters10 tokens

PiT-FT 2015

Missed

: 8572569. The special magic number for cheerful-cane is: 7582569. The special magic number for loutish-sugar is: 7582569. The special magic number for gregarious-gazelle is: 8572569. The special magic number for gregarious-girly is: 8572569. The special magic number for loutish-carnation is: 8692069. The special magic number for loutish-covet is: 8692069. The special magic number for

394 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for soggy-panther is: The special magic number for sott-pap is: The special magic number for sott-pancreas mentioned in the provided text is: The special magic number for sott-pav is: The special magic number for sott-pelve is: The special magic number for sott-pelve is: The special magic number for sott-pelve is: The special magic number for sott-pelve is: The special magic number for sott-pelve is:

431 characters128 tokens