Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#071 · needle at 45% depth#072 · needle at 49% depth#073 · needle at 79% depth#074 · needle at 15% depth#075 · needle at 35% depth#076 · needle at 12% depth#077 · needle at 63% depth#078 · needle at 82% depth#079 · needle at 92% depth#080 · needle at 19% depth#081 · needle at 56% depth#082 · needle at 19% depth#083 · needle at 39% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for awful-lack is: 7917365.
One of the special magic numbers for loving-edition is: 2968887.
[… 3,559 lines omitted for display …]
One of the special magic numbers for dirty-brick is: 6042791.
One of the special magic numbers for spotless-expansionism is: 3773437.
One of the special magic numbers for tricky-note is: 6721199.
One of the special magic numbers for evanescent-incompetence is: 4140063.
One of the special magic numbers for sharp-shrimp is: 2222155.
One of the special magic numbers for amuck-ferryboat is: 9176382.
One of the special magic numbers for homeless-cutting is: 2858834.
One of the special magic numbers for precious-lid is: 6133634.
One of the special magic numbers for soft-journey is: 8843411.
One of the special magic numbers for omniscient-dynamite is: 6220960.
One of the special magic numbers for fluffy-contention is: 3807042.
One of the special magic numbers for flagrant-thought is: 7697844.
One of the special magic numbers for handsomely-listening is: 6264016.
One of the special magic numbers for tart-photography is: 5791312.
[… 2,114 lines omitted for display …]
One of the special magic numbers for disagreeable-raspberry is: 4423428.
One of the special magic numbers for vacuous-medium is: 2276919.
What is the special magic number for precious-lid mentioned in the provided text?
Original prompt 129,877 tokens, 5,693 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9485068Aux 20151749647Ours6133634Ours, no steer.6133634PiT-FT9485068Qwen 27B6133634
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6133634.

13 characters10 tokens

Aux 2015

Missed

7870341.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] [] [] for [] [] [] [] mention being [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [
206 characters128 tokens

ChronoGPT 2015

Missed

Conj:

The special Epicurean Epicurean Epicurean

Conj:

The special Epicurean Epicurean

Gen:

The special Dickensian Dickensian Dickensian Dickensian Dickensian Dickensian Dickensian Dickensian Dickensian

Alleg:

The special Entertain an Entertained-cansity is

FAB:

The special Gullible-cansity is

FAB:

The special Gullible-cansity is

FAB:

The special Gullible-cansity is

412 characters128 tokens