SniperGold_ML/docs/P3_S25_1G_CANONICAL_PARALLEL_BRIDGE_REPORT.md

12 KiB

P3-S25.1G - CANONICAL PREFIX TO PARALLEL EXECUTION BRIDGE - FINAL REPORT

DOCUMENT ROLE      : REPORT (derived summary; generated from machine
                      evidence under bridge_validation/output/*.json)
AUTHORITATIVE SOURCE: canonical real checkpoint
                      ml/p3/p3_s251_external_ingest/output/s251_real_checkpoint.json
PHASE              : P3-S25.1G - LEGACY PREFIX -> PARALLEL EXECUTION BRIDGE
CLASSIFICATION     : A - CANONICAL/PARALLEL COMPATIBILITY VERIFIED
GATES PASS         : 10/10

1. Starting Git SHA

starting_sha = 4af7cad913423edbaee430de48106ba8381a7e4f
origin/main  = 4af7cad913423edbaee430de48106ba8381a7e4f
branch       = main
working tree = CLEAN (only the scoped untracked bridge_validation/ evidence tree)
stash        = EMPTY
preconditions= PASS

2. Final Git SHA

post-push repository HEAD = 03372d37b924a243e2b9407b93192a7150ae65a3
origin/main = 03372d37b924a243e2b9407b93192a7150ae65a3
branch = main | working tree CLEAN | stash EMPTY (verified post-push)

3. Bridge range

PRIMARY bridge : [0, 188743943) bytes = full committed prefix CHUNKS 0-11
                8 x 24 MiB atomic chunks (24 MiB = 25165824 B)
TAIL bridge    : [113246416, 188743943) bytes = committed CHUNKS 9/10/11
                3 x 24 MiB atomic chunks == committed chunk boundaries
                [113246416, 138412248) [138412248, 163578081) [163578081, 188743943)
seed (PRIMARY)  : initial state (None, None) = canonical chunk-0 pre-state
seed (TAIL)     : committed chunk-8 output carry (recorded pre-chunk-9 state)

4. Maximum real byte consumed

max_real_byte_consumed = 188743943 (== canonical next_byte_offset)
no real byte beyond 188743943 was read (hard guard enforced)
CHUNK 12 - NOT PROCESSED; new real Tickstory bytes - NONE read

5. Canonical path result (PATH A, x2 runs)

PRIMARY rows 4224365 | M15 20689 | M30 11078 | first 1052092863 | last 1080919496
  output_sha256 21f682486c40bf09ca3e814ef29084181cf2cd70f7b0cb533bc413bf153b776c | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
  vs committed checkpoint oracle (rows/M15/M30/first/last/carry): True
  atomic == continuous single-stream: True
TAIL    rows 1689622 | M15 7401 | M30 3997 | first 1070906628 | last 1080919496
  output_sha256 e2561a773941032bccad58d4d265283962aeabc1b9fe3b2adfbd90b34957f7e6 | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
  vs committed chunk-9/10/11 row oracle: True
  final carry M15  {"ts": 1080918900, "open": 421.052, "high": 421.549, "low": 420.204, "close": 420.472, "ticks": 394, "first_ts": 1080918914, "last_ts": 1080919496}
  final carry M30  {"ts": 1080918000, "open": 421.759, "high": 423.205, "low": 420.539, "close": 421.229, "n_m15": 1}
canonical reproducible (run1 == run2): PRIMARY True | TAIL True

6. Parallel 2-worker result (PATH B)

PRIMARY w2 rows 4224365 | M15 20689 | M30 11078 | output_sha256 21f682486c40bf09ca3e814ef29084181cf2cd70f7b0cb533bc413bf153b776c | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
  equals canonical: run1 True | run2 True | reproducible True
TAIL w2 rows 1689622 | M15 7401 | M30 3997 | output_sha256 e2561a773941032bccad58d4d265283962aeabc1b9fe3b2adfbd90b34957f7e6 | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
  equals canonical: run1 True | run2 True | reproducible True

7. Parallel 8-worker result (PATH B)

PRIMARY w8 rows 4224365 | M15 20689 | M30 11078 | output_sha256 21f682486c40bf09ca3e814ef29084181cf2cd70f7b0cb533bc413bf153b776c | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
  equals canonical: run1 True | run2 True | reproducible True
  tasks 8 (non-empty partitions [0, 1, 2, 3, 4, 5, 6, 7]) completion [7, 1, 4, 2, 0, 3, 6, 5]
TAIL w8 rows 1689622 | M15 7401 | M30 3997 | output_sha256 e2561a773941032bccad58d4d265283962aeabc1b9fe3b2adfbd90b34957f7e6 | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
  equals canonical: run1 True | run2 True | reproducible True
  tasks 3 (non-empty partitions [0, 1, 2]) completion [0, 1, 2]

8. State compatibility

input (pre-range) state is byte-for-byte the recorded canonical state:
  PRIMARY seed = (None, None) == chunk-0 canonical input carry
  TAIL seed = {"ts": 1070906400, "open": 406.703, "high": 407.133, "low": 406.367, "close": 406.631, "ticks": 99, "first_ts": 1070906400, "last_ts": 1070906623}
both paths start from the SAME trusted pre-range state (deep-copied; seed_carry_hash identical in canonical and parallel records)
final state (carry) equality: canonical == committed oracle == parallel 2/8
  final M15 carry == {"ts": 1080918900, "open": 421.052, "high": 421.549, "low": 420.204, "close": 420.472, "ticks": 394, "first_ts": 1080918914, "last_ts": 1080919496}
  final M30 carry == {"ts": 1080918000, "open": 421.759, "high": 423.205, "low": 420.539, "close": 421.229, "n_m15": 1}
semantic_invariance gate : True

9. Output compatibility

canonical output == parallel output (exact equality, no approximation):
  PRIMARY w2 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
  PRIMARY w8 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
  TAIL w2 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
  TAIL w8 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
all_pass : True

10. Boundary compatibility (7/7)

  inside_m15     PASS True   basis REAL-PREFIX
  inside_m30     PASS True   basis REAL-PREFIX
  exact_m15      PASS True   basis P3-S25.1F-synthetic-provenance
  exact_m30      PASS True   basis P3-S25.1F-synthetic-provenance
  same_ts        PASS True   basis REAL-PREFIX
  carry_boundary PASS True   basis REAL-PREFIX
  CHUNK 10 -> 11  PASS True   boundary byte 163578081
real_present_classes : ['carry_boundary', 'inside_m15', 'inside_m30', 'same_ts']
all_pass : True (required 7/7)
critical invariant actual_byte_end(N) == actual_byte_start(N+1):
  verified for every atomic boundary (no gap, no overlap) - see coverage oracle + boundary detail in bridge_evidence

11. CHUNK 10 -> 11 bridge result

byte boundary      : 163578081
byte_contiguous    : True (chunk10.byte_end == chunk11.byte_start == 163578081)
carry_chain_ok     : True (chunk11.input_state_hash == chunk10.output_state_hash)
timestamp continuity: True (chunk11.first_ts >= chunk10.last_ts)
PASS : True

12. Continuation-state simulation (CHUNK 12 SIM)

workload : deterministic synthetic continuation (schema-identical), seeded EXACTLY from the canonical post-chunk-11 carry
seed_carry_hash == canonical_post11_carry_hash : True
bytes 54525988 | atomic chunks 3 | final canonical rows 1239227 | M15 2065 | M30 1033
  canonical   run1==run2 True | reproducible True
  parallel_2 run1==canonical True | run2==canonical True | reproducible True
  parallel_8 run1==canonical True | run2==canonical True | reproducible True
all_pass : True (outputs identical AND final states identical)

13. Interruption / resume

canonical corrected resume (P3-S25.1D-R actual-byte-end tail re-execution): PRIMARY True | TAIL True
parallel resume at every worker boundary (actual byte_end): PRIMARY-8 True | TAIL-2 True
shuffled worker completion order does not change the merge: verified
all_pass : True

14. Mutation detection (8/8)

  primary_8 : 8/8 DETECTED
    omitted-byte-range       DETECTED
    duplicated-byte-range    DETECTED
    wrong-byte-boundary      DETECTED
    reordered-worker-result  DETECTED
    wrong-input-carry        DETECTED
    altered-prefix-state     DETECTED
    dropped-output-rows      DETECTED
    duplicated-output-rows   DETECTED
  tail_2 : 8/8 DETECTED
    omitted-byte-range       DETECTED
    duplicated-byte-range    DETECTED
    wrong-byte-boundary      DETECTED
    reordered-worker-result  DETECTED
    wrong-input-carry        DETECTED
    altered-prefix-state     DETECTED
    dropped-output-rows      DETECTED
    duplicated-output-rows   DETECTED
required 8/8 DETECTED : True
classes : omitted-byte-range | duplicated-byte-range | wrong-byte-boundary | reordered-worker-result | wrong-input-carry | altered-prefix-state | dropped-output-rows | duplicated-output-rows

15. Reproducibility

canonical run1==run2 : PRIMARY True | TAIL True
parallel primary_2 run1==run2 : True
parallel primary_8 run1==run2 : True
parallel tail_2 run1==run2 : True
parallel tail_8 run1==run2 : True
all_pass : True (semantic equality; timing equality not required; repeatability is NOT the sole correctness argument - see oracle)

16. Performance

canonical continuous PRIMARY : 116.3 s | canonical atomic PRIMARY : 114.7 s
parallel PRIMARY w2 : span 59.3/60.1 s | merge 0.466 s | dispatch 0.613 s | per-worker peak [246265764, 247910794] | total peak 494176558 B | speedup vs stream 1.96x | rows/s 71195
parallel PRIMARY w8 : span 17.2/17.8 s | merge 0.535 s | dispatch 1.280 s | per-worker peak [246265764, 246097590, 245983692, 245974620, 245995136, 247751860, 248161298, 123852854] | total peak 1850082814 B | speedup vs stream 6.76x | rows/s 245626
note: correctness has priority; performance is secondary.

17. Checkpoint before / after

checkpoint_sha_before : 76ce95eb1e67b4138302a9c9d318e3a3c9f3e52430ac80c08f1a9900da23d0c1
checkpoint_sha_after  : 76ce95eb1e67b4138302a9c9d318e3a3c9f3e52430ac80c08f1a9900da23d0c1
byte_identical        : True
run_id                : P3_S251_REAL_TICK_RUN_001 (untouched)
last_completed_chunk  : 11 | next_chunk 12 | next_byte_offset 188743943

18. SAFE_MAX_CHUNK_SIZE

SAFE_MAX_CHUNK_SIZE = 25165824 bytes (24 MiB) - UNCHANGED (P3-S25.1C)

19. SAFE_CHUNKS_PER_TURN

SAFE_CHUNKS_PER_TURN = NOT ESTABLISHED (unchanged)

20. Operational-policy status

OPERATIONAL_POLICY : NOT CHANGED (bridge validation only)
Real Chunk 12 execution : NOT AUTHORIZED and NOT PROCESSED
New real Tickstory bytes : NONE read (max 188743943)
Dukascopy : NOT accessed | ML : NOT run | Production MQL5/MQH : UNCHANGED
Frozen contracts / feature / label contracts : UNCHANGED
CURRENT_DECISION_GATE.md / CURRENT_PROJECT_STATE.md : UNCHANGED
Historical scientific evidence : UNCHANGED

21. CHUNK 12 status

CHUNK 12 = NOT AUTHORIZED / NOT PROCESSED
next_byte_offset 188743943 is a FACT, not an authorization; the disposable continuation simulation processed only SYNTHETIC bytes.

22. Limitations

  • The parallel engine's per-line chunk-digest is intentionally omitted in the lean verifier (inherited from P3-S25.1E/F); its equality with the canonical full-digest ChunkParser is independently verified in this phase by the committed-chunk SHA oracle (raw + parsed SHA-256 byte-exact for chunks 9/10/11).
  • Boundary classes without a natural instance in the real prefix are verified by provenance to the P3-S25.1F 6/6 boundary audit of the same engine on the validated synthetic workload (not on new real bytes).
  • 8 workers on the TAIL bridge dispatch only 3 non-empty worker tasks (3 atomic chunks); the 8-worker pool machinery is unchanged.
  • Altered-prefix-state is detected via the canonical oracle path (wrong seed -> committed-signature mismatch) and via the worker-level mutation suite.
  • Full 34.5 GB ingestion NOT complete; CHUNK 12 remains gated on the owner decision recorded in CURRENT_DECISION_GATE.md.

23. Compatibility decision

CLASSIFICATION : A - CANONICAL/PARALLEL COMPATIBILITY VERIFIED
gates : {
  "git_preflight": true,
  "semantic_invariance": true,
  "boundary_7of7": true,
  "interruption_resume": true,
  "mutation_detection_8of8": true,
  "reproducibility": true,
  "independent_oracle": true,
  "continuation_sim": true,
  "prefix_continuation_invariant": true,
  "checkpoint_unchanged": true
}

End of P3-S25.1G final report (generated from machine evidence).