forked from chiki2bum2/SniperGold_ML
12 KiB
12 KiB
P3-S25.1G - CANONICAL PREFIX TO PARALLEL EXECUTION BRIDGE - FINAL REPORT
DOCUMENT ROLE : REPORT (derived summary; generated from machine
evidence under bridge_validation/output/*.json)
AUTHORITATIVE SOURCE: canonical real checkpoint
ml/p3/p3_s251_external_ingest/output/s251_real_checkpoint.json
PHASE : P3-S25.1G - LEGACY PREFIX -> PARALLEL EXECUTION BRIDGE
CLASSIFICATION : A - CANONICAL/PARALLEL COMPATIBILITY VERIFIED
GATES PASS : 10/10
1. Starting Git SHA
starting_sha = 4af7cad913423edbaee430de48106ba8381a7e4f
origin/main = 4af7cad913423edbaee430de48106ba8381a7e4f
branch = main
working tree = CLEAN (only the scoped untracked bridge_validation/ evidence tree)
stash = EMPTY
preconditions= PASS
2. Final Git SHA
post-push repository HEAD = 03372d37b924a243e2b9407b93192a7150ae65a3
origin/main = 03372d37b924a243e2b9407b93192a7150ae65a3
branch = main | working tree CLEAN | stash EMPTY (verified post-push)
3. Bridge range
PRIMARY bridge : [0, 188743943) bytes = full committed prefix CHUNKS 0-11
8 x 24 MiB atomic chunks (24 MiB = 25165824 B)
TAIL bridge : [113246416, 188743943) bytes = committed CHUNKS 9/10/11
3 x 24 MiB atomic chunks == committed chunk boundaries
[113246416, 138412248) [138412248, 163578081) [163578081, 188743943)
seed (PRIMARY) : initial state (None, None) = canonical chunk-0 pre-state
seed (TAIL) : committed chunk-8 output carry (recorded pre-chunk-9 state)
4. Maximum real byte consumed
max_real_byte_consumed = 188743943 (== canonical next_byte_offset)
no real byte beyond 188743943 was read (hard guard enforced)
CHUNK 12 - NOT PROCESSED; new real Tickstory bytes - NONE read
5. Canonical path result (PATH A, x2 runs)
PRIMARY rows 4224365 | M15 20689 | M30 11078 | first 1052092863 | last 1080919496
output_sha256 21f682486c40bf09ca3e814ef29084181cf2cd70f7b0cb533bc413bf153b776c | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
vs committed checkpoint oracle (rows/M15/M30/first/last/carry): True
atomic == continuous single-stream: True
TAIL rows 1689622 | M15 7401 | M30 3997 | first 1070906628 | last 1080919496
output_sha256 e2561a773941032bccad58d4d265283962aeabc1b9fe3b2adfbd90b34957f7e6 | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
vs committed chunk-9/10/11 row oracle: True
final carry M15 {"ts": 1080918900, "open": 421.052, "high": 421.549, "low": 420.204, "close": 420.472, "ticks": 394, "first_ts": 1080918914, "last_ts": 1080919496}
final carry M30 {"ts": 1080918000, "open": 421.759, "high": 423.205, "low": 420.539, "close": 421.229, "n_m15": 1}
canonical reproducible (run1 == run2): PRIMARY True | TAIL True
6. Parallel 2-worker result (PATH B)
PRIMARY w2 rows 4224365 | M15 20689 | M30 11078 | output_sha256 21f682486c40bf09ca3e814ef29084181cf2cd70f7b0cb533bc413bf153b776c | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
equals canonical: run1 True | run2 True | reproducible True
TAIL w2 rows 1689622 | M15 7401 | M30 3997 | output_sha256 e2561a773941032bccad58d4d265283962aeabc1b9fe3b2adfbd90b34957f7e6 | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
equals canonical: run1 True | run2 True | reproducible True
7. Parallel 8-worker result (PATH B)
PRIMARY w8 rows 4224365 | M15 20689 | M30 11078 | output_sha256 21f682486c40bf09ca3e814ef29084181cf2cd70f7b0cb533bc413bf153b776c | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
equals canonical: run1 True | run2 True | reproducible True
tasks 8 (non-empty partitions [0, 1, 2, 3, 4, 5, 6, 7]) completion [7, 1, 4, 2, 0, 3, 6, 5]
TAIL w8 rows 1689622 | M15 7401 | M30 3997 | output_sha256 e2561a773941032bccad58d4d265283962aeabc1b9fe3b2adfbd90b34957f7e6 | final_state_hash e5ccabae0e926cf4b0ab3f31542bb32d95fd69ad05d3a2b7eb7575b7656c6f9d
equals canonical: run1 True | run2 True | reproducible True
tasks 3 (non-empty partitions [0, 1, 2]) completion [0, 1, 2]
8. State compatibility
input (pre-range) state is byte-for-byte the recorded canonical state:
PRIMARY seed = (None, None) == chunk-0 canonical input carry
TAIL seed = {"ts": 1070906400, "open": 406.703, "high": 407.133, "low": 406.367, "close": 406.631, "ticks": 99, "first_ts": 1070906400, "last_ts": 1070906623}
both paths start from the SAME trusted pre-range state (deep-copied; seed_carry_hash identical in canonical and parallel records)
final state (carry) equality: canonical == committed oracle == parallel 2/8
final M15 carry == {"ts": 1080918900, "open": 421.052, "high": 421.549, "low": 420.204, "close": 420.472, "ticks": 394, "first_ts": 1080918914, "last_ts": 1080919496}
final M30 carry == {"ts": 1080918000, "open": 421.759, "high": 423.205, "low": 420.539, "close": 421.229, "n_m15": 1}
semantic_invariance gate : True
9. Output compatibility
canonical output == parallel output (exact equality, no approximation):
PRIMARY w2 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
PRIMARY w8 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
TAIL w2 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
TAIL w8 : run1==canonical True | run2==canonical True | run1==committed-oracle True -> PASS True
all_pass : True
10. Boundary compatibility (7/7)
inside_m15 PASS True basis REAL-PREFIX
inside_m30 PASS True basis REAL-PREFIX
exact_m15 PASS True basis P3-S25.1F-synthetic-provenance
exact_m30 PASS True basis P3-S25.1F-synthetic-provenance
same_ts PASS True basis REAL-PREFIX
carry_boundary PASS True basis REAL-PREFIX
CHUNK 10 -> 11 PASS True boundary byte 163578081
real_present_classes : ['carry_boundary', 'inside_m15', 'inside_m30', 'same_ts']
all_pass : True (required 7/7)
critical invariant actual_byte_end(N) == actual_byte_start(N+1):
verified for every atomic boundary (no gap, no overlap) - see coverage oracle + boundary detail in bridge_evidence
11. CHUNK 10 -> 11 bridge result
byte boundary : 163578081
byte_contiguous : True (chunk10.byte_end == chunk11.byte_start == 163578081)
carry_chain_ok : True (chunk11.input_state_hash == chunk10.output_state_hash)
timestamp continuity: True (chunk11.first_ts >= chunk10.last_ts)
PASS : True
12. Continuation-state simulation (CHUNK 12 SIM)
workload : deterministic synthetic continuation (schema-identical), seeded EXACTLY from the canonical post-chunk-11 carry
seed_carry_hash == canonical_post11_carry_hash : True
bytes 54525988 | atomic chunks 3 | final canonical rows 1239227 | M15 2065 | M30 1033
canonical run1==run2 True | reproducible True
parallel_2 run1==canonical True | run2==canonical True | reproducible True
parallel_8 run1==canonical True | run2==canonical True | reproducible True
all_pass : True (outputs identical AND final states identical)
13. Interruption / resume
canonical corrected resume (P3-S25.1D-R actual-byte-end tail re-execution): PRIMARY True | TAIL True
parallel resume at every worker boundary (actual byte_end): PRIMARY-8 True | TAIL-2 True
shuffled worker completion order does not change the merge: verified
all_pass : True
14. Mutation detection (8/8)
primary_8 : 8/8 DETECTED
omitted-byte-range DETECTED
duplicated-byte-range DETECTED
wrong-byte-boundary DETECTED
reordered-worker-result DETECTED
wrong-input-carry DETECTED
altered-prefix-state DETECTED
dropped-output-rows DETECTED
duplicated-output-rows DETECTED
tail_2 : 8/8 DETECTED
omitted-byte-range DETECTED
duplicated-byte-range DETECTED
wrong-byte-boundary DETECTED
reordered-worker-result DETECTED
wrong-input-carry DETECTED
altered-prefix-state DETECTED
dropped-output-rows DETECTED
duplicated-output-rows DETECTED
required 8/8 DETECTED : True
classes : omitted-byte-range | duplicated-byte-range | wrong-byte-boundary | reordered-worker-result | wrong-input-carry | altered-prefix-state | dropped-output-rows | duplicated-output-rows
15. Reproducibility
canonical run1==run2 : PRIMARY True | TAIL True
parallel primary_2 run1==run2 : True
parallel primary_8 run1==run2 : True
parallel tail_2 run1==run2 : True
parallel tail_8 run1==run2 : True
all_pass : True (semantic equality; timing equality not required; repeatability is NOT the sole correctness argument - see oracle)
16. Performance
canonical continuous PRIMARY : 116.3 s | canonical atomic PRIMARY : 114.7 s
parallel PRIMARY w2 : span 59.3/60.1 s | merge 0.466 s | dispatch 0.613 s | per-worker peak [246265764, 247910794] | total peak 494176558 B | speedup vs stream 1.96x | rows/s 71195
parallel PRIMARY w8 : span 17.2/17.8 s | merge 0.535 s | dispatch 1.280 s | per-worker peak [246265764, 246097590, 245983692, 245974620, 245995136, 247751860, 248161298, 123852854] | total peak 1850082814 B | speedup vs stream 6.76x | rows/s 245626
note: correctness has priority; performance is secondary.
17. Checkpoint before / after
checkpoint_sha_before : 76ce95eb1e67b4138302a9c9d318e3a3c9f3e52430ac80c08f1a9900da23d0c1
checkpoint_sha_after : 76ce95eb1e67b4138302a9c9d318e3a3c9f3e52430ac80c08f1a9900da23d0c1
byte_identical : True
run_id : P3_S251_REAL_TICK_RUN_001 (untouched)
last_completed_chunk : 11 | next_chunk 12 | next_byte_offset 188743943
18. SAFE_MAX_CHUNK_SIZE
SAFE_MAX_CHUNK_SIZE = 25165824 bytes (24 MiB) - UNCHANGED (P3-S25.1C)
19. SAFE_CHUNKS_PER_TURN
SAFE_CHUNKS_PER_TURN = NOT ESTABLISHED (unchanged)
20. Operational-policy status
OPERATIONAL_POLICY : NOT CHANGED (bridge validation only)
Real Chunk 12 execution : NOT AUTHORIZED and NOT PROCESSED
New real Tickstory bytes : NONE read (max 188743943)
Dukascopy : NOT accessed | ML : NOT run | Production MQL5/MQH : UNCHANGED
Frozen contracts / feature / label contracts : UNCHANGED
CURRENT_DECISION_GATE.md / CURRENT_PROJECT_STATE.md : UNCHANGED
Historical scientific evidence : UNCHANGED
21. CHUNK 12 status
CHUNK 12 = NOT AUTHORIZED / NOT PROCESSED
next_byte_offset 188743943 is a FACT, not an authorization; the disposable continuation simulation processed only SYNTHETIC bytes.
22. Limitations
- The parallel engine's per-line chunk-digest is intentionally omitted in the lean verifier (inherited from P3-S25.1E/F); its equality with the canonical full-digest ChunkParser is independently verified in this phase by the committed-chunk SHA oracle (raw + parsed SHA-256 byte-exact for chunks 9/10/11).
- Boundary classes without a natural instance in the real prefix are verified by provenance to the P3-S25.1F 6/6 boundary audit of the same engine on the validated synthetic workload (not on new real bytes).
- 8 workers on the TAIL bridge dispatch only 3 non-empty worker tasks (3 atomic chunks); the 8-worker pool machinery is unchanged.
- Altered-prefix-state is detected via the canonical oracle path (wrong seed -> committed-signature mismatch) and via the worker-level mutation suite.
- Full 34.5 GB ingestion NOT complete; CHUNK 12 remains gated on the owner decision recorded in CURRENT_DECISION_GATE.md.
23. Compatibility decision
CLASSIFICATION : A - CANONICAL/PARALLEL COMPATIBILITY VERIFIED
gates : {
"git_preflight": true,
"semantic_invariance": true,
"boundary_7of7": true,
"interruption_resume": true,
"mutation_detection_8of8": true,
"reproducibility": true,
"independent_oracle": true,
"continuation_sim": true,
"prefix_continuation_invariant": true,
"checkpoint_unchanged": true
}
End of P3-S25.1G final report (generated from machine evidence).