# RBFL Benchmark Suite Run

Status: benchmark run completed from the available SPARC/reproducibility package and the current 3D Phase Field Detector outputs. The locked law was not changed. Lensing/Bullet amplification remains detection-stage only.

## Scope

- Run available SPARC phase-tuner, phase-correlation, velocity/phase detector, weak-lensing pilot, strong-lensing pilot, Bullet centroid, and Bullet proxy checks.

- Not run: wide-binary benchmark, timing/planet-spacing benchmark, full Bullet kappa-map fit, or real arc inversion, because those raw datasets are not present in the current package.

## Headline results

- Original SPARC phase tuner: 143/165 within chi2<=1; 154/165 within chi2<=1.5; median chi2/dof=0.492.

- Baryonic phase correlation: Psi_bar vs B_y gives Spearman rho=0.503, p=9.43e-12.

- Baryonic phase-drift predictor: CV R2=0.245, pred/true Spearman rho=0.522.

- Current detector, holdout: phase-state match=75.0%, velocity-pass<15%=70.0%, combined tolerance=60.0%, median MAPE=12.19%.

- Weak-lensing BTFR pilot All_R<1000 kpc: aTheta/locked=1.038, RMS dlog10V=0.0117.

- Strong-lensing pilot: rho(logMstar,logM_E)=0.658; CV R2=0.436.

- Bullet proxy: RBFT shock/prelock strong-region shape corr=0.777 vs mass-only 0.252; RMSE=75.5 vs 143.3 kpc.

## Benchmark table

| test_family                                | benchmark                                              | status                             | sample                          | headline_metric                                                                | interpretation                                                                           |
|:-------------------------------------------|:-------------------------------------------------------|:-----------------------------------|:--------------------------------|:-------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------|
| SPARC parsing                              | raw package tables                                     | RUN                                | 175 galaxies / 3391 radial rows | SPARC raw tables parsed and merged                                             | Data loading completed.                                                                  |
| SPARC phase detector                       | original NGC7331 reference gauge phase tuner           | PASS / detector-stage              | 165 galaxies                    | 143/165 chi2<=1; 154/165 chi2<=1.5; median chi2/dof=0.492                      | Original phase grouping is reproducible; detector, not law modification.                 |
| SPARC baryonic phase correlation           | Psi_bar vs radial phase drift B_y                      | PASS / correlation                 | N=162                           | Spearman rho=0.503; p=9.43e-12                                                 | Baryonic structure correlates with radial phase drift.                                   |
| SPARC phase prediction                     | cross-validated baryonic-structure predictor for B_y   | SURVIVED / modest predictive skill | N=162                           | CV R2=0.245; MAE=0.380; pred/true rho=0.522                                    | Baryonic observables recover part of the phase drift; not a complete predictor.          |
| SPARC locked-law velocity + phase detector | prior strict direct handshake                          | RUN / detection-stage              | 79 train galaxies               | state match=30.0%; velocity pass<15%=58.2%; combined=19.0%; median MAPE=13.80% | Law unchanged; detector uses observable phase fingerprints.                              |
| SPARC locked-law velocity + phase detector | prior strict direct handshake                          | RUN / detection-stage              | 20 holdout galaxies             | state match=34.3%; velocity pass<15%=70.0%; combined=10.0%; median MAPE=12.19% | Law unchanged; detector uses observable phase fingerprints.                              |
| SPARC locked-law velocity + phase detector | NGC7331 multi-channel observable decoder, train-frozen | RUN / detection-stage              | 79 train galaxies               | state match=88.6%; velocity pass<15%=58.2%; combined=51.9%; median MAPE=13.80% | Law unchanged; detector uses observable phase fingerprints.                              |
| SPARC locked-law velocity + phase detector | NGC7331 multi-channel observable decoder, train-frozen | RUN / detection-stage              | 20 holdout galaxies             | state match=75.0%; velocity pass<15%=70.0%; combined=60.0%; median MAPE=12.19% | Law unchanged; detector uses observable phase fingerprints.                              |
| SPARC locked-law velocity + phase detector | NGC7331 all-data tuned detector, diagnostic only       | RUN / detection-stage              | 79 train galaxies               | state match=87.3%; velocity pass<15%=58.2%; combined=49.4%; median MAPE=13.80% | Law unchanged; detector uses observable phase fingerprints.                              |
| SPARC locked-law velocity + phase detector | NGC7331 all-data tuned detector, diagnostic only       | RUN / detection-stage              | 20 holdout galaxies             | state match=95.0%; velocity pass<15%=70.0%; combined=65.0%; median MAPE=12.19% | Law unchanged; detector uses observable phase fingerprints.                              |
| Weak lensing                               | weak-lensing BTFR contact, All R<1000 kpc              | PASS / pilot                       | N=4 bins/samples                | median aTheta/locked=1.038; RMS dlog10V=0.0117; Vobs/VRBFT=1.009               | Pilot scaling agrees closely; not full profile fitting.                                  |
| Strong lensing                             | SLACS/BELLS enclosed mass pilot                        | SURVIVED / pilot                   | N=61 lenses                     | rho(logMstar,logM_E)=0.658; p=8.38e-09; CV R2=0.436                            | Pilot relation present; not real arc inversion.                                          |
| Bullet Cluster                             | centroid distance proxy                                | PASS / proxy                       | main + sub components           | main lens->gas 180.3 kpc vs lens->compact 48.7 kpc; sub 139.5 vs 21.8 kpc      | Proxy lens peaks are closer to compact galaxies than gas; not full kappa map.            |
| Bullet Cluster                             | deflection-field proxy                                 | PASS / proxy                       | synthetic/proxy field           | strong-region shape corr 0.777 vs mass-only 0.252; RMSE 75.5 vs 143.3 kpc      | RBFT-style projected proxy beats mass-only baryonic proxy; not observed map-level proof. |
| Wide binaries                              | 3D tracer / velocity-separation benchmark              | PENDING / data not in package      | not available                   | not run                                                                        | Gaia binary catalog + contamination/triple model not included in package                 |
| Timing / planetary beat                    | 12-day-style timing/spacing phase benchmark            | PENDING / data not in package      | not available                   | not run                                                                        | planet timing/spacing dataset not included in package                                    |
| Full observed Bullet kappa                 | map-level convergence benchmark                        | PENDING / data not in package      | not available                   | not run                                                                        | observed kappa pixels/FITS not included                                                  |
| Real arc inversion                         | image-plane lensing benchmark                          | PENDING / data not in package      | not available                   | not run                                                                        | observed arc pixels/source IDs not included                                              |


## Detector feature note

Top detection-stage features in the train-frozen multi-channel decoder:

| feature                        |   importance |
|:-------------------------------|-------------:|
| Aobs_grad_med_abs              |    0.0880548 |
| Aobs_med                       |    0.0790879 |
| Aobs_q25                       |    0.0617224 |
| Lambda_phase_median            |    0.0497213 |
| Lambda_phase_outer_median      |    0.0418695 |
| Aobs_q75                       |    0.0404241 |
| lambda4_point_score            |    0.0396664 |
| phase_ratio_Aobs_over_Ab_rot80 |    0.0390541 |
| Lambda_point_outer_med         |    0.0379735 |
| Ab_Aobs_median_absdiff         |    0.0354178 |
| Lambda_point_med               |    0.0336069 |
| lambda4_outer_score            |    0.0329378 |


## Interpretation

The available benchmarks are consistent with the current expectation: the locked law gives close but not perfect velocity-scale performance, while the improved detector recovers substantially more of the phase grouping. The strongest current number for the detector is the train-frozen holdout phase-state match of 75%. This should be treated as detection-stage performance, not as proof of a final physical theory.

## Files

This folder contains CSV summaries and copied key figures. See RBFL_benchmark_suite_summary.csv for the main table.
