Hyperspectral retrieval of phytoplankton absorption and community composition from NASA’s PACE-OCI in estuarine–coastal waters using a hybrid framework combining mixture-of-experts and Variational Autoencoder

Retrieving the phytoplankton absorption coefficient (a_phy; m−1), one of the most spectrally rich inherent optical properties, remains challenging in optically complex coastal waters worldwide. Leveraging NASA's new hyperspectral mission, PACE, we introduce Hyper-MoE-VAE, a deep-learning architecture that integrates a Mixture-of-Experts with a Variational Autoencoder to retrieve high-dimensional a_phy and subsequent estimation of phytoplankton community composition (PCC) from PACE-OCI hyperspectral remote sensing reflectance (R_rs). Pre-trained on global hyperspectral bio-optical datasets and fine-tuned using regional field R_rs–a_phy pairings from inland– estuarine–coastal waters, Hyper-MoE-VAE demonstrated strong transferability and effective adaptation across regions. Validation with in-situ Rrs showed accurate aphy retrievals in Lake Erie (NRMSE = 0.12, ε = 17.10), Lake Pontchartrain (NRMSE = 0.11, ε = 37.12), and the Barataria–Terrebonne Estuary (NRMSE = 0.14, ε = 38.89). Using same-day PACE-OCI Level 2 Rrs, the model achieved comparable performance in Lake Erie (NRMSE = 0.19, ε = 55.19), Lake Pontchartrain (NRMSE = 0.14, ε = 51.39), and the Barataria–Terrebonne Estuary (NRMSE = 0.17, ε = 47.92). Hyper-MoE-VAE derived PACE-OCI hyperspectral aphy was further decomposed against mass-specific absorption spectra to estimate group-specific contributions to total chlorophyll a. The resulting PCC showed strong agreement with HPLC–CHEMTAX in Lake Erie (R²= 0.692) and Gulf estuarine–coastal systems (R² = 0.732). Monte Carlo noise experiments further revealed group-dependent sensitivities, with diatoms and dinoflagellates showing moderate susceptibility to noise, while cyanobacteria and cryptophytes exhibited narrow uncertainty distributions. These results demonstrate Hyper-MoE-VAE's capability for regional, operational water-quality monitoring with PACE-OCI and its adaptability to current and future hyperspectral missions.