Abstract:Hidden Markov Models (HMMs) are fundamental for modeling sequential data, yet learning their parameters from observations remains challenging. Classical methods like the Baum-Welch (EM) algorithm are computationally intensive and prone to local optima, while modern spectral algorithms offer provable guarantees but may produce probability outputs outside valid ranges. This work introduces Belief Net, a novel framework that learns HMM parameters through gradient-based optimization by formulating the HMM’s forward filter as a structured neural network. Unlike black-box Transformer models, Belief Net’s learnable weights are explicitly the logits of the initial distribution, transition matrix, and emission matrix, ensuring full int…
Abstract:Hidden Markov Models (HMMs) are fundamental for modeling sequential data, yet learning their parameters from observations remains challenging. Classical methods like the Baum-Welch (EM) algorithm are computationally intensive and prone to local optima, while modern spectral algorithms offer provable guarantees but may produce probability outputs outside valid ranges. This work introduces Belief Net, a novel framework that learns HMM parameters through gradient-based optimization by formulating the HMM’s forward filter as a structured neural network. Unlike black-box Transformer models, Belief Net’s learnable weights are explicitly the logits of the initial distribution, transition matrix, and emission matrix, ensuring full interpretability. The model processes observation sequences using a decoder-only architecture and is trained end-to-end with standard autoregressive next-observation prediction loss. On synthetic HMM data, Belief Net achieves superior convergence speed compared to Baum-Welch, successfully recovering parameters in both undercomplete and overcomplete settings where spectral methods fail. Comparisons with Transformer-based models are also presented on real-world language data.
| Comments: | 19 pages, 7 pages, submitted to conference: L4DC 2026 |
| Subjects: | Machine Learning (cs.LG); Systems and Control (eess.SY); Probability (math.PR) |
| Cite as: | arXiv:2511.10571 [cs.LG] |
| (or arXiv:2511.10571v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2511.10571 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Heng-Sheng Chang [view email] [v1] Thu, 13 Nov 2025 18:08:19 UTC (200 KB)