On the Sparsity-Storage-Accuracy Tradeoff in Parsimoniously Activated Dictionary Learning

Dictionary learning has long been studied from both optimization and probabilistic perspectives. While formulations with element-wise sparsity regularization (e.g., L1-based sparse coding) admit well-established probabilistic interpretations, many structured variants that impose global constraints l…