⛰️ Gradient Descent - pfh · Scour

Natural gradient descent with momentum 🎪Convex Optimization

massimilianoconcas0-del/Relational_Loss_ML: A scale-invariant loss function for Deep Learning. Replace Absolute Loss (MSE) with Relational Loss to achieve 4000x faster convergence and zero-shot transfer across scales. 🗺️Manifold Learning

github.com·1d·Hacker News

RBF-PoroNet: A differentiable implicit framework for automated optimization of porous structures via a self-adaptive RBF neural network 📐Computational Geometry

sciencedirect.com·2h

[ASAP] FlashMRM: An Automated Platform for MRM Method Generation and Iterative Optimization Based on High-Resolution Spectra 🗺️UMAP

Finite Difference Flow Optimization 🎪Convex Optimization

mcallisterdavid.com·5d

Mean-Variance Optimization in Practice: Reverse Optimization and Implied Expected Returns [Portfolio Optimizer] 🎪Convex Optimization

portfoliooptimizer.io·5d

Carnegie Mellon at ICLR 2026 🗺️UMAP

blog.ml.cmu.edu·4d

The Recurrent Transformer: Greater Effective Depth and Efficient Decoding 🔢Embeddings

Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction 📊Empirical Bayes

Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training 📊Empirical Bayes

arxiv.org·20h·Hacker News

MatthewK78/Rose: 🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates. 🎪Convex Optimization

github.com·6d·r/StableDiffusion

Towards intelligent mine ventilation: An inverse optimization approach for fan efficiency maximization via surrogate modeling and adaptive particle swarm optimi... 🎪Convex Optimization

sciencedirect.com·3d

Generalization at the Edge of Stability 🗺️UMAP

Geometric Monomial (GEM): a family of rational 2N-differentiable activation functions 🎪Convex Optimization

Rethinking Reinforcement Fine-Tuning in LVLM: Convergence, Reward Decomposition, and Generalization 📊Empirical Bayes

Neural field-based shape optimization for manufacturability-aware support structure minimisation 🗺️Manifold Learning

sciencedirect.com·3d

Explicit Dropout: Deterministic Regularization for Transformer Architectures 📊Empirical Bayes

Fine-Tuning Regimes Define Distinct Continual Learning Problems 🎪Convex Optimization

SGD at the Edge of Stability: The Stochastic Sharpness Gap 📊Empirical Bayes

Fast Amortized Fitting of Scientific Signals Across Time and Ensembles via Transferable Neural Fields 🗺️Manifold Learning

Log in to enable infinite scrolling