Computer Science > Computation and Language
arXiv:2601.04036 (cs)
Abstract:Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages, where limited parallel data constrains generalization and transfer. Understanding how multilingual models share knowledge across languages requires examining the interaction between representations, data availability, and training strategies. In this thesis, we study cross-lingual knowledge transfer in neural models and develop methods to improve robustness and generalization in multilingual settings, using machine trans…
Computer Science > Computation and Language
arXiv:2601.04036 (cs)
Abstract:Multilingual machine translation systems aim to make knowledge accessible across languages, yet learning effective cross-lingual representations remains challenging. These challenges are especially pronounced for low-resource languages, where limited parallel data constrains generalization and transfer. Understanding how multilingual models share knowledge across languages requires examining the interaction between representations, data availability, and training strategies. In this thesis, we study cross-lingual knowledge transfer in neural models and develop methods to improve robustness and generalization in multilingual settings, using machine translation as a central testbed. We analyze how similarity between languages influences transfer, how retrieval and auxiliary supervision can strengthen low-resource translation, and how fine-tuning on parallel data can introduce unintended trade-offs in large language models. We further examine the role of language diversity during training and show that increasing translation coverage improves generalization and reduces off-target behavior. Together, this work highlights how modeling choices and data composition shape multilingual learning and offers insights toward more inclusive and resilient multilingual NLP systems.
| Comments: | PhD dissertation defended on November 26th, 2025 |
| Subjects: | Computation and Language (cs.CL) |
| Cite as: | arXiv:2601.04036 [cs.CL] |
| (or arXiv:2601.04036v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2601.04036 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: David Stap [view email] [v1] Wed, 7 Jan 2026 15:51:54 UTC (2,910 KB)
Current browse context:
cs.CL
Change to browse by:
export BibTeX citation