Ge Developer calculations performed using the same set of harmonic and cubic force constants. (a) Temperature dependence of RTA and full PBTE solution thermal conductivities for isotopically pure 70Ge. (b) RTA thermal conductivity accumulation with frequency at a temperature of 300 K for isotopically pure 70Ge. Credit: Journal of Applied Physics (2025). DOI: 10.1063/5.0289819

Mechanical Engineering Professor Alan McGaughey of Carnegie Mellon University recently coordinated the Phonon Olympics, bringing together developers and expert users to benchmark three leading open-source thermal conductivity calculation packages.

Although there’s no medal at the end of the Phonon Olympics, for McGaughey, the collaboration required to evaluate the accuracy of three widely used open-source thermal conductivity calculation packages was worth more than gold.

For the last decade, researchers seeking to understand the properties of new materials have turned to open-source packages to perform thermal conductivity calculations. These packages enable a broader community to study thermal transport, but until now users had no way of knowing whether or not each package would produce consistent and accurate results.

Coordinated by McGaughey, six teams participated in the Phonon Olympics to test each of the three most cited packages: ALAMODE, phono3py, and ShengBTE. For each package, one team was made up of the developers while the other consisted of expert users. Each team conducted benchmark calculations for four materials: geranium, rubidium bromide, monolayer molybdenum diselenide, and aluminum nitride.

As published in the Journal of Applied Physics, the thermal conductivities calculated by the teams fell within 15% of their mean values for each of the four materials.

“This is a good sign that when used properly, these codes give us a consistent prediction of thermal conductivity,” said McGaughey, professor of mechanical engineering. “This outcome is better than what we expected.”

The team also documented best practices for how to perform the calculations. They hope this will help novice users recognize that how they use these open-source packages impacts their results.

With this type of program, users can’t just download a code and hit “go.” For example, they must determine how to model the atomic interactions, build a digital sample of the material, and weigh accuracy vs. computational cost.

“Having more researchers in this space will lead to more advancement, but only if their findings are well grounded. A lot of people write code and put it on the internet, but it’s important that they are rigorously checked to make sure they give trustworthy results,” he said.

The dedication of every team member involved in this four-year project is a testament to just how important validating these open-source codes is.

“Through pandemics and personal changes, 17 people pulled together to get this job done,” McGaughey said. “Being part of a team effort like this is really special, both personally and for the greater research community.”

More information: Alan J. H. McGaughey et al, Phonon Olympics: Phonon property and lattice thermal conductivity benchmarking from open-source packages, Journal of Applied Physics (2025). DOI: 10.1063/5.0289819

Citation: Developers and expert users benchmark three leading open-source thermal conductivity calculation packages (2025, November 10) retrieved 10 November 2025 from https://phys.org/news/2025-11-expert-users-benchmark-source-thermal.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.