Upfront design beats post hoc reliability fixes (opens in new tab)
Behavioral tasks often show robust group effects yet unreliable person-level estimates. Many ‘reliability fixes’ yield mixed results because they rarely change the two determinants of person-level reliability: trials per person and per-trial informativeness. Recent evidence supports this two-lever view and motivates routine reliability auditing and measurement engineering for translational use.
Read the original article