Scarce data, noisy inferences and overfitting: the hidden flaws in ecological dynamics modelling

Abstract

Metagenomic data has significantly advanced microbiome research by employing ecological models, particularly in personalized medicine. The generalized Lotka–Volterra (gLV) model is commonly used to understand microbial interactions and predict ecosystem dynamics. However, gLV models often fail to capture complex interactions, especially when data are limited or noisy. This study critically assesses the effectiveness of gLV and similar models using Bayesian inference and a model reduction method based on information theory. We found that ecological data often leads to non-interpretability and overfitting due to limited information, noisy data and parameter sloppiness. Our results highlight the need for simpler models that align with the available data and propose a distribution-based approach to better capture ecosystem diversity, stability and competition. These findings challenge current bottom-up ecological modelling practices and aim to shift the focus towards a statistical mechanics view of ecology based on distributions of parameters.