A study finds that foundation models in astronomy, trained on survey data including incomplete catalogues, inherit biases related to pixel-level incompleteness, potentially skewing mean redshift measurements. This matters because it highlights systemic issues in how astronomical data is processed and analyzed, impacting the accuracy of cosmological observations.