Interestingly, there is a paper which suggests that at least some groups of Neanderthals had their y chromosome and mitochondrial DNA replaced via an earlier admixture with modern humans https://www.science.org/doi/epdf/10.1126/science.abb6460

This goes against the theory that ms-fn hybrids didn't happen, and suggests instead that they were selected against in modern humans populations