Perhaps it’s the paradox that makes the travel impossible rather than the physics with the infinite loops settling/converging on the scenario where time travel is not discovered / possible.