If you take this argument to its logical conclusion all laws and regulations are good and freedom does not exist. In reality the definition of "harm" and the laws and regulations that are necessary and desirable to mitigate these harms are very much up for debate.
It is nakedly authoritarian for the government to restrict, at the point of a gun, consenting adults from choosing their own method of transaction.
It is nakedly authoritarian for the government to restrict, at the point of a gun, consenting adults from choosing their own method of transaction.