This is my sailing experience every time I play Valheim. I'm starting to believe the devs put in an RNG variable that makes the wind constantly fight you for certain steam IDs or something.
Some further evidence from playing just now. My friend was sailing the ship and the wind was at our backs, he had to take a phone call so I took over and the moment I sat down the wind abruptly spun around 180 degrees and is blowing in my face. Aaaaaaaaaa