Even if the wind weren't blowing with the amount of boats moving around you have a man made wave action that the fish are some what used to.I think your better days fishing come from when you have negative weather such as rain, wind etc. because it cuts down on boat traffic and disturbing the fish.High pressure can effect fish if they are deeper due to the pressure on their swim bladders that keeps them up right. Low pressure fronts are what I look for and sometime that means rain, wind,clouds.But I will fish anytime I get a chance. I just prefer due to cost to look for optimal days.