I hear what you are saying about PVC--It may be that most water is purified, but I have well water.
I know that making or storing wine or booze in plastic jugs is bad tasting and may be a health hazard.
Supposely the chemicals within the PVC material takes a while to surface---I do know the Millwood lake manager told the park rangers to stop and fine anyone abusing the lake and to report them to him.
Buckets is what a lot of crappie fisherman use for condo's---I have switched to trees and sandbags--much easier to use and to place out in the water.