When it's gonna be cold all day. Its the chest waders for me. The neoprene isn't that uncomfortable and it is always warm and dry. I also wear a regular vest type life jacket rather than the inflatable.
I wear the chest waders if it's raining or real windy. Never get cold in them.