I never go without it...I've actually broken one before going down into a camping area that I hadn't been in before and found a big dip...attached it with zip ties and ropes after that.

Your transom WILL get weakened bouncing down the road without one..not to mention the possibilty of it falling as has already been said.