A kayak or canoe or jon boat would get you out and about on the water relatively cheap. Kayak would probably work best just to get out there and not have to worry about much but fishing. And they go wherever you want them to, even really shallow stuff.