Could be a school of baitfish. I've done the same thing but trust me when you see a big blob on the bottom going up, it's brush. You may want to adjust the sensitivity on the depthfinder.