I saw the same thing last weekend. The fish we saw breaking the surface were over 20", and the ones we were catching on the bottom were 12".

How about putting a weighted float on the end of the line, and rigging bait a couple feet back? I primarily use dip-bait, and my favorite tubes have a small sponge intended to float them off the bottom. It might just work.

Just thinkin' ...