How heavy a weight are you using now? If I'm drop shotting, I'll go with the lightest weight I can get away with and still be able to get to the bottom quickly. Then I make sure I'm not directly in contact with the sinker, so that I can allow the bait to freely do it's thing.