Either dropping down too fast, or jigging the bait too hard, or the split shot is too close to the jig