Slow down and go to a lighter jig. Try some 1/80 oz. And use a loop knot.