Two things that might help :

Use solid body tubes .... they're harder to pull down on the jighead. (if jighead has a retainer barb)

Use weedless jigheads (when casting) .... you'll lose far less of them than regular jigheads. Use your regular jigheads when trolling methods are used.

And you are correct (mostly) that the ratatatat "bite" is usually Bluegill, and the "one & done" tap is usually Crappie. "USUALLY", but not always.