So basically the jig is going to be in the sweet spot for a very short amount of time
The way to overcome that is to use a small float or bobber (there are plenty of different types to choose from) and set your jig at the depth you want it to fish at, then you can slow roll it back in keeping yourself in the "sweet spot" for the entire cast.