Sometimes the conditions are such that the bite is tough and only little ones bite.
That's just the way it is.
Try bigger baits.Then there's always dynomite.