I think I am on to something with the leader length. I've never had an issue with these rigs for perch or other species but, I think it really has something to do with how they hit. With a short leader (say 4 inches or less), they have zero upward movement.

I'm going to play around again on my next trip. Maybe a 12 inch leader will do it. This is what happens when I am not out on the walleye waters for an extended period of time. I start trying to figure stuff out!