For me, it's not that smaller is better. It's that lighter is better.
There's very little difference in size between a 1/64 oz trout magnet and a slider grub on a 1/32 oz head, but the latter is twice as heavy. Bream like that slow drop through the water column.