I usually start seeing next year's egg sacs in late Summer/early Fall around here.

I would think any egg sacs left in your fish would be discolored if they were leftovers, but yellow if they were new sacs developing.