I scale everything and hand filet...IMHO most of the flavor comes from the skin holding fat and juices in.
My grandmother taught me to filet and over the years I became pretty quick....now that I'm getting older I've been working with my son.