I have the same issue when I pan fry like that. Cant do too many before I need to clean the skillet and change the oil. One thing I have found with crappie though is that they tend to stay much more firm when pan fried as opposed to deep fried. For some reason deep frying tends to make them more soft or mushy.