Make sure you pat the fillets off with a paper towel before you bread them.
I don't know that rigor mortise has anything to do with fish meat(it could?), but it does with red meat. I grew up eating fresh fish every weekend just a few hours after they're filleted... Other than that, it sounds like you may just be used to different texture fish?