I've caught fish from a fertilized pond many times and never detected a change in taste. Considering how minutely the fertilizer gets dissipated throughout the water column, I doubt one could detect it if one tried.