This paper evaluates the suitability and limitations of Explainable AI (XAI) methods for regression problems prevalent in geoscientific applications. It reviews various XAI techniques, applies a selection to a machine learning emulator of the Lorenz-63 system, and surveys their use across Earth system sciences to provide practical recommendations for effective XAI.