Probing the limit of hydrologic predictability with the Transformer network

First time Transformer achieved the same performance as LSTM on CAMELS dataset. Unmodified vanilla Transformer could not reach LSTM's performance. A non-recurrent connection was added to the Transformer, supporting parallelism. Transformers may have scale advantages for larger datasets. LSTMs and Transformers are likely nearing the prediction limits of the dataset.