Algorithmic Trading with Fitted Q Iteration and Heston Model
Abstract
We present the use of the fitted Q iteration in algorithmic trading. We show that the fitted Q iteration helps alleviate the dimension problem that the basic Q-learning algorithm faces in application to trading. Furthermore, we introduce a procedure including model fitting and data simulation to enrich training data as the lack of data is often a problem in realistic application. We experiment our method on both simulated environment that permits arbitrage opportunity and real-world environment by using prices of 450 stocks. In the former environment, the method performs well, implying that our method works in theory. To perform well in the real-world environment, the agents trained might require more training (iteration) and more meaningful variables with predictive value.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2018
- DOI:
- 10.48550/arXiv.1805.07478
- arXiv:
- arXiv:1805.07478
- Bibcode:
- 2018arXiv180507478L
- Keywords:
-
- Quantitative Finance - Trading and Market Microstructure;
- Quantitative Finance - Computational Finance
- E-Print:
- 12 pages, 4 figures