Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables
Abstract
Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.
- Publication:
-
Physical Review Letters
- Pub Date:
- December 2009
- DOI:
- arXiv:
- arXiv:0910.4514
- Bibcode:
- 2009PhRvL.103w8701B
- Keywords:
-
- 89.70.Cf;
- 05.40.-a;
- 87.10.Mn;
- 87.19.lo;
- Entropy and other measures of information;
- Fluctuation phenomena random processes noise and Brownian motion;
- Stochastic modeling;
- Information theory;
- Mathematical Physics
- E-Print:
- In review, Phys. Rev. Lett., Nov. 2009