Pay for a Sliding Bloom Filter and Get Counting, Distinct Elements, and Entropy for Free
Abstract
For many networking applications, recent data is more significant than older data, motivating the need for sliding window solutions. Various capabilities, such as DDoS detection and load balancing, require insights about multiple metrics including Bloom filters, per-flow counting, count distinct and entropy estimation. In this work, we present a unified construction that solves all the above problems in the sliding window model. Our single solution offers a better space to accuracy tradeoff than the state-of-the-art for each of these individual problems! We show this both analytically and by running multiple real Internet backbone and datacenter packet traces.
- Publication:
-
arXiv e-prints
- Pub Date:
- December 2017
- DOI:
- 10.48550/arXiv.1712.01779
- arXiv:
- arXiv:1712.01779
- Bibcode:
- 2017arXiv171201779A
- Keywords:
-
- Computer Science - Data Structures and Algorithms
- E-Print:
- To appear in IEEE INFOCOM 2018