University of Calgary
In this paper, the authors describe the support for data feed ingestion in AsterixDB, an open-source Big Data Management System (BDMS) that provides a platform for storage and analysis of large volumes of semi-structured data. Data feeds are a mechanism for having continuous data arrive into a BDMS from external sources and incrementally populate a persisted dataset and associated indexes. The need to persist and index \"Fast-flowing\" high-velocity data (and support ad hoc analytical queries) is ubiquitous. However, the state of the art today involves 'Gluing' together different systems. AsterixDB is different in being a unified system with \"Native support\" for data feed ingestion.