Presentation
14 May 2019 Adaptive data collection and retention planning to support cyber analytics (Conference Presentation)
Author Affiliations +
Abstract
The amount of network traffic and host log data collected by the commercial and government organizations to maintain their security is growing every day due to proliferation of cyber sensors and security appliances. However, these huge amounts of data can no longer be stored efficiently or processed in real time. Security analysts need to make decisions about what data is most effective for current and novel attack detection, what data may be relevant to analyze in forensic mode, and what data can be aggregated and discarded without significant degradation to the enterprise security. Making these decisions manually, and reasoning about both utility of attack detection and the cost of data management, is infeasible. In this paper, we will present a model for developing a plan for data collection and archiving that adapts the sensor and storage state configuration to the analytical systems available in the organization, threats detected by those systems over time, and capacity and cost of collection and storage resources. Our planning model computes the sensor state and data archiving actions via approximate variational inference, decomposing the planning problem into perception, learning, and control, which enables tractable plan construction and incremental updates.
Conference Presentation
© (2019) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Georgiy M. Levchuk "Adaptive data collection and retention planning to support cyber analytics (Conference Presentation)", Proc. SPIE 11013, Disruptive Technologies in Information Sciences II, 1101304 (14 May 2019); https://doi.org/10.1117/12.2519104
Advertisement
Advertisement
KEYWORDS
Analytics

Computer security

Data modeling

Network security

Sensors

Data archive systems

Systems modeling

Back to Top