An intelligent system for complex violence pattern analysis and detection

Fath U.Min Ullah, Mohammad S. Obaidat, Khan Muhammad, Amin Ullah, Sung Wook Baik, Fabio Cuzzolin, Joel J.P.C. Rodrigues, Victor Hugo C. de Albuquerque

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Video surveillance has shown encouraging outcomes to monitor human activities and prevent crimes in real time. To this extent, violence detection (VD) has received substantial attention from the research community due to its vast applications, such as ensuring security over public areas and industrial settings through smart machine intelligence. However, because of changing illumination, complex background and low resolution, the analysis of violence patterns remains challenging in the industrial video surveillance domain. In this paper, we propose a computationally intelligent VD approach to precisely detect violent scenes through deep analysis of surveillance video sequential patterns. First, the video stream acquired through the vision sensor is processed by a lightweight convolutional neural network (CNN) for the segmentation of important shots. Next, temporal optical flow features are extracted from the informative shots via a residential optical flow CNN. These are concatenated with appearance-invariant features extracted from a Darknet CNN model. Finally, a multilayer long short-term memory network is plugged to generate the final feature map for learning the violence patterns in a sequence of frames. In addition, we contribute to the existing surveillance VD data set by considering its indoor and outdoor scenarios separately for the proposed method's evaluation, achieving a 2% increase in accuracy over surveillance fight data set. Experiments also show encouraging results over the state of the art on other challenging benchmark data sets.

Original languageEnglish
Pages (from-to)10400-10422
Number of pages23
JournalInternational Journal of Intelligent Systems
Volume37
Issue number12
DOIs
StatePublished - Dec 2022

Keywords

  • LSTM
  • artificial intelligence
  • complex pattern analysis
  • convolutional neural network
  • intelligent system
  • violence detection

Fingerprint

Dive into the research topics of 'An intelligent system for complex violence pattern analysis and detection'. Together they form a unique fingerprint.

Cite this