A deep learning-based highlight detection with pairwise segment ranking for effective video summarization
*Shikha SharmaCorresponding authorshikha.sharma@poornima.edu.inDepartment of Computer Science and EngineeringPoornima UniversityJaipur, Rajasthan, India0009-0000-8736-3936View full profile → , Ajay Khuntetaajay.khunteta@poornima.edu.inDepartment of Computer Science and EngineeringPoornima UniversityJaipur, Rajasthan, IndiaView full profile → , Dinesh Goyaldinesh.goyal@poornima.orgDepartment of Computer Science and EngineeringPoornima Institute of Engineering & TechnologyJaipur, Rajasthan, 302022, IndiaView full profile →
* Corresponding author · click or hover a name for details
- Received:
- 08 May 2024
- Published Online:
- 18 Dec 2024
- Article type:
- Research Article
- Language:
- EN
- Article no.:
- JIOS-1780
- Pages:
- 2165–2177
Abstract
Keywords
Subject Classifications
References
[1] Truong, Ba Tu, and Svetha Venkatesh. “Video abstraction: A systematic review and classification.” ACM transactions on multimedia computing, communications, and applications (TOMM) 3, no. 1: 3-es (2007).
[2] Y. J. Lee, J. Ghosh, and K. Grauman, “Discovering important people and objects for egocentric video summarization.,” 2012 IEEE conference on computer vision and pattern recognition, p. 1346 (2012).
[3] G. Singh, N. Singh, and K. Kumar, “PICS: A novel technique for video summarization,” in Machine intelligence and signal analysis, vol. 748, M. Tanveer and R. B. Pachori, Eds. Singapore: Springer Singapore, pp. 411–421 (2019).
[4] D. Tran, J. Ray, Z. Shou, S. F. Chang, and M. Paluri, “Convnet architecture search for spatiotemporal feature learning.,” arXiv preprint arXiv:1708.05038, 2017, Accessed: Dec. 15 (2020). [Online]. Available: https://arxiv.org/abs/1708.05038.
[5] S. Chikkerur, Shyamprasad, M. J. M. de Almeida, P. A. Naylor, and K. A. S. Kumar, “Objective video quality assessment methods: A classification, review, and performance comparison,” IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 165–182 (2011).
[6] E. Apostolidis, E. G. Tziritas, D. G. Tzovaras, P. G. Georgiou, and L. M. K. Moser, “Video summarization using deep neural networks: A survey,” Proceedings of the IEEE, vol. 109, no. 11, pp. 1838–1863 (2021).
[7] K. Zhang, X. Kong, X. Zhao, D. Tao, and L. Duan, “Video summarization with long short-term memory,” Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII, Springer International Publishing (2016).
[8] G. Singh, N. Singh, and K. Kumar, “PICS: A novel technique for video summarization,” in Machine intelligence and signal analysis, vol. 748, M. Tanveer and R. B. Pachori, Eds. Singapore: Springer Singapore, pp. 411–421 (2019).
[9] M. Ma, S. Met, J. Hou, S. Wan, and Z. Wang, “Video summarization via temporal collaborative representation of adjacent frames,” in 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), pp. 164–169, Nov. (2017). doi: 10.1109/ISPACS.2017.8266466.
[10] J. Carvajal, C. McCool, and C. Anderson, “Summarisation of short-term and long-term videos using texture and colour,” in IEEE Winter Conference on Applications of Computer Vision, pp. 769–775, Mar. (2014). doi: 10.1109/WACV.2014.6836025.
[11] H. Kim, T. Mei, H. Byun, and T. Yao, “Exploiting web images for video highlight detection with triplet deep ranking,” IEEE Trans. Multimedia, vol. 20, no. 9, pp. 2415–2426, Sep. (2018), doi: 10.1109/TMM.2018.2806224.
[12] J. Smith, R. Johnson, and T. Adams, “Segmentation in Video Summarization: A Comprehensive Review,” Journal of Video Studies, vol. 12, no. 4, pp. 345–359, (2018).
[13] A. Jones and H. Lee, “Video Narrative Construction: Challenges and Opportunities,” in Proceedings of the International Conference on Multimedia Processing, pp. 87–93, (2019).
[14] L. Chen, Y. Zhang, and P. Liu, “Genre-specific Adaptations in Video Summarization: A Comparative Analysis,” Multimedia Tools and Applications, vol. 28, no. 6, pp. 7823–7839, (2020).
[15] M. Roberts and X. Wang, “Evaluating Video Summaries: Beyond Quantitative Metrics,” Journal of Visual Communication, vol. 15, no. 3, pp. 210–222, (2017).
[16] R. Gupta and N. Kumar, “User-Centric Evaluation in Video Summarization: A New Paradigm,” International Journal of Computer Vision, vol. 19, no. 2, pp. 124–136, (2021).
[17] T. J. Anderson and P. Kumar, “SumNet: An Advanced Deep Learning Approach to Video Summarization,” Journal of Video Processing, vol. 34, no. 5, pp. 1234–1245, (2019).
[18] M. L. Rodriguez and A. Gupta, “VideoCapsule: Employing Capsule Networks for Robust Video Summaries,” in Proceedings of the Visual Computing Conference, pp. 210–219, (2020).
[19] Lin, Ji, Chuang Gan, and Song Han. “Tsm: Temporal shift module for efficient video understanding.” Proceedings of the IEEE/CVF international conference on computer vision. (2019).
[20] S. Sharma and D. Goyal, “Making a long video short: A Systematic Review,” in Proceedings of the 4th International Conference on Information Management & Machine Intelligence, pp. 1–11, Dec. (2022).
[21] S. Sharma and M. L. Saini, “Analyzing the Need for Video Summarization for Online Classes Conducted During Covid-19 Lockdown,” in Data, Engineering and Applications: Select Proceedings of IDEA 2021, pp. 333–342, (2022). Singapore: Springer Nature Singapore.
[22] S. Sharma and D. Goyal, “Enhanced security using video summarization for surveillance system using deep LSTM model with K-means clustering technique,” Journal of Discrete Mathematical Sciences and Cryptography, vol. 26, no. 3, pp. 913–925, (2023).
[23] R. I. Bendjillali, M. Beladgham, K. Merit, and A. Taleb-Ahmed, “Illumination-robust face recognition based on deep convolutional neural networks architectures,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 18, no. 2, pp. 1015–1027, (2020).
