TARU PUBLICATIONS
Journal of Information and Optimization Sciences cover
Open Access ·Peer-reviewed·ISSN (Online): 2169-0103·ISSN (Print): 0252-2667

WoS  JIF 2026 : 0.4 (Q4)

Powered by:Powered by

Monthly Journal: Publishes theoretical and applied research on topics in information and optimization sciences.

Issues up to 2022 co-published with and available at:Taylor & Francis
submissions@tarupublications.com
Open Access Research Article

Identification of social network automated hate speech using GLTR with BERT and GPT-2 : A novel approach

, , *

* Corresponding author · click or hover a name for details

pp. 315–331Vol. 45Issue 2March 2024DOI: 10.47974/JIOS-1549XML
Published Online:
17 Mar 2024
Article type:
Research Article
Language:
EN
Article no.:
JIOS-1549
Pages:
315–331

Abstract

Automated hate speech on social media is a serious issue for online safety and wellbeing. A promising strategy to address the issue is the identification of artificial hate speech using machine learning techniques. The authors present research on the detection of automated hate speech on social networks with the use of GLTR (Giant Language model Test Room) along with BERT (Bidirectional Encoder Representations from Transformers) as well as GPT-2 (Generative Pretrained Transformer 2) on the four widely used benchmark datasets (ETHOS, Founta, Waseem, and Davidson). The performance of the proposed approach was evaluated by comparing F1 scores, precision, recall, and accuracy with other state-of-the-art machine algorithms. The results show that the proposed approach out performs other algorithms on all four datasets. The results indicate that the GLTR approach with BERT and GPT-2 models is a promising method for automated hate speech detection on social networks. 

Keywords

Subject Classifications

Primary 68TSecondary 68U

References

[1] Badjatiya, P., Gupta, S., Gupta, M., & Varma, V., Deep learning for hate speech detection in tweets. In Proceedings of the 26th International Conference on World Wide Web, pp. 759-760 (2017). 
[2] Davidsson, P., Hansen, A. H., & Haddadi, H., Automated hate speech detection and the problem of offensive language. In Proceedings of the 26th International Conference on World Wide Web Companion, pp. 1445-1453 (2017). 
[3] Davidson, T., Warmsley, D., Macy, M., & Weber, I., Automated hate speech detection and the problem of offensive language. Proceedings of the International AAAI Conference on Web and Social Media, 512-515 (2017). 
[4] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K., BERT: Pre-training of deep bidirectional transformers for language understanding (2019). arXiv preprint arXiv:1810.04805.
[5] Founta, A. M., Djouvas, C., Chatzakou, D., Leontiadis, I., Blackburn, J., & Stringhini, G., Large-scale crowdsourcing and characterization of Twitter abusive behavior. In Proceedings of the 11th International AAAI Conference on Web and Social Media, pp. 13-23 (2018).
[6] Fortuna, P., Nunes, S., & Sarmento, L., Hate speech detection in social networks using semantic graph representation. Expert Systems with Applications, 151, 113312 (2020).
[7] Gao, W., Xie, S., Li, X., & Zhang, F., Hierarchical recurrent neural network for hate speech detection. In Proceedings of the 27th International Conference on Computational Linguistics, pp. 2972-2983 (2018). 
[8] Garg, S., & Gopalakrishnan, V., Multilingual hate speech detection with cross-lingual transfer learning. Expert Systems with Applications, 166, 113767 (2021).
[9] Gehrmann, S., Strobelt, H., & Rush, A. M., GLTR: Statistical detection and visualization of generated text (2019). arXiv preprint arXiv:1906.04043. 
[10] Kumar, R., Gupta, R., Bansal, S., & Varma, V., Hate speech detection: A solved problem? The challenge of offensive language in social media. In Proceedings of the 12th ACM International Conference on Web Search and Data Mining, pp. 783-791 (2020). 
[11] Kumar, V., Pratap, S., & Varma, V., Hate speech detection in Twitter: A comparative study of machine learning algorithms. In 2020 IEEE Region 10 Symposium (TENSYMP), pp. 1684-1688. IEEE (2020). 
[12] Majumder, P., Poria, S., & Gelbukh, A., Deep learning based hate speech detection: An empirical study. Information Processing & Management, 57(1), 102135 (2020).
[13] Mishra, A., Singh, A., & Ahirwal, M. K., Adversarial Training for Improving Hate Speech Detection using LSTM and CNN. Expert Systems with Applications, 168, 114390 (2021).
[14] Nobata, C., Tetreault, J., Thomas, A., Mehdad, Y., & Chang, Y., Abusive language detection in online user content. In Proceedings of the 25th International Conference on World Wide Web, pp. 145-153 (2016). 
[15] Poria, S., Sharma, G., De Sarkar, S., Gelbukh, A., & Cambria, E., BERT for hate speech detection in social media: An empirical analysis. In Proceedings of the 28th International Conference on Computational Linguistics , (pp. 1499-1505 (2020). 
[16] Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I., Language models are unsupervised multitask learners. OpenAI Blog, 1(8), 9 (2019). 
[17] Schmidt, A., Wiegand, M., & Jurafsky, D., Offensive language detection and relevance detection in online conversations. Proceedings of the International Conference on World Wide Web, 311-320 (2017). 
[18] Smith, A., Anderson, M., & Duggan, M., Harassment is a common part of online life for many adults in the United States. Pew Research Center (2019). 
[19] Statista. Number of social media users worldwide from 2010 to 2021 (2022).https://www.statista.com/statistics/278414/number-of-worldwide-social-network-users/. 
[20] Statt, N. 510,000 comments are posted on Facebook every 60 seconds (2021). https://www.theverge.com/2021/10/25/22744761/facebook-510000-comments-every-60-seconds.
[21] Thakur, A., & Nigam, A., Multi-view attention mechanism for hate speech detection. Applied Soft Computing, 105, 107210 (2021).
[22] Wang, W., Lu, Y., Zuo, X., & Zhang, X., Detecting hate speech in social media using semantic convolutional neural networks. IEEE Transactions on Computational Social Systems, 6(2), 352-362 (2019).
[23] Wang, Y., Jiang, J., Shi, Y., Zhang, X., & Li, C., An approach for community detection in social semantic networks based on clustering and label propagation. IEEE Access, 7, 10398-10408 (2019).
[24] Waseem, Z., & Hovy, D., Hateful symbols or hateful people? Predictive features for hate speech detection on Twitter. In Proceedings of the NAACL student research workshop, pp. 88-93 (2016). 
[25] Wiegreffe, S., & Pinter, Y., Attention is not Explanation (2019). arXiv preprint arXiv:1902.10186. 
[26] Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V., XLNet: Generalized autoregressive pretraining for language understanding. In Advances in neural information processing systems, pp. 5754-5764 (2019). 
[27] Zeng, Y., Chen, Y., & Wang, F., Personalized recommendation via social semantic network embedding. Information Sciences, 558, 327-341 (2021). 
[28] Zhang, Z., Li, X., & Wang, W., Detecting hate speech against immigrants using Twitter data: A NLP approach. In Proceedings of the 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 953-960 (2018). 

Views: 302Downloads: 104Citations: 1