TARU PUBLICATIONS
Journal of Information and Optimization Sciences cover
Hybrid ·Peer-reviewed·ISSN (Online): 2169-0103·ISSN (Print): 0252-2667

WoS  JIF 2026 : 0.4 (Q4)

Powered by:Powered by

Monthly Journal: Publishes theoretical and applied research on topics in information and optimization sciences.

Issues up to 2022 co-published with and available at:Taylor & Francis
submissions@tarupublications.com
Open Access Research Article

Hate content detection through prompt engineering : A pioneering attempt

* , ,

* Corresponding author · click or hover a name for details

pp. 107–119Vol. 46Issue 1January 2025DOI: 10.47974/JIOS-1856XML
Received:
14 Aug 2024
Published Online:
19 Feb 2025
Article type:
Research Article
Language:
EN
Article no.:
JIOS-1856
Pages:
107–119

Abstract

The detection of hate speech is a difficult task and an active study subject at the moment. Effective hate speech identification is more important than ever in a time when a sizable section of the populace uses social media to express their emotions, feelings, rage, and anxiety as well as to look for protection. Conventional approaches to detecting hate content typically rely on hate-related keywords or utilize a labelled dataset to train a learning model. However, hate speech often stands out more due to its context. Conversely, training a learning model requires a substantial amount of labelled data. This paper explores a pioneering approach to hate content detection in the Bengali language through the innovative use of prompt engineering. We develop and apply dynamic prompts that improve the model’s comprehension and recognition of complex hate speech in a range of circumstances by utilizing the power of sophisticated language models. Using the publicly accessible HASOC 2023 dataset, we tested ChatGPT in our experiment and compared its performance to the state-of-the-art. 

Keywords

Subject Classifications

68T50 Natural language processing

References

[1] P. Mandal, A. Senapati, and A. Nag, “Hate-Speech Detection in News Articles: In the Context of West Bengal Assembly Election 2021,” Pattern Recognition and Data Analysis with Applications, Lecture Notes in Electrical Engineering, Springer, vol. 888, pp. 247-256 (2022).
[2] Oxford English Dictionary, s.v. “hate speech (n.),” Mar. (2024). [Online]. Available: https://doi.org/10.1093/OED/2283136643.
[3] K. Ghosh and A. Senapati, “Hate speech detection in low-resourced Indian languages: An analysis of transformer-based monolingual and multilingual models with cross-lingual experiments,” Cambridge University Press, pp. 1–22 (2024).
[4] K. Ghosh, A. Senapati, M. Narzary, and M. Brahma, “Hate Speech Detection in Low-Resource Bodo and Assamese Texts with ML-DL and BERT Models,” Scalable Computing: Practice and Experience, vol. 24, pp. 941–955 (2023).
[5] T. Mandl, M. J. R. S. Tjandra, V. L. S. V. D. G., D. A. H. P. Y., and M. S. L. R., “Overview of the HASOC track at FIRE 2019: Hate speech and offensive content identification in Indo-European languages,” Proceedings of the 11th Annual Meeting of the Forum for Information Retrieval Evaluation, pp. 14–17 (2019).
[6] S. Yadav, A. Singh, R. S. K. S., and P. Tiwari, “Leveraging Weakly Annotated Data for Hate Speech Detection in Code-Mixed Hinglish: A Feasibility-Driven Transfer Learning Approach with Large Language Models,” arXiv preprint arXiv:2403.02121 (2024).
[7] J. Antonio, P. Garcia, S. C. Soto, and L. S. Gomez, “Leveraging Zero and Few-Shot Learning for Enhanced Model Generality in Hate Speech Detection in Spanish and English,” Mathematics, MDPI, vol. 11, p. 5004 (2023).
[8] F. Arco, J. Santos, P. Diaz, and L. Rodriguez, “Respectful or Toxic? Using Zero-Shot Learning with Language Models to Detect Hate Speech,” The 7th Workshop on Online Abuse and Harms (WOAH), pp. 60–68 (2023).
[9] T. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, and S. M. Mishra, “Language models are few-shot learners,” Advances in Neural Information Processing Systems, vol. 33, pp. 1877-1901 (2020).
[10] S. Bsharat, M. Khalil, S. Mahmood, and J. Anwar, “Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4,” arXiv preprint arXiv:2312.16171 (2023).
[11] J. Wei, P. Devlin, and W. Lee, “Finetuned Language Models Are Zero-Shot Learners,” arXiv preprint arXiv:2109.01652 (2021).
[12] P. Christiano, G. Dhariwal, and J. K. R. Y. Sharma, “Deep reinforcement learning from human preferences,” Advances in Neural Information Processing Systems, vol. 30 (2023).
[13] S. Min, S. Shankar, N. Gupta, and M. Singh, “Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?” Proceedings of EMNLP 2022, pp. 11048–11064 (2022).
[14] J. Wei, C. Ouyang, L. Xu, and T. S. Zhang, “Chain of Thought Prompting Elicits Reasoning in Large Language Models,” Advances in Neural Information Processing Systems, vol. 35, pp. 24824-24837 (2022).
[15] K. Ghosh, M. Chakraborty, M. Choudhury, and P. Dutta, “Annihilate Hates (Task 4, HASOC 2023): Hate Speech Detection in Assamese, Bengali, and Bodo Languages,” FIRE (Working Notes), pp. 368-382 (2023).

Views: 220Downloads: 84Citations: 0