TARU PUBLICATIONS
Journal of Information and Optimization Sciences cover
Hybrid ·Peer-reviewed·ISSN (Online): 2169-0103·ISSN (Print): 0252-2667

WoS  JIF 2026 : 0.4 (Q4)

Powered by:Powered by

Monthly Journal: Publishes theoretical and applied research on topics in information and optimization sciences.

Issues up to 2022 co-published with and available at:Taylor & Francis
submissions@tarupublications.com
Open Access Research Article

FakeExpose: Uncovering the falsity of news by targeting the multimodality via transfer learning

* , , ,

* Corresponding author · click or hover a name for details

pp. 301–314Vol. 44Issue 3April 2023DOI: 10.47974/JIOS-1342XML
Published Online:
11 Aug 2023
Article type:
Research Article
Language:
EN
Article no.:
JIOS-1342
Pages:
301–314

Abstract

Social media for news utilization has its own pros and cons. There are several reasons why people look for and read news through internet media. On the one hand, it is easier to access, and on the other, social media’s dynamic content and misinformation pose serious problems for both government and public institutions. Several studies have been conducted in the past to classify online reviews and their textual content. The current paper suggests a multimodal strategy for the (FND) task that covers both text and image. The suggested model (FakeExpose) is created to automatically learn a variety of discriminative features, instead of relying on manually created features. Several pre-trained words and image embedding models, such as DistilRoBERTa and Vision Transformers (ViTs) are used and fine-tined for the best feature extraction and the various word dependencies. Data augmentation is used to address the issue of pre-trained textual feature extractors not processing a maximum of 512 tokens at a time. The accuracy of the presented model on PolitiFact and GossipCop is 91.35 percent and 98.59 percent, respectively, based on current standards. According to our knowledge, this is the first attempt to use the FakeNewsNet repository to reach the maximum multimodal accuracy. The results show that combining text and image data improves accuracy when compared to utilizing only text or images (Unimodal). Moreover, the outcomes imply that adding more data has improved the model’s accuracy rather than degraded it.

Keywords

Subject Classifications

68T50

References

[1] K. Shu, L. Cui, S. Wang, D. Lee, and H. Liu, “dEFEND: Explainable Fake News Detection,” Proc. 25th ACM SIGKDD Int. Conf. Knowl. Discov. data Min., pp. 395-405 (2019), doi: 10.1145/3292500.3330935.
[2] X. Zhou, R. Zafarani, K. Shu, and H. Liu, “Fake News: Fun-damental Theories, Detection Strategies and Challenges,” vol. 19 (2019), doi: 10.1145/3289600.3291382.
[3] Y. Wang et. al., “EANN: Event adversarial neural networks for multi-modal fake news detection,” Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., pp. 849-857 (Jul. 2018), doi: 10.1145/3219819.3219903.
[4] S. Singhal, A. Kabra, M. Sharma, R. R. Shah, T. Chakraborty, and P. Kumaraguru, “SpotFake+: A multimodal framework for fake news detection via transfer learning (student abstract),” AAAI 2020 - 34th AAAI Conf. Artif. Intell., pp. 13915-13916 (2020), doi: 10.1609/aaai.v34i10.7230.
[5] S. Singhal, R. R. Shah, T. Chakraborty, P. Kumaraguru, and S. Satoh, “SpotFake: A multi-modal framework for fake news detection,” Proc. - 2019 IEEE 5th Int. Conf. Multimed. Big Data, BigMM 2019, pp. 39-47 (Sep. 2019), doi: 10.1109/BIGMM.2019.00-44.
[6] D. Khattar, M. Gupta, J. S. Goud, and V. Varma, “MvaE: Multimodal variational autoencoder for fake news detection,” in The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019, pp. 2915-2921 (May 2019). doi: 10.1145/3308558.3313552.
[7] V. R. Suri, B., Taneja, S., Aggarwal, S., & Sharma, “Fake news detection tool (FNDT): Shield against sentimental deception,” J. Inf. Optim. Sci., vol. 41, no. 6, pp. 1513-1524 (2020), [Online]. Available: https://doi.org/10.1080/02522667.2020.1802125
[8] S. K. Malhotra, P., & Malik, “Fake news detection using supervised machine learning techniques.,” J. Inf. Optim. Sci., vol. 43, no. 1, pp. 7-15 (2022).
[9] X. Ma and E. Hovy, “End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF,” 54th Annu. Meet. Assoc. Comput. Linguist. ACL 2016 - Long Pap., vol. 2, pp. 1064-1074 (Mar. 2016), doi: 10.48550/arxiv.1603.01354.
[10] T. Chen, L. Wu, X. Li, J. Zhang, H. Yin, and Y. Wang, “Call AAention to Rumors: Deep AAention Based Recurrent Neural Networks for Early Rumor Detection”, Accessed: Sep. 28, 2022. [Online]. Available: www.dailymail.co.uk/news/article-2313652/AP-Twiier-hackers-break-news-
[11] J. MA et. al., “Detecting rumors from microblogs with recurrent neural networks,” Proc. 25th Int. Jt. Conf. Artif. Intell. (IJCAI 2016), pp. 3818–3824, Jul. 2016, Accessed: Jul. 29, 2022. [Online]. Available: https://ink.library.smu.edu.sg/sis_research/4630.
[12] H. Jwa, D. Oh, K. Park, J. M. Kang, and H. Lim, “exBAKE: Automatic Fake News Detection Model Based on Bidirectional Encoder Representations from Transformers (BERT),” Appl. Sci. 2019, Vol. 9, Page 4062, vol. 9, no. 19, p. 4062 (Sep. 2019), doi: 10.3390/APP9194062.
[13] R. Rajesh Kumar, E., Rama Rao, K. V. S. N., Nayak, S. R., & Chandra, “Suicidal ideation prediction in twitter data using machine learning techniques.,” J. Interdiscip. Math., vol. 23, no. 1, pp. 117-125 (2020), [Online]. Available: https://doi.org/10.1080/09720502.2020.1721674.
[14] K. Nakamura, S. Levy, and W. Y. Wang, “r/Fakeddit: A new multimodal benchmark dataset for fine-grained fake news detection,” Lr. 2020 - 12th Int. Conf. Lang. Resour. Eval. Conf. Proc., pp. 6149-6157 (2020).
[15] K. Shu, D. Mahudeswaran, S. Wang, D. Lee, and H. Liu, “FakeNewsNet: A Data Repository with News Content, Social Context, and Spatiotemporal Information for Studying Fake News on Social Media,” Big data, vol. 8, no. 3, pp. 171-188 (Jun. 2020), doi: 10.1089/BIG.2020.0062.
[16] M. Raghu, T. Unterthiner, S. Kornblith, C. Zhang, and A. Dosovitskiy, “Do Vision Transformers See Like Convolutional Neural Networks?,” Adv. Neural Inf. Process. Syst., vol. 34, pp. 12116-12128 (Dec. 2021).
Views: 229Downloads: 75Citations: 0