TARU PUBLICATIONS
 Journal of Statistics and Management Systems cover
Hybrid ·Peer-reviewed·ISSN (Online): 2169-0014·ISSN (Print): 0972-0510

Monthly Journal: Publishes peer-reviewed aticles on theoretical and applied statistics and management systems, expoloring industrial statistics, actuarial and decision sciences.

Issues up to 2022 co-published with and available at:Taylor & Francis Online
submissions@tarupublications.com
Open Access Research Article

RDBMS to distributed in-memory data grid: A paradigm shift for improved performance

, , *

* Corresponding author · click or hover a name for details

pp. 169–175Vol. 26Issue 1December 2022DOI: 10.47974/JSMS-956XML
Published Online:
31 Dec 2022
Article type:
Research Article
Language:
EN
Article no.:
JSMS-956
Pages:
169–175

Abstract

As per available Cisco VNI report [1], global IP traffic will grow more than three times and global network device connections will be more than 28.5 billion. Availability of high-speed network and connectivity will lead to more online business opportunities to enterprises and in turn will generate large data. Sometimes these large datasets need to be processed in near real time to do some critical analysis. Traditional databases are not designed to do real time data analysis and have challenges in terms of performance and throughput. This paper describes various widely used data storage tools and frameworks currently available and how to achieve the best performance while processing large datasets using in memory data grid. It briefly covers the evolution of in-memory data grid from traditional relational database management systems. It also provides a high-level feature comparison across available in-memory database solutions and how they provide the best of solution for processing real time data beyond Hadoop referencing use cases like fraud detection and genetic data processing. It also emphasizes on leveraging power of GPU alongside CPU to achieve high performance and throughput while processing large data with multiple iterations.

Keywords

Subject Classifications

68P20

References

[1] CISCO Visual Networking Index, https://twiki.cern.ch/twiki/pub/HEPIX/TechwatchNetwork/HtwNetworkDocuments/white-paper-c11-741490.pdf.
[2] Vimala Ithayan, J., and C. Sundar, “A Secured Healthcare Management and Service Retrieval for Society Over Apache Spark Hadoop Environment”, IETE Journal of Research, 2021, pp. 1-20.
[3] H. Fei., C. Yang., Y. Jiang., Y. Li., W. Song., D. Q. Duffy., J. L. Schnase, and T. Lee, “A hierarchical indexing strategy for optimizing Apache Spark with HDFS to efficiently query big geospatial raster data” International Journal of Digital Earth, Vol. 13, No. 3, 2020, pp. 410-428.
[4] E. Shaikh, I. Mohiuddin, Y. Alufaisan and I.Nahvi, “Apache Spark: A Big Data Processing Engine”, 2019 2nd IEEE Middle East and North Africa Communications Conference(MENACOMM). doi:10.1109/menacomm46666.2019.8988541.
[5] A. Katsifodimos and S. Schelter, “Apache Flink: Stream Analytics at Scale”, 2016 IEEE International Conference on Cloud Engineering Workshop (IC2EW), doi:10.1109/ic2ew.2016.56.
[6] R. Evans, “Apache Storm, a Hands on Tutorial”,2015 IEEE International Conference on Cloud Engineering. doi:10.1109/ic2e.2015.67.
[7] List of In-Memory DBs, https://en.wikipedia.org/wiki/List_of_in-memory_databases.
[8] A. Tapekhin, I. Bogomolov, and O. Velikanov, “Analysis of Consistency for In Memory Data Grid Apache Ignite”. 2019 Ivannikov Memorial Workshop (IVMEM). doi:10.1109/ivmem.2019.00013.
[9] T. Priovolos, S. Maroulis and V.Kalogeraki , “A Framework for Managing an Elastic Redis Cache”, 2019 38th Symposium on Reliable Distributed Systems (SRDS). doi:10.1109/srds47363.2019.000.
[10] Hazlecast, https://hazelcast.com/.
[11] A. H. Sojoodi, M. Salimi Beni and F. Khunjush , “Ignite-GPU: a GPU-enabled in-memory computing architecture on clusters”, The Journal of Supercomputing, 2020, pp. 1-28.
[12] R.Bansod, S. Kadarkar, R. Virk, M. Raval, R. Rashinkarand M. Nambiar, “High Performance Distributed In-Memory Architectures For Trade Surveillance System”, 17th International Symposium on Parallel and Distributed Computing, 2018, pp. 101-108.

Views: 154Downloads: 65Citations: 0