A Hybrid SQL Query Execution Model for JSON Data: Balancing Resource Efficiency and Analytical Performance
Abstract
The rapid growth of unstructured and semi- structured data has necessitated the development of efficient query execution frameworks capable of handling complex data formats such as JSON. This paper presents a hybrid framework that intelligently leverages Apache Drill and DuckDB to optimize SQL query execution on JSON data. Our framework dynamically selects the appropriate query engine based on dataset size, available memory, and the nature of the SQL workload, effectively balancing memory efficiency with analytical performance. We explore the advantages of using Apache Drill for complex joins and nested JSON data, while DuckDB is employed for analytical queries when sufficient memory resources are available. Experimental results demonstrate the framework’s capability to reduce execution time and enhance resource utilization across various workloads. By providing insights into hybrid query processing techniques, this work aims to contribute to the efficient management of JSON
data in modern data-driven applications.
Keywords:
Hybrid Framework, SQL Queries, JSON Data, Apache Drill, DuckDB, Query Execution, Memory Utilization, Analytical Workload
Published
Issue
Section
License
Copyright (c) 2024 International Journal on Emerging Research Areas
This work is licensed under a Creative Commons Attribution 4.0 International License.
All published work in this journal is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
How to Cite
Similar Articles
- Joel Lee George, Karthik S Kumar , Riya Merce Thomas, Roshan Roy Varghese, Simy Mary Kurian, Epidemo A Machine Learning Regression-Based , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Amal P Varghese , Juby Mathew, Advancements in Vehicular Communication Systems: Integrating IoT, Edge Cloud Computing, Microgrid Energy Management, Blockchain, AI, and Simulation Tools , International Journal on Emerging Research Areas: Vol. 3 No. 2 (2023): IJERA
- Jefrin Siby Mathew, Joyal Joseph, Roshik George, Tinu Rose Thottungal , Honey Joseph, Multiple Disease Detection using Machine Learning , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
- Mrs. Lis Jose, Akhil Lorence, Akhil Manohar, Amal Jose Chacko, Arjun J, Lung Disease Detection From Chest X-ray Images Using Hybrid Machine Learning Model , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Sandra Saji, Melbin Mathew, Angel Mariya S, Amrutha Mugesh, Jincy Lukose, MACHINE LEARNING FOR DETECTION AND PREDICTION OF TOMATO LEAF DISEASES , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
- Akhil Mathew Mohan, Alan Maria George, Arathy Baby, Gopika S, Syam Gopi, Abubeker K.M, Real-time Air Quality Index Monitoring and Alert System using IoT Technology , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
- Adhil Salim, Advaith Manoj, Alan Thomas Shaji, The Future of Encryption in the Face of Advancing Quantum Computing Technology , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
- M Midhun, Sangeetha Tony, Tibin Abraham, B Vyshnav, ACCIDENT DETECTION USING VIDEO SURVEILLANCE , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
- Elisabeth Thomas, Arjun Saji, Aswin M S, Augustine Salas, Emil Viju, A Comprehensive Review of Advancing Cattle Monitoring and Behavior Classification using Deep Learning , International Journal on Emerging Research Areas: Vol. 4 No. 2 (2024): IJERA
- ANU ROSE JOY, Christeena Antony, Dona Mariyam John, Anuja Sara Mathew, Christeen Mareia Paul, UnLocking Emotion Recognition in ASD Children: Analyzing Facial Expressions , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
You may also start an advanced similarity search for this article.