A Hybrid SQL Query Execution Model for JSON Data: Balancing Resource Efficiency and Analytical Performance
Abstract
The rapid growth of unstructured and semi- structured data has necessitated the development of efficient query execution frameworks capable of handling complex data formats such as JSON. This paper presents a hybrid framework that intelligently leverages Apache Drill and DuckDB to optimize SQL query execution on JSON data. Our framework dynamically selects the appropriate query engine based on dataset size, available memory, and the nature of the SQL workload, effectively balancing memory efficiency with analytical performance. We explore the advantages of using Apache Drill for complex joins and nested JSON data, while DuckDB is employed for analytical queries when sufficient memory resources are available. Experimental results demonstrate the framework’s capability to reduce execution time and enhance resource utilization across various workloads. By providing insights into hybrid query processing techniques, this work aims to contribute to the efficient management of JSON
data in modern data-driven applications.
Keywords:
Hybrid Framework, SQL Queries, JSON Data, Apache Drill, DuckDB, Query Execution, Memory Utilization, Analytical Workload
Published
Issue
Section
License
Copyright (c) 2024 International Journal on Emerging Research Areas
This work is licensed under a Creative Commons Attribution 4.0 International License.
All published work in this journal is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
How to Cite
Similar Articles
- R Karthika, Maria Toms, S R Aadrash, P U Prabath, InsightAI: Bridging Natural Language and Data Analytics , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Syam Gopi, Evelyn Susan Jacob, Joel John, Raynell Rajeev, Steve Alex, Survey on AI Malware Detection Methods and Cybersecurity Education , International Journal on Emerging Research Areas: Vol. 4 No. 2 (2024): IJERA
- Amrutha Priya C B, Nitha C Velayudhan, Arjun K S, Aleena Francis, Divya P S, AI Enabled Robot for Data Collection in Unreachable and Extreme Environment , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- P S Aswin, Archana Madhusudhanan , Athulya Sajeev, Neeha Moideen , C R Suhail, Revolutionizing Football Management: A Data-Driven Approach with Random Forest Regressor , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Lis Jose , Achyuth P Murali, Christin Joseph Shaji, Christy Kunjumon Peter , Multiple Detection and Diagnosis of Skin Diseases using CNN , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Melvin Tom Varghese, Joseph V S, Kevin Chacko, Johns Benny, Tintu Alphonsa Thomas, Crop Recommendation System using Machine Learning and IoT , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Rohan Malka, Jerin Joseph Abraham, Jobcy Johnson, Sobin Saju, Febin Sam Philip, Aju Mathew George, S.N.Kumar , Green Waste Utilization for Sustainable Energy Engineering Application: A Path towards Green Circular Economy , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Amal P Varghese, Simy Mary Kurian, Advancements in ECG Heartbeat Classification: A Comprehensive Review of Deep Learning Approaches and Imbalanced Data Solutions , International Journal on Emerging Research Areas: Vol. 3 No. 2 (2023): IJERA
- Ankith Issac Dominic, Meera Johnson, Jaida Fathima, Alaina Benny, Amritha Soloman, PARK-EZE: An IoT based Smart Parking System using DLSTM Prediction , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Dona S Plavelil, A Devanandha, Haritha H Kurupp, Jissin k Jose, DETECTION OF ALZHEIMER’S DISEASE AND ASSISTANCE , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
You may also start an advanced similarity search for this article.