A Hybrid SQL Query Execution Model for JSON Data: Balancing Resource Efficiency and Analytical Performance
Abstract
The rapid growth of unstructured and semi- structured data has necessitated the development of efficient query execution frameworks capable of handling complex data formats such as JSON. This paper presents a hybrid framework that intelligently leverages Apache Drill and DuckDB to optimize SQL query execution on JSON data. Our framework dynamically selects the appropriate query engine based on dataset size, available memory, and the nature of the SQL workload, effectively balancing memory efficiency with analytical performance. We explore the advantages of using Apache Drill for complex joins and nested JSON data, while DuckDB is employed for analytical queries when sufficient memory resources are available. Experimental results demonstrate the framework’s capability to reduce execution time and enhance resource utilization across various workloads. By providing insights into hybrid query processing techniques, this work aims to contribute to the efficient management of JSON
data in modern data-driven applications.
Keywords:
Hybrid Framework, SQL Queries, JSON Data, Apache Drill, DuckDB, Query Execution, Memory Utilization, Analytical Workload
Published
Issue
Section
License
Copyright (c) 2024 International Journal on Emerging Research Areas
This work is licensed under a Creative Commons Attribution 4.0 International License.
All published work in this journal is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
How to Cite
Similar Articles
- Sebin Thomas, John VG, Josin Chacko, Mariyam Shajahan, Sharon Sunny, PPT GENERATION FROM REPORT , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
- V Amarjith, Anaswara Anil, Anju Viswam, KM Aravind, Multilingual Hardcoded Subtitle Extractor , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Yamini C.K, Ajin krishna K U, Akhil Thilak, Amith Raj P R, Aromal A S, Alex joy, Jishnu Babu T, Jeswin jaison, VIDEO MOMENT RETRIEVAL SYSTEM , International Journal on Emerging Research Areas: Vol. 5 No. 1 (2025): IJERA
- Rohan R Krishna, Ron Mathew Modayil, Tintu Alphonsa Thomas, Saran Sankar, Rosh Aben Jacob, Better Banking: Smart Approach to Financial Decision Making , International Journal on Emerging Research Areas: Vol. 5 No. 1 (2025): IJERA
- Athira Sankar, Sajishma S R, Alan Raj, Vaishnavi A K, Reshmi S Kaimal, Hydro Sense: Empowering Water Quality Monitoring Through IoT And ML , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Ethen Biju, Chris Mathew, Alina Ann Joseph, Diya Kalyan, Ria Mathews, DaceStudio: AI-Driven Code Editing for Next-Gen Software Development , International Journal on Emerging Research Areas: Vol. 5 No. 1 (2025): IJERA
- NITHYA M V, ADIL SIYAD K.M, AFINSHA P.B, GAUTHAM T.S, ABHIJITH K.P, SALIH SUDHEER, ARJUN SANKAR R.S, C.S ADHITHYAN, JEWELLERY SHOPPING WITH FACIAL RECOGNITION , International Journal on Emerging Research Areas: Vol. 5 No. 1 (2025): IJERA
- Alan Binoy, Sajin Santy, Hashna Mansoor, Semin Shaji, Almaria Joseph , A Blind-Friendly Navigation System Integrating RFID Technology for Enhanced Accessibility in Public Transportation , International Journal on Emerging Research Areas: Vol. 4 No. 1 (2024): IJERA
- Badarunnisa T S, Albert Titto, Ajay C R, Vivek K R, Nandakumar M M, Sreehari N A, Ajildeep U P, Pinto Sabu, NOTE NEXUS , International Journal on Emerging Research Areas: Vol. 5 No. 1 (2025): IJERA
- Adams Mathew, Adithya Sanil, Akhil J Medackal, Nikhil J Medackal, Dyni Thomas, A Literature Review on IMAGE FORGERY DETECTION , International Journal on Emerging Research Areas: Vol. 3 No. 1 (2023): IJERA
You may also start an advanced similarity search for this article.