TY - GEN
T1 - Applications of Large Language Models to SQL Learning
AU - Chittavally Dugge Gowda, Adwaith
AU - Joshi, Sharvari Rajiv
AU - Tandel, Jaykumar
AU - Zou, Jia
N1 - Publisher Copyright: © 2026 Copyright held by the owner/author(s).
PY - 2026/2/17
Y1 - 2026/2/17
N2 - We present a Large Language Model (LLM)-assisted SQL learning system that closes the loop from problem discovery to grading. Grounded in real-world data-wrangling scenarios, our agentic workflow (i) synthesizes industry-style practice problems with pedagogical metadata, (ii) produces executable reference SQL via a multi-step operator-planning pipeline, and (iii) grades student submissions against rich rubrics while explaining partial credit and surfacing actionable feedback for revision. We evaluate two core capabilities. First, on a large corpus of realistic SQL problems, our zero-shot, multi-step reference-answer generator, implemented with OpenAI’s o4-mini, substantially outperforms a single-prompt baseline while approaching the state-of-the-art pipelines trained with supervised learning. Second, in a classroom deployment, we compare LLM-assisted grading with human graders across four exam questions, encompassing 326 submissions evaluated by six graders. The results indicate that LLMs can provide grading signals competitive with those of human graders for many question types. Overall, the system is designed for responsible educational use through real-world problems, generated reference solutions, and grading assistance. Together, these features enable scalable practice generation and grading, which improves student learning while augmenting instructor capacity.
AB - We present a Large Language Model (LLM)-assisted SQL learning system that closes the loop from problem discovery to grading. Grounded in real-world data-wrangling scenarios, our agentic workflow (i) synthesizes industry-style practice problems with pedagogical metadata, (ii) produces executable reference SQL via a multi-step operator-planning pipeline, and (iii) grades student submissions against rich rubrics while explaining partial credit and surfacing actionable feedback for revision. We evaluate two core capabilities. First, on a large corpus of realistic SQL problems, our zero-shot, multi-step reference-answer generator, implemented with OpenAI’s o4-mini, substantially outperforms a single-prompt baseline while approaching the state-of-the-art pipelines trained with supervised learning. Second, in a classroom deployment, we compare LLM-assisted grading with human graders across four exam questions, encompassing 326 submissions evaluated by six graders. The results indicate that LLMs can provide grading signals competitive with those of human graders for many question types. Overall, the system is designed for responsible educational use through real-world problems, generated reference solutions, and grading assistance. Together, these features enable scalable practice generation and grading, which improves student learning while augmenting instructor capacity.
UR - https://www.scopus.com/pages/publications/105034024846
UR - https://www.scopus.com/pages/publications/105034024846#tab=citedBy
U2 - 10.1145/3770761.3777206
DO - 10.1145/3770761.3777206
M3 - Conference contribution
T3 - SIGCSE TS 2026 - Proceedings of the 57th ACM Technical Symposium on Computer Science Education V.2
SP - 1267
EP - 1268
BT - SIGCSE TS 2026 - Proceedings of the 57th ACM Technical Symposium on Computer Science Education V.2
PB - Association for Computing Machinery, Inc
T2 - 57th SIGCSE Technical Symposium on Computer Science Education, SIGCSE TS 2026
Y2 - 18 February 2026 through 21 February 2026
ER -