[Sugar-devel] GSoC 2025: AI Code Generation for Lesson Plans

[Nideesh Bharath Kumar]

Hey Walter,

Thank you for looking over the proposal. So one of the goals is to convert
the Carnegie lessons into Music Blocks projects to enhance the lesson
generation, which doesn't seem that complicated, it's just adding the files
to the existing Chroma DB. The bigger goal is to add code generation (both
block-based and JavaScript) for the music blocks. So let's say I ask for a
lesson on slow bpm music. The lesson plan generator in MusicBlocks-AI would
generate a lesson plan, and code generation would generate example Music
Blocks code as examples in the lesson plan.

The way this works is by using an annotated music dataset (A-MAPS is a
better example than the Lahk), converting the MIDI files into Music Blocks
code using a script, and storing the annotations and code inside another
Chroma DB.

Now lets say the user wants a lesson on slow bpm music. The LangChain agent
in the FastAPI backend will determine if it needs context from the lesson
plan Chroma DB and the code sample Chroma DB, which is yes in this case.
The backend will query from the respective Chroma DBs reference material
using ANN, and supply this to the LLM. The LLM will generate a lesson plan
and code samples based on these references, and send it back to the user.
Now, the user has a generated lesson plan and example Music Blocks code,
which can be imported into Music Blocks.

Simply put, this is enhancing the capabilities of the current
MusicBlocks-AI repo by enhancing lesson plan generation and adding code
generation capabilities.

I can add further details about the process into the proposal.

Thanks,
Nideesh

On Fri, Mar 28, 2025 at 5:05 PM Walter Bender <walter.bender at gmail.com>
wrote:

> I think I largely understand all of the individual things you are
> mentioning in your proposal, but I am not sure I understand the end goal.
> Is your plan essentially to convert the Carnegie lessons into Music Blocks
> projects? What is the role of the Lahk dataset? What does the LLM do?
>
> -walter
>
> On Thu, Mar 27, 2025 at 8:59 PM Nideesh Bharath Kumar <bknideesh at gmail.com>
> wrote:
>
>> Hey Music Blocks Team,
>>
>> I would like to participate in the development of the AI Code Generation
>> for Lesson Plans and Model Abstraction Layer. I have attached my initial
>> proposal for review and any feedback would be greatly appreciated.
>>
>> Thanks,
>> Nideesh
>> _______________________________________________
>> Sugar-devel mailing list
>> Sugar-devel at lists.sugarlabs.org
>> http://lists.sugarlabs.org/listinfo/sugar-devel
>>
>
>
> --
> Walter Bender
> Sugar Labs
> https://www.sugarlabs.org
> <http://www.sugarlabs.org>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sugarlabs.org/archive/sugar-devel/attachments/20250328/f849b824/attachment.htm>