GSoC 2024 students’ weekly reports #4 and #5
A few weeks ago, we shared the second and third week reports from our Google Summer of Code (GSoC) and Code4GovTech’s DMP program students. In this report, we are sharing their updates on progress made over the past two weeks.
We’ve received the following reports, which are divided into the following sections: Music Blocks, Sugarizer, Pippy, Chat, Math, Flatpack, and Raspberry Pi.
Music Blocks project reports
Make your own lesson plans
Khadar shared his latest work on Make Your Own Lesson Plans, a project to use generative AI to create lesson plans for Music Blocks. The past few weeks, he has been working on various improvements such as song suggestion and providing a link to a MIDI file (which can then be imported into Music Blocks thanks to work being done by GSoC contributor Mubashir). These improvements have been made based on testing done the past few weeks by teachers who were creating lesson plans for Music Blocks, both with the tool and without.
Khadar’s code can be found here: https://github.com/khadar1020/Musicblocks-AI
You can read his full posts here, which include some examples of the output:
Musical ideation through LLMs
The goal of this project is to assist people in creating original music within Music Blocks, which they can then manipulate and use in other ways. Because LLMs are good at processing text and text is a good way to express code, even musical code such as text-based Lilypond and ABC notation, we are approaching the problem by first creating a tool that generates text-based code from an LLM which will next be translated into Music Blocks visual code. Abhijeet Singh is one of our contributors for the summer who is working on this problem.
Abhijeet Singh has continued to make progress with his work to import ABC notation into Music Blocks, generating Music Blocks code. And now he has started working on tooling to help a user generate ABC notation via a large language model (LLM).
You can read his full reports here:
- https://medium.com/@vayuabhijeet/optimizing-clean-test-code-gsoc-coding-period-v-9aae93ece229
- https://medium.com/@vayuabhijeet/llm-for-music-generation-coding-period-vi-8507676b52cc
Musical creation and transcription assistance via generative AI
Mubashir Shariq has been making progress on MIDI import into Music Blocks, solving issues like making the generated code more structured by splitting tracks into separate Start blocks, breaking up long strings of notes into Action blocks, and by specifying tempo by parsing tempo data. This is work that will used to help a user transcribe music that they would like to have in Music Blocks.
You can read his full progress reports here:
- https://medium.com/@mubashirsharik01/google-summer-of-code-with-sugar-labs-week-4-c660927da674
- https://medium.com/@mubashirsharik01/google-summer-of-code-with-sugar-labs-week-5-d3446d88e268
- https://medium.com/@mubashirsharik01/google-summer-of-code-with-sugar-labs-week-6-13a68ccc5ae6
Mubashir’s code can be found here: https://github.com/Mubashirshariq/music_transcription
Masonry for Music Blocks v4
Since our previous post, Karan Palan shared his week 3 & 4 and week 5 & 6 progress on the following blog posts:
- https://musicblocks.net/2024/06/27/gsoc-2024-with-sugar-labs-week-3-4-music-blocks-v4-project-updates/
- https://musicblocks.net/2024/07/11/gsoc-2024-with-sugar-labs-week-5-6-music-blocks-v4-project-updates/
In particular, you can see the progress made toward snapping blocks together in working prototype mockups, which will be implemented into Music Blocks v4 in the coming weeks. Since we are working with bricks, we are calling the poject “Masonry”.
Add real-time collaboration in Music Blocks
Ajeet is working on real-time collaboration of Music Blocks projects. You can read about his work on the following posts:
- https://github.com/apsinghdev/DMP/blob/main/week-2.md
- https://medium.com/@apsinghdev/week-3-installing-and-configuring-libraries-b90524842ed4
- https://medium.com/@apsinghdev/week-4-5-setting-up-socket-connection-and-sending-changes-aa094a85d0f2
In particular, you can read about the challenges of sending data from different sessions of Music Blocks and how we are approaching the problem.
Get Sugar Labs’s stories in your inbox
Join Medium for free to get updates from this writer.
Interested in following Music Blocks development more closely? Many of the day-to-day discussions happen in our Matrix channel, which you can find here: https://matrix.to/#/#musicblocksdev:matrix.org
Sugarizer GSoC Projects
3D Volume Activity
The following is the latest report from Samarth Bagga, which is typically sent to the Sugar Labs GSoC mailing list:
Migration to i18next-vue
The following is the latest report from Utkarsh Siddhpura, which is typically sent to the Sugar Labs GSoC mailing list:
I had a meeting on July 14, 2024 with my mentor about my GSOC project -
Sugarizer 3D Volume Activity. We discussed various bugs in the activity and
how to fix them. We also discussed a new Human Body 3D Activity.
Details can be found on the Discord Channel (https://discord.com/channels/1078051575580336249/1200910015532372029>) You
can follow my progress here: https://volume-activity-gsoc.vercel.app/ (select the 3D volume activity from the list).
Interested in following Sugarizer development more closely? Most of the discussions for Sugarizer happen on the Sugarizer Discord channel, which you can join via the following invite: https://discord.gg/tZfQMRMc
Video presentation by Music Blocks and Sugarizer contributors
These blog posts are nice overviews of weekly process, including both the successes and the challenges. For those reading this who would also like to see the contributors demo their work in video format, you can watch our recent video of these contributors share their work. You can find the video of the mid-term presentation here:
Pippy, Chat, Math, Flatpack, and Raspberry Pi
And lastly, here are some bullets of the work done over the past couple weeks for the other projects this summer:
- Qixang Wang shares his work on AI-integration for our Chat activity, including some of the decisions made to help keep the design simple: https://medium.com/@qxwang27/gsoc-weekly-update-refining-the-model-pipeline-and-designing-the-first-version-of-chat-activity-56aa4af59571 and https://medium.com/@qxwang27/gsoc-weekly-update-an-attempt-with-gemma-2-ui-ux-design-update-021ca5b59821
- Kshitij Shah shares his work on an LLM-enabled Python assist here, including working with RAG models, LLAMA, and designing the chatbot for use by children: https://github.com/kshitijdshah99/Pippy_Activity/blob/main/Weekly%20Blogs/Week%203.md; https://github.com/kshitijdshah99/Pippy_Activity/blob/main/Weekly%20Blogs/Week%204.md; https://github.com/kshitijdshah99/Pippy_Activity/blob/main/Weekly%20Blogs/Week%205.md; and https://github.com/kshitijdshah99/Pippy_Activity/blob/main/Weekly%20Blogs/Week%206.md
- Vaibhav Sangwan is working on a Tower of Hanoi game as part of the “math games” project. His blogposts for weeks three through six are here: https://github.com/vaibhav-sangwan/DMP/blob/main/week-3-4.md and https://github.com/vaibhav-sangwan/DMP/blob/main/week-5-6.md
- Spandan Barve is working on a NIM game. His blog for this week blog is here: (Pending)
- Anurag Singh is working on Raspberry Pi projects. His blogposts for weeks three and four are here: https://medium.com/@principalquantum30/gsoc-with-sugarlabs-coding-phase-ii-week-3-4-1db73480b68d
- Aayush Raj is also working on Raspberry Pi projects. His blog is here: (Pending)
- Shubham Tiwari is working on Flatpack. His blog for this week is here: (Pending)
Interested in following Sugar Activitiy and Flatpack development more closely? We encourage you to join these two chats: https://matrix.to/#/#sugar:matrix.org and https://matrix.to/#/#sugar-flatpak:matrix.org
Upcoming live progress reports and demonstrations on YouTube
This Friday, July 19, we are hosting another round of our GSoC students to show us what they have accomplished this summer. The link is here:
- https://www.youtube.com/watch?v=TARoJDitQVg (Pippy, Chat, Math, and Raspberry Pi)
More to come
As mentioned last week, we’re asking GSoC contributors to write regular blogs, send in reports, attend meetings, and even present for our ongoing series of online events on YouTube.
We’re doing this so that the students can document their process and learn more about their own learning. We also expect that it will help others get involved in Sugar Labs, as well as to help future contributors, who may be building upon the work of this year’s students. Please join us in giving the students a big round of applause (i.e. smash that clap button).
