Course curriculum

  • 1

    Session 1: An Introduction to AI Music

    • Main Topics: AI Music Case Studies, Course Roadmap

    • An Introduction to AI Music (50')

    • Session 1 PDF handout

    • Open Discussion
  • 2

    Session 2: Setting up your environment

    • Main Topics: Environment Setup

    • GitHub Repository

    • Setting up your environment - Cloning the class repository (10')

    • Hands On

    • Setting up your environment - Hands On 1.1: Loading, visualizing, playing audio (10')

    • Setting up your environment - Hands On 1.2: Extracting Audio Features, RMS and ZCR (13')

    • Setting up your environment - Hands On 1.2: Extracting Audio Features, Spectrograms (13')

    • Setting up your environment - Hands On 2: Manipulating MIDI Data (20')
  • 3

    Session 3: Core Machine Learning Concepts for Music and Audio

    • Main Topics: Audio vs Symbolic Music, Basics of Generative AI, Data Acquisition and Ethics

    • Hands On
  • 4

    Session 4: Representation Learning for Music

    • Deep Dive into MIDI & Spectrograms

    • Hands On
  • 5

    Session 5: Autoregressive Music Generation

    • Main Topics: Autoregressive modeling, the Transformer architecture, HuggingFace Hub

    • Hands On
  • 6

    Session 6: Real-Life Collaborations between Artists and Engineers with Guest Speaker Jordan Rudess

    • Main Topics: Formative Studies, Iterative Design, Continuous Deployment

    • Open Discussion with guest speaker
  • 7

    Session 7: Diffusion Models for Music Generation

    • Main Topics: Diffusion Models, Latent Diffusion Models

    • Hands On
  • 8

    Session 8: Running Deep Generative AI Models in Real-Time

    • Main Topics: Optimizing AI models, Basics of Real-Time Audio

    • Hands On
  • 9

    Session 9: Commercial Applications of Generative AI in Music with Guest Speaker

    • Main Topics: Landscape of companies in AI and Music, Available Commercial Products

    • Demo
  • 10

    Session 10: Final Project Planning

    • Main Topics: Setting up a project specification, timeline, and scope

    • Peer Review & Feedback
  • 11

    Session 11: Final Project Lab

    • Lab Session: Guided Coding & Troubleshooting

    • Milestone Check-Ins
  • 12

    Session 12: Project Showcase & Next Steps

    • Final Presentations

    • Next Steps