Group Abstract Group Abstract

Message Boards Message Boards

[WSS18] Generating Music with Expressive Timing and Dynamics

Posted 7 years ago
Attachments:
POSTED BY: Pavlo Apisov
9 Replies
Posted 1 year ago

Wow, Pavlo. I can't believe I didn't come across this post until now! This is great work, clearly presented. Despite its shortcomings, MIDI is a great tool for identifying useful insight into the structure and properties of music (certainly in the case of Western music).

POSTED BY: Updating Name
Posted 7 years ago

Audio representation is just another digital version of music but it's much more detailed and closer to reality than midi. With this kind of data, you can learn a timbre of an instrument and sound of it in special conditions (techniques of playing).

As could be listened from the tweet I've posted above - the piano generated their model sound pretty realistically. The quality of sound is poor for now though.

POSTED BY: Pavlo Apisov
Posted 7 years ago

MIDI representation loses an enormous part of musical information. This is the price you pay when you want to generalize a music notation. To be honest, I don't know much about a classic music notation or MIDI notation but as I understand MIDI tries to "digitize" a classic one. Correct me if I'm wrong but a classic music notation also lacks those things that you've mentioned.

If we want to learn specific techniques of playing an instrument we must learn it from raw music data(sound). Here is the latest research in this directions: https://twitter.com/deepmindai/status/1012290879120429056

POSTED BY: Pavlo Apisov

Nice project. You must realize that MIDI is absolutely awful at describing 'real' music. For a keyboard player, it might be sufficient to specify pitch and duration, using equal temperament, but for a wind player or especially a string player or singer, most of the stylistic information is missing. This is why a MIDI rendering of a solo violin piece (Bach's Chaconne, for example) or a flute piece is flat and mechanical.

I looked into inventing a replacement for MIDI, where you could specify the attack -- which is highly variable for most instruments -- and the way the sound evolves over time. However, it became apparent that even for 'simple' music, there were simply too many variables. It was easier to just learn the instrument. ;-). I am just an amateur flute player, but I can vary the note attack in 10 or 15 different ways, and change the way the sound developed, including adjusting the timbre during the note's elaboration is several more. A professional can do a lot more.

Professional musicians can play in strict time, of course. However, for many types of music, such as Chopin, the controlled deviation from strict time is an important performance criterion.

Posted 7 years ago

Thank you!

Yeah...jazz was a little part of the dataset but it gave a big influence :)

POSTED BY: Pavlo Apisov

Very nice. You generated jazzz :) The Only possible outcome.

POSTED BY: l van Veen

enter image description here - Congratulations! This post is now a Staff Pick as distinguished by a badge on your profile! Thank you, keep it coming!

POSTED BY: EDITORIAL BOARD
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard