Google has created a brand new AI experiment, this time simulating 100 completely different musical devices such as you’d play a keyboard.
The brand new music instrument playground can simulate over 100 devices from around the globe, together with some unique devices. The Veena from India, the Dizi from China, and the Mbira from Zimbabwe are all represented. Even the resonator guitar, however you’ll must ask for it by brand-name (Dobro) somewhat than description.
Music LM can pair the instrument sound with adjectives like ‘melancholic’ or ‘dramatic’ to create a selected sound. For superior musicians, the device even contains a sequencer to make it doable to layer and loop as much as 4 completely different generated devices—every with their very own sound.
Google says the place to begin for this experiment was exploring an interface based mostly on Music LM that evokes creativity and the invention of devices around the globe. You’ll be able to experiment with a ‘festive crystal flute’ to think about Lizzo enjoying a jaunty vacation tune for the month of December by making an attempt out the playground your self.
The playground is an extension of its MusicLM mission, a generative AI mannequin that may create high-fidelity music from textual content prompts. Google launched MusicLM in February 2023, educated on a dataset of 280,000 hours of music to supply songs from textual content prompts. Researchers say the mannequin has been constructed with the flexibility to rework a set of sequentially written descriptions right into a musical story to construct on present melodies that may be whistled, hummed, sung, or performed on an instrument.
The power to play over 100 devices means Google has been onerous at work coaching MusicLM on a whole bunch of extra hours of every of those devices. Whether or not it’s a crystal flute, mandolin, or sitar—a whole bunch of hours of those devices being performed had been fed to the algorithm to ensure that it to precisely re-create the sounds. Do the musicians who performed these devices know their recordings had been used on this method? Google has not revealed its coaching mannequin for MusicLM, so we’re solely left to guess.