Make Your Words Musical: Google’s AI Brings Text to Life with Music

A research team at Google has created an artificial intelligence that is capable of generating musical pieces from a written description. As if that were not enough, you can also transform a hum into melodies played by different instruments.

Google Chrome DOWNLOAD

This artificial intelligence follows a process very similar to that of other tools such as ChatGPT or Stable Diffusion, which use a description or “prompt” to be able to generate images or texts. The model that concerns us today is called MusicLM and although we still can’t prove it for ourselves, we can appreciate some of the results that Google itself has uploaded.

MusicLM, the ChatGPT of music

The examples we can hear are pretty impressive. The fragments have a short duration (30 seconds) and first of all, they can pass for real songs, even for the most expert ears. The melodies are recreated from specific descriptions, where we can choose from the genre to the instruments. To make matters worse, MusicLM can generate pieces with descriptions as brief as “melodic techno”.

Another of MusicLM’s features is that it can “Mix” between different descriptions, in order to create more complex songs. As an example, the AI was able to generate this audio based on this description: “electronic song in a video game (0:00-0:15), meditation song by a river (0:15-0:30), fire (0:30-0:45), fireworks (0:45- 0:60)”.

Additional details that indicate the time help MusicLM build a foundation for these “artificial songs”. As with other generative models, MusicLM benefits from a huge database of sounds and audios, which help it “train” itself to improve.

MusicLM is even capable of simulating human voices, although their quality is still questionable. And if you ask them to sing in any language, it gets even worse. The feeling when listening to these voices from the digital underworld is that they pretend to sound like English, but to no avail.

Despite Google’s advances in the field of AI, the truth is that the company is not doing very well in the public eye. Tech giants like Microsoft and now OpenAI are overtaking Google in artificial intelligence. In fact, Google recently issued a “code red” to its employees to get them to step up their game against the threat of tools such as ChatGPT. Will Google manage to recover its position in the AI race?