Forget Chatgpt - This Google AI can create music from a text prompt

Forget Chatgpt - This Google AI can create music from a text prompt

ChatGPT has been replaced by a new AI tool that can make music (almost) out of nothing. Following on from writing text and creating art, AI can now also create music with just a text prompt. This is due to Google's new AI system called MusicLM (open in new tab), which can create music of any genre.

Google describes MusicLM as "a model for generating high-fidelity music from textual descriptions"; at 24 kHz, it can generate complex songs that remain consistent over several minutes. The textual descriptions are extremely detailed and include style, genre, and even the mood and tempo of the song.

Remarkably, the AI also manages to capture nuances such as melody and mood. You can hear what AI-generated music looks like in Google's research paper (opens in new tab).

This is not the first time AI has been used to create music: there have been many attempts, including Riffusion, Dance Diffusion, and the Google-owned AudioML. AI. However, it has not been as successful as MusicLM in creating layered songs.

MusicLM was trained on 280,000 hours of music data sets to create songs of some complexity. The AI takes a description, creates a "hierarchical inter-sequence modeling task," and can create musical narratives of up to 5 minutes in length based on the length of the description.

There is one caveat, however. Google trained the AI with copyrighted music, which is why researchers found that 1% of the examples could be associated with existing songs. This could raise a number of ethical concerns, as the AI could easily pick up copyrighted material, which is why Google is not releasing this AI immediately. 11]

The co-authors of the research paper acknowledge this and "strongly emphasize the need for further research in addressing these risks associated with music generation."

The paper also states that "the study is a good example of the need for further research to address the risks associated with music generation.

Google has published 5,500 example music/text pairs for those who wish to listen to MusicLM's work.

ChatGPT is taking the world by storm. From passing complex legal and medical exams (opens in new tab) to writing CEO emails (opens in new tab) to real estate agents using AI to write property information, ChatGPT is taking over many highly skilled jobs. MusicLM is not actually launching not, so we may not see such unknown growth, but it is another major step in the advancement of AI.

Categories