In 2024, we have witnessed the impressive evolution of NVIDIA, a company once renowned for its formidable graphics cards, now leading the field of processors designed for artificial intelligence. NVIDIA has solidified its position at the forefront of this technology, becoming a key player in one of the most innovative and relevant industries today.
Last Monday, Nvidia unveiled a generative artificial intelligence model designed to revolutionize how audio is produced and edited.
This system, called the Foundational Generative Audio Transformer Opus 1, or simply Fugatto, enables users to generate and transform audio content through simple text commands.
In a statement published on its official blog, the company explained that Fugatto can perform various tasks, such as composing musical fragments, adjusting accents in voices, or modifying emotions in recordings—all through text-based commands.
While it shares similarities with text-to-music AI generators like Udio AI and Suno AI, Fugatto’s capabilities are more focused on creatively and flexibly manipulating sounds, voices, and music.
What Does Fugatto Offer?
Fugatto can alter existing audio files, allowing users to add or remove instruments from a track or change the emotional tone of a recorded voice, according to Nvidia.
The tool can also generate music or sound effects from written descriptions, swap instruments in a composition, or modify voices in real time.
In the fields of film and video games, the model can adjust voiceovers, modify accents or emotions, and facilitate the localization of content for different markets.
Developed by an international team of AI experts, Fugatto builds on Nvidia’s previous advancements in audio and voice modeling. It leverages a transformer-based architecture to achieve precise control over the generated sound.
Release Restrictions
Despite its impressive capabilities, Nvidia has chosen not to release Fugatto to the public due to concerns about potential misuse. This decision is not surprising, especially considering recent lawsuits against Udio and Suno for alleged copyright infringements filed by major record labels.
By: Nestor Castillo, ForAllTechNews DIrector
Image credit: Nvidea website / CC BY-NC-ND 4.0 / Attribution-NonCommercial-NoDerivatives 4.0 International