This new Nvidia technology is specially created to be used by producers of music, films, and even video games to make the whole experience more interesting.
Nvidia represents the biggest supplier globally of chips and software that are used to design and create various AI model systems. According to this tech giant, this new Nvidia generative AI technology has yet to be planned for an immediate release. The company calls this AI model Fugatto which is short for Foundational Generative Audio Transformer Opus 1.
Even more so, the Nvidia generative AI Fugatto is similar to other tech giants like Runway or Meta which can also generate audio and video from text queries.
Fugatto, the Nvidia generative AI model, can generate sound effects and music based on a detailed text description and also can generate novel sounds for example changing the trumpet sound with a dog barking.
However, this AI model successfully differentiates from other artificial intelligence technologies due to its ability to upload and change an already existing audio. For example, Fugatto will be able to take a line from a piano and change it into a sung by a human voice line.
"If we think about synthetic audio over the past 50 years, music sounds different now because of computers, because of synthesizers. I think that generative AI is going to bring new capabilities to music, to video games, and to ordinary folks that want to create things.", the vice president of applied deep learning research at Nvidia stated.
Also, it’s important to mention that the new generative AI Nvidia model, Fugatto, was trained on open-source data, and according to the company is still in debates about how to release it for public use.
“Any generative technology always carries some risks, because people might use that to generate things that we would prefer they don't. We need to be careful about that, which is why we don't have immediate plans to release this.", Bryan Catanzaro said.
It remains to be seen when this generative AI model will be released and if it will be so similar to the technologies from other tech giants that are also unreleased yet.
Stay tuned for more updates!