Music Meets AI: AI-Powered Music Tool  ## Metadata - Author: [[Hard Fork AI]] - Full Title: Music Meets AI: AI-Powered Music Tool - Category: #podcasts - URL: https://share.snipd.com/episode/2a62145f-9818-45b1-859a-31c8d051a4c3 ## Document Notes ## Highlights - **Streamline AI Access with AIbox** - Try AIbox.ai to access top AI models across text, image, and audio in a single platform. - Paying one subscription offers convenience over multiple individual AI service accounts. Transcript: Jaeden Schafer It is officially launched. And our first product is the AIbox Playground. We have a beta out right now that essentially allows you to access the top 20 AI models all on one platform. You can chat with them all in the same chat. We have audio, image, and text all in the same chat for $20 a month. So you don't have to have subscriptions to 20 different platforms. You pay one time for that. ([Time 0:00:45](https://share.snipd.com/snip/daddafc6-70af-48b9-97e3-0e4325e525db)) - **Stability AI’s Unique Music Model** - Stability AI developed a small, lightweight music model optimized for phones that can generate short audio clips up to 11 seconds. - They trained only on royalty-free audio to avoid copyright issues, offering a unique approach compared to competitors like Suno or UDO. Transcript: Jaeden Schafer Beyond the fact that, you know, they came up with kind of like an audio model. And I should preface this by saying they have a big announcement about an audio model, but this isn't like a vocal model. This is a music model. So specifically, it does music. There's a bunch of different competitors. There's Suno and UDO that are doing this. But most of these ones that are kind of doing this generated music, people criticize them for the copyright. So they're like, look, these guys, they grabbed all of this data from the internet. They grabbed everyone's music. They trained a model and now it creates music. So people are upset about kind of the copyright in the data set for this. Stability tried to avoid this essentially. And they did a couple of cool things. Number one, it's a really lightweight, small model that actually can run on your phone. Meaning like Suno and UDO have apps that can run on your phone, but obviously that's going up to the server, to the cloud, and running off of, you know, their own websites and servers and Stuff. You have to have access to the internet. With this application, you technically could just do everything on your phone. Your phone is powerful enough to run this model, and it can generate you stuff. Now, I will put a caveat on this by saying this is not as good as Suno or UDO. It's just that's just the nature of the beast. So Stability trained this only on content that they had copyright for, which is fantastic, right? They don't want any sort of IP risk involved with this when they're releasing it. So they said that it's entirely made out of royalty-free audio libraries and the free music archive and free sounds. Those are kind of their sources and they're allowed to do this, which is technically great, except that it's not as good. So that's, I think, the big thing. It is really small. ([Time 0:01:18](https://share.snipd.com/snip/8363ee2b-47fb-4db5-aa29-c6d2f2f23932)) - **Model Strengths and Limitations** - Stability's model runs efficiently on ARM CPUs, suitable for smartphone usage without cloud dependency. - The model is limited to English prompts and primarily Western musical styles, producing lower-quality music without vocals. Transcript: Jaeden Schafer It's 341 million parameters in size. And it was specifically optimized to run on ARM CPUs. So ARM makes chips. These are built on, you know, this model was essentially built so that it's able to run on ARM CPU right on a phone. These ARM CPUs are often put into phones. So the thing that it's specifically made for doing though is for quick kind of shorter audio samples and sound effects. So you can do drums, you can do instruments, you can do riffs and it can make up to 11 seconds of audio you can do it on a smartphone and it takes about eight seconds to do this so this is you Know definitely faster than your average uh yudio or suno ai um piece but and i'm not saying it's bad i actually think it's fairly decent for what it can do but like it doesn't do vocals And so if you're trying to make a fully fledged song or honestly uh a really great song like suno and yudio are going to do a much better job in my opinion of making music i've tried both of The um i've extensively tried suno and uh it does incredible work makes amazing music people criticize that it was trained off of the copyrighted data i'm not too concerned about that That's not really my. You know, I'm sure people get mad at me or criticize me for that, but that's just my opinion is just like, that's, you know, their copyright issue to deal with the model so much better as A user and a consumer and someone that would like to create things, I'm going to use the best model. So that's kind of what I'm getting at sooner or UDO. All right, I wanted to give you a sample though, because I'm actually quite impressed by what they have been able to produce completely copyright free. There's no issues there. So they have a couple samples of what it's able to actually. So you can actually go online, check out SoundCloud. They got a bunch of different samples and all of their samples are like much shorter but they are you know showing you exactly what it's capable of doing they can do some drums some music They have a bunch of limitations in addition to the all ones i've mentioned already one it can only do english prompts written in english so if you speak another language you'd have to Translate your prompts into english and google translate or something like that um it can't generate realistic vocals or high quality songs. It's kind of low quality. And it doesn't do a lot of different musical styles. ([Time 0:02:58](https://share.snipd.com/snip/86c389ec-72ac-41da-a5c5-83292fb5deb1)) - **Choose Quality Over Copyright Concerns** - Users seeking high-quality or vocal music generation should consider models like Suno or UDO. - Despite copyright concerns in other models, prioritize quality if your focus is creative output. Transcript: Jaeden Schafer Not too concerned about that that's not really my. You know, I'm sure people get mad at me or criticize me for that, but that's just my opinion is just like, that's, you know, their copyright issue to deal with the model so much better as A user and a consumer and someone that would like to create things, I'm going to use the best model. So that's kind of what I'm getting at sooner or UDO. All right, I wanted to give you a sample though, because I'm actually quite impressed by what they have been able to produce completely copyright free. There's no issues there. So they have a couple samples of what it's able to actually. So you can actually go online, check out SoundCloud. They got a bunch of different samples and all of their samples are like much shorter but they are you know showing you exactly what it's capable of doing they can do some drums some music They have a bunch of limitations in addition to the all ones i've mentioned already one it can only do english prompts written in english so if you speak another language you'd have to Translate your prompts into english and google translate or something like that um it can't generate realistic vocals or high quality songs. ([Time 0:04:01](https://share.snipd.com/snip/78ae9c58-5abc-4cc4-bcde-b552401ace31)) - **Stability AI’s Strategic Pivot** - Stability AI, once financially troubled, is pivoting toward video and multimedia with new leadership and board additions, including James Cameron. - Integrating AI-generated music with video content could be a strategic focus moving forward. Transcript: Jaeden Schafer Tons of staff resigned. There was a partnership they had with Canva that fell through. Investors were super concerned about this. So in the last few months, they actually got a new CEO and they appointed James Cameron to their board of directors, which is interesting because typically this has kind of been famous As a image company. And with James Cameron, you can kind of imagine where they're going with this is going to become a video company. All these AI generated images are perfectly poised to create AI generated videos. And they've also released a bunch of new image generation models. So it seems like stability is on track to do some cool things. I think specifically, if we're looking at video, doing these sound effects and kind of these like smaller music bits makes a lot of sense. They want this in the background of if you know, they're making music tracks to be able to or sorry, videos, it'd be really cool to have also AI generated music in the background. So this makes a lot of sense with kind of their strategic direction. I'll be super curious to see where they go. ([Time 0:06:23](https://share.snipd.com/snip/05d68698-149d-4329-9685-a1c3769a4d92))