It's honestly so sad that AI vocal/singing synthesis is given such a bad name due to AI art and AI covers floating around making people think AI vocal synth softwares like VOCALOID, SynthesizerV, ACE Studio, etc. are morally wrong.
AI art? Yeah, it's bad! It trains itself on artwork taken from other artists without their own permission. It also strives to make it so that people don't need to pay artists any money when they can just generate an image with their mind.
AI covers made with characters or celebrities, using software such as Diff-SVC, RVC, and DiffSinger? Yeah, it can be bad! It makes silly cover songs and such trained on audio by real people, usually without their consent. That could even be used to imitate/spread misinformation about someone.
But? AI vocal synthesizer software are made and used ethically.
Software such as VOCALOID6, CeVIO, SynthV, ACE Studio, Neutrino, etc. use voice and song samples given by people who are usually professional vocalists with express consent and permission, and they are properly compensated for their work.
AI vocal synth doesn't use anything without consent and, really, it's inherently just a tool that helps you make your own things, it can't make things for you.
Hell, if you look at vocal synthesis that /doesn't/ use AI, such as VOCALOID1-5, UTAU, and DeepVocal, from a users perspective, whether or not AI is involved, it's really the same, AI is only being used to make it more closely match human singing. It's not making anything for you. It's not sourced from non-consenting parties. It is a tool.