The problem with chasing minorities or being a fuckboy isn't the lack of true love. It's the lack of treating the individual as a person.
You don't have to love anyone. But you do have to treat everyone like they're more than just a fetish to you.
That can range from a deep and meaningful relationship, to simply not being a douchebag.
Romantic relationships can still be meaningless in this way, and people can have nonromantic sex with someone they're attracted to without it being morally wrong.
...Yes, this includes men sleeping with women. This includes thin individuals sleeping with fat individuals. This includes cis individuals sleeping with trans individuals.
Remember, aroallos are a minority, too. And they don't owe anyone love; they owe everyone respect, and you owe everyone that as well.