Ok so this is more an Au, but what if the evil hermits were more like Anti hermits who represent things said hermits hate or repress about themselves. So Helsknight is full of spite and hate and is violent because Wels is more pacifistic, Evil Xisuma is the represention of Xisumas derp moments, So on and ao forth.
See, that's basically what's going on. Quick tangent because this reminded me of something that I've been wanting to put out there for a while.
Some people are claiming that it's like underfell (a really popular undertale au) and let me tell you, as someone who was way too into ut, it really isn't.
Fell was meant to be the exact opposites of the characters. You can even see that with mr "kill or be killed" Flowey being on Frisk's side in most renditions.
That doesn't work with the hermits, whether you take into account the preexisting evil alters or not.
The hermits are way too morally complex for all of their opposites to be this pure evil version. You get characters like Doc or Cleo or even Grian who's opposites would be absolute goody two shoes types.
I don't really know where I'm going but you get the point.