Connor was at his best as a character (not a person) in his first few episodes (teenaged not baby). How he is unfamiliar with the modern world. Saving Sunny, chocodiles, tools for eating. His unhinged grin when he tries to kill Cordelia, the confusion and pain on his face as her demony powers pass through him, ridding him of some of the stain that Quartoth left on him. How he breaks down and cries in her arms, just like a child. Because he is just a child and that is the first moment in his life that he gets to be one, to take comfort in a mother, to be vulnerable and feel safe.
I think one of the problems with how Connor was handled is that he very rarely got to be a character who's depths we explored, who's immense trauma was delved into. There could have been much more to him than the writers gave us.
I generally don't like Connor as a character. I don't enjoy him and he brings a lot of grief to the show, we all know the troubles of season 4. It's sad, because I think he had a lot of potential if his character and storyline hadn't been so fumbled.