A small speech about Mun's feelings of Odin below the read more due to spoliers for Thor 2
Odin in Thor took both his sons down to the vault and talked to them about history. Note that Odin was a King and I imagine a very busy one at that , he had matters to attend to but still made effort to be a father to both of them by taking time and actually teaching them history himself rather than having someone else do it like a teacher or a nanny.
As he said in Thor , Loki is taking words and twisting them , Odin could have easily had left the Jotun baby to die in the snow and nobody would have given a single fuck, he was the spawn of his sworn enemy .
Odin in my opinion wanted to raise Loki in Asgard's way so he would one day claim Jotunheims throne and rule it , Odin's two son's would rule side by side and the realms would know true peace. He was a believable father, one that I believe loved his sons in his own way and screwed up badly like fathers do, he was flawed and made mistakes.
Odin in my opinion will always be more a King that a father. If he had just forgiven Loki after he tried to enslave Midgard he would appear weak and too merciful, not the image he usually portrays of a firm leader that rules with an iron fist proven by what Thor said at the end of Thor 2 that he would rather be a good man that a great King. I think it's because a great King has no heart.
I agree that Odin is a massive douche, a dick to both Thor and Loki when they are older but I honestly believe that when they were still children he truly loved them as a father.