Should I invite my father to his granddaughters graduation?

Regardless how much he's despised, he's still family and must be invited. Chances are pretty good he won't come, but the invitation needs to be made anyway. If he hasnt' responded to your communication before, I doubt he will now, but at least you won't be in the wrong and blamable.