I ended up having another conversation with him today though in which he was able to accurately describe his thoughts on the matter, thankfully. He still isn't exactly a fan of the idea. He's concerned about two things:
1) Me coming across problems as a result of people not being cool with it (ironic, I know).
2) He's had the image of me and him hanging out and playing with my kids while my wife and mom talk about whatever it is they talk about, but that obviously isn't going to happen.
Sorry about your situation, though. My dad never tried to pester me about it to find out. I just kind of ended up expecting him to be cool with it because everyone I had told prior was.