Well he did say that. But there are several hints that he has a crush on that girl. It's just that he is more focused on improving his realm for now. Again only pursing dao and cultivating all day long feels boring. I am not telling him to have a huge harem. But having at least one partner would have been better. It's like what's the reason for having power if he doesn't even enjoy. And there's no need to deliberately avoid having a relationship cause it would not hamper his cultivation.