Having a child can bring people together. After all, they have this tie that connects them together. I would ask him this question. You do not want him staying with you because he feels he should.
He's saying he's starting to get feelings for her. Do I fall back or leave? Or is he just in the process of figuring out his feelings for her as the mother of his child?