Oh, I don't think he's keeping them; I can remember a book-canon instance where someone (Ace, I think) wanted to leave and he effectively forced her to stay. It's more like someone who is putting out food for stray cats and being friendly to them. They're not 'owned', they come and go as they please. Maybe pets is the wrong word.