Personally I find that the higher end you go for rentals the more trouble you will have, as these people are generally not in the life time renter class and have a much different attitude toward renting than someone more inclined to rent for a long period of time. So I would not look at a rental home the same as one you would want to live in, but whatever you are most comfortable with I guess.
As a side note most people get into being landlords by accident (many of these happing now) they are ready to move up and find a deal but at the same time don’t want to sell in today’s market. Not saying this is bad Idea but the same logic may not be the best one for rental property investment in general.
