Cats are intensely sensitive and loving beings. They take their cues from you. So if you are holding anything in your energy field that lets them know you do not really want them around, they will not want to be around you.
Flu, I used to be allergic to cats, as did my husband. Then a cat showed up at our home in northern california and asked to live with us. We let her with the agreement that she would be an outside cat. That lasted about a week. I feel in love with her sweetness and our allergies disappeared. I once read that a cat allergy was manifestation of an inability to receive unconditional love.
We have 2 other cats now, our old girl died a couple of years ago. Every morning one of them jumps on the bed, lays on my chest, and licks my face to wake me up. The other one will wake up from her nap and then call to me or my husband to come over to her. She will then proceed to circle around us and smush her face into ours and purr up a storm.
Oxford, get down on all fours, on their level and let them come to you. Use a soft voice when you speak to them.
If you let them love you, you will come to understand that they can be great friends. That means, however, that you must be willing to be open to them. Right now they think you do not like them (which you don’t). Well, do you like to hang out with people who act like they do not like you?
The flower essence Rescue Remedy is also very useful for calming cats.