Its mainly her Japanese voice, its too high pitched and annoying.

What's poor Kaori Horie ever done to deserve that, eh?

I've actually enjoyed her voice since the beginning. Reminds me of Nicole's voice from Guardian heroes, too (which is impossible, since Kaori does little else but KoF, and Nicole's voice ended up being Pikachu from Pokemon, lol), and I think they both very well fit that "cute Japanese girl" character type.
I really enjoyed the early days of being introduced to all the japanese talk in video games. Still do now, really. It's awkward at first, but it ends up having the same charm as listening to exaggerated move declarations and yells in martial arts movies. It adds something to fighting games, that localized VA actually detracts from.
I kinda think it's good for gamers to get used to another culture's vocal taste and ways. And KoF is as "Japanese" as they come. I think learning EXACTLY what it is, is one of the best parts of playing it, really. These voices ARE the characters. These actors have been doing skits at presentations, and vocal drama CDs and songs as these characters since the mid 90s! I've heard these guys so long, it's almost like I've had actual conversations with them, lol. I barely even think "I wish the person would stop shooting Psycho Balls!", it's more like "Man, Athena's being annoying! Time to shut her up!"

I guess it's partially different, because SF started off with very plain vocal synth voicework. So I have little problem hearing them as others (and it's cool hearing Ryu as Kyle Herbert, English Gohan!). But whenever I hear KoF characters dubbed in english, it's a constant "who'se that guy pretending to be Kyo?!?!" type deal, haha.
We'll always have the Maximum Impact series to satisfy our curiosity as to what English KoF would sound like, even if none of the 2D games ever get localized VA. I'd actually encourage people to help learn about the Japanese Seiyuus, look up translation FAQs by the late K Megura, and start recognizing a bit of japanese by ear! Unique "lost in translation" quirks, like how Yuri ends her sentences with "-chi!", Or Robert and Kensou's unique Kansai dialect use, are nice to appreciate, once you know what you're looking for.