Speaking for myself, it's not the fact that I don't like the idea of special creation, it's the fact that I believe the idea to be false and truthfulness matters to me.
I like the idea of Guinness falling as rain, but I'd still consider someone foolish if they were to stand outside holding a pint glass skyward waiting for it to happen. I try to base my opinions on my best estimate of whether they're factual, not on how much I'd like it if they were proven true or false.
BTW - even without special creation, you're still related to every other living human on the planet. You just have to go back a few more generations.