Why does it seem like many atheists don't care for Pascal's Wager?

Because Pascal's Wager is ridiculously illogical and would only work if a person believes in all gods "just in case". And even then it wouldn't work.