Science fiction – A guilty secret?

What is it about science fiction that attracts some people and alienates others. Is it your guilty secret?