He's right in this instance, though Crowley may have a harder time with Jules given he doesn't fit into the "humanity" category. Jules is only half human, and was raised - if that word can even be used - primarily in the Andarion culture. There are far more differences between the species in terms of body language and behavior than there are physical ones.

"Consider it part of my irritating nature to not go where whatever being in charge wants me to go."

And he just really, really doesn't like people. Then there's the whole uncontrolled mind reading thing that makes being alone a much more pleasant experience than being so close to a large group of people he doesn't know.