Are the any downsides to using 'WITH' statements? Specifically in an interview setting?

Sometimes using them feels like cheating, because your solution is no longer a single querry.

Any experiences/input appreciated! Thanks!