Yep, if you've played it right you can do that.
If you don't think you've got them into your frame enough I'd go with something more akin to:
"What's that got to do with anything? We're talking about [Whatever]." and then continue.

Ultimately, playing hot girls off against each other is a good system, I'd have to say you want to get to the point where you can do that if you feel it appropriate.