Preferably a ladies answer: Do women think this?

No, you don't have to ask her out right away. But, you should do it before the cl ends. Once you no longer have a reason to talk to her it will be harder to get her attention.