Backstory: A co-worker asked me to lunch one day, and insisted it wasn't a date. I gave him the benefit of the doubt and went to lunch. Despite a few suggestive comments, things went ok, and he asked when I was free next. We ended up going to lunch again, but this time the comments were more abundant and I was getting uncomfortable. Yesterday he texted me asking if I am free any time soon. I don't want to go again, but I don't want to lie.