Let me not beat around the bush and tell you what I think. You might be tall and hansome and your dad taught you everything you know (business wise) but you don't have a "dammmm" clue about women. Women don't want to have dinner or lunch with you and and five minutes later you have five or six extra women (woman joining you every five minutes) at the table. That ain't "cool" dude !
Can you go out with just one person are you this little wimp that got his heart broken and can't stand to be by himself. GROW UP, if you as one woman out to dinner don't take your whole department. It really looks stupid and you look disparate. Or are you just so stuck on yourself that it make you feel better that you're the only male at a table with five or more women.
If you need that many women around........take them on a picnic !