He probably said that because most females are worried about their weight AND too you guys were ordering food, and he was probably thinking about all the calories you two would be eating. Unless he mentions weight again, or you guys were gonna workout together and watch your weight, I would leave him.