Don't smile and shake your head and say yes if you do not fully understand what is being asked of you.
Do say Please slow down I am having trouble understand you. Maybe in a day or two I will be better at it but right now, no.