What does it mean if you have a small brain?
Well, if somebody told you "you have got a small brain", he was trying to tell you that you are stupid. That isn't really polite.