He feels morally inferior and is awed by their size. He knows that they have the power to destroy if they wanted to but they do not. He feels powerless because here he is the smaller person. Still he considers the Lilliputians to be more vain and dangerous. The Brobdingagians were not despite their size.
