Christ spoke of his followers as a "little flock."  We should not let this discourage us.  God told Gideon and many others to "Fear not, it is your Father's good pleasure to give you this victory."  It is in God's pleasure, God's will, and God's power that we should trust.