The missing ingredient is that if the common men--who you think have no better option than to depend blindly on someone they choose to believe--build a civilization based exclusively on the meditations of these holy men who they have accepted as the repositories of truth, they will find that their society will fall to those societies which have a, shall we say, more empirical basis for their view of the world.