The withdrawal of the prophets is symbolic of the withdrawal of the Spirit of the Lord from the people. Moroni is telling us that they are sealing their fate, and that the prophesied destruction will surely come.