This passage refers to the Lehites, represented by the branches planted in the choice soil. Despite such choice circumstances and their early promise, the good branches have been destroyed by the wild.
The symbolism is perhaps stronger than the historical case, and it would be a mistake to read this allegory as a judgment that the Lamanites are evil. Rather, it means that the gospel did not continue among the Lehites.