Leaf damage from wind.
I'm sorry to read that all your pods were thorn of in the wind. I have had the same problems here, but there is really nothing to do to prevent it :-(
Wind is also responsible for most (if not all) fungus attacks on our Yucca. While the leaves get damaged by the leaf spine and hard edges of the leaves. It's specially big a problem on Yucca recurvifolia, which have very flexible leaves with a very sharp spine. Also hail is can cause of damage which give fungus attacks an easy way into the leaf. Oh yes hail can also knock of the seed pods or introduce fungus, which kills the young seed pod. :-(
Good luck with your Yucca elata, you can "easily" pollinate it with it's own pollen, and get strong locate seeds.