As I see it, the beauty of youth does indeed end. But so, too, flowers wither, sunsets fade, and so forth. I think it is the insensitive fool who discounts the physical beauty of the earth because it is impermanent. Seems to be a cultural thing to do so. The Japanese, for instance, do not typically indulge in such folly, but rather embrace the beauty of nature, which is transitory.
Maybe people who refuse to value transitory beauty are just spiritually too weak to endure something so poignant as the passing of physical beauty.
Inward beauty has its own value too. It is valuable ever as much as outward beauty. But outward beauty is not lessened in value by the fact it fades. To deny physical beauty is to deny life. He or she who denies life is a spiritual fool. At least, that's how I see it. I could, of course, be wrong.