I agree a lot with what you both say, Tinker & noddy. In terms of physical toughness, sure, those raised in the school of hard knocks have been more thoroughly conditioned for physical exertion.
In terms of mental toughness, after an extended period of prosperity, we all get used to stuffed bellies, and think it will never rain again. Human nature.
I recall my brother-in-law, 20 years ago, holding his 16 month old son in his arms and saying "I don't ever want my son to get his hands dirty earning a living." I recall thinking "That seems like a recipe for producing a maladjusted adult." Sure enough, he can drive a car, but can not plow snow. If someone plows the driveway for him, he is capbable of functioning in society, if not, he can't get to society. Sure given no other options, he will eventually learn to plow snow or shovel snow, but the adjustment period may be ugly. At age 30, he may be as capable as any others, but right now, by that one criteria, he is non-functional.
My point is when you are getting punched in the face, or doing a faceplant at 40 mph (I hope a motorcycle was involved), probably the last thought on your mind was that "Life is totally unfair!" because the iPod Daddy or Mommy or Uncle Sam bought for you, was not as nice as one of your peer's iPods.
Or, if you grew up eating meat less than three times a week, you may consider yourself a rich man today if you can afford to eat at McDonald's or Wendy's or another fast food joint whenever you want. Our current concept of "blessings" or "Life is good!"is largely determined by our past conditioning. Look at what is considered "offensive" today vs. the idea of free speech that prevailed in the past. Being "offended" was once considered a mark of emotional immaturity or an attempt at censorship.
We don't live in the jungle anymore, but for those who have been sheltered from life's challenges, it does not take much adversity for them to become mildly depressed.
The huge number of people living in environmentally controlled conditions, IMO, was a factor in producing the widespread belief in AGW. Most who bought into that idea were people who did not work outside and rarely experienced the "mood swings" of Mother Nature.
"A mere trifle consoles them, because a mere trifle upsets them!"
I guess another way to look at it is life is a period of continual adjustment. What we think are hard times, are always relative. What is considered tough times during one era may be looked back on as "the good ole days" if the intermediate period is even harsher.