"Considering most Americans spend time in the military at some time or other...it easier to count those who DIDN'T serve as opposed to those that have."

Where did you get that notion?

ABC News said in 2011 there were under 23 million veterans, then roughly 7% of the population.

http://abcnews.go.com/Politics/us-veterans-numbers/story?id=14928136#1

The US Dept. of Veterans Affairs predicts by 2015 the number of living veterans will be less than 15 million, or less than 5% of the population.

https://www.va.gov/vetdata/Veteran_Population.asp

It's hardly worth adding in the 2.3 million currently on active or reserve status, less than 1% of the population.