The better the CIO is at the following items, the better he will do.
1. Understanding the technology of the industry (basics)
2. Well-rounding understanding of IT (fundamentals - not vendor or product-specific) and how it is used in the industry.
3. ability to read people - Figure out the knowledgeable from the BSers.
4. Ability to think strategically - He needs to be able to understand what the strategic thinkers of the organization recommend at a fundamental level.
5. Ecomonic sense & how businesses operate.
6. Leadership abilities particularly when introducing change.
7. The ability to put the company ahead of politics and recognize politics when he see its.
The larger the organization, the more he relies on underlings to get the work done and the more important for him to recognize those who know from those who BS.