Task Bar not showing all open items

My task bar is not showing all my open items. For example I have mozilla, outlook, windows explorer and excel open. Currently I can not see the explorer unless I alt tab to the application. Is there some setting I need to change?

Thank you.