Terminal Services License

I am building a Windows Server 2003 Terminal Services system. I bought a 20-user Terminal Services license. I just installed the base OS using a Server 2003 CD from a different server. Now I am wondering if the base Server 2003 OS must also have 20-user license along with the Terminal Services CALs or will the Terminal Services CALs cover all requirements for this server?