How do I prioritize voice and video traffic?

We are using Tandberg video conferencing phones in our network. Call management is done by the SIP server. Can I assure priority to both voice and video by giving priority to RTP traffic between port nos range 16384 to 32767? Do I need to specify any other port nos as well?