Static IP addresses

Is there a way to configure a linksys router on a network that uses static IP addresses? I am trying to use the router to hook up 3 computers from one port. The computers are using Windows Xp.