wireless router

So I bought a wireless router thinking it would allow me to connect two home laptops to my DSL connection at the same time. However, although they both say they are connected wirelessly, in order to access the internet, they require “dialing” into my DSL through the wireless connection and only one can do this at a time. I have a feeling this has something to do with IP addresses maybe? Is this possible to fix or maybe it’s not possible to begin with? Thanks!