All three are good answers.
Here's the explanations. First your cable company has to assign you an IP address. Either static [which costs more $$] or a dynamically assigned one [which costs less]. Based upon this, you configure your router [which is the physical link to your ISP and the internet at large]. So if your cable company has assigned you a static IP address they should have given you that # along with a submask # and DNS IP addresses. You MUST imput these values in your router's setup pages for you to have connectivity to your ISP. If you have a dynamically assigned IP address & DNS address from your ISP, then you MUST configure your router to obtain them automatically from your ISP.
Behind the router, you can basically configure IP addressing which ever way you want because the router is the link and acts as the gateway for any computer that is BEHIND it.
Next is to configure how computers behind the router will access the internet. You can do this in one of two ways. Enable the DHCP service on the router or use a static IP addressing scheme for each computer. If you use the DHCP service on the router, the router will assign computers and IP address to use. Your NIC card has to be configured to obtain an IP address automatically and this is done via the Windows [whatever flavor] control panel, network connection, Local Area Connection properties page. Browsers on the other hand typcially are configured with ziltch. You CLEAR all checkboxes [the documentation that came with your linksys router explains all this].
If you still are experiencing problems, As Chas says, contact Linksys. They have a pretty good tech support staff.
Your broadcom 440X 10/100 intergrated Controller I assume is the intergrated Ethernet controller on your mainboard.