There are so many different places to begin.
First, remember this name, O'reilly. They are the book gods of everything *nix.
When learning Linux, just like winblows. The fastest and most sure fire way to learn is to install it (clean on a non-dual boot system), mess it up and learn from your mistakes.
Forget everything you knew about how an MS OS is made up when using linux. It will just confuse you.
But once you learn where everything is, it will become easy. For that, an excellent little site to learn that is: http://www.linuxnewbie.org/ &
http://www.linuxcommand.org/
The former will give you little tips and tricks. The latter, very helpful when learning commands.
Get yourself a copy of RedHat 8 or 9. I say RedHat rather then slackware or mandrake, because it is widely supported and the most common of the distro's. Instead of downloading the iso images, buy yourself a copy. It will be one of the few chances you get to actually monetarily support linux.Get yourself 2 books to start off with, both from o'reilly. Running Linux, and the Linux Administrators guide.
The RedHat bibles will also be helpful.
Other usefull links:
The LDP http://www.linuxdoc.org/
Trinity OS http://www.ecst.csuchico.edu/~dranch/LINUX/TrinityOS/cHTML/TrinityOS-c.html
RPM Finder
http://www.rpmfind.net/linux/RPM/
And most importantly for Kernel updates
http://www.kernel.org/
http://www.kernel.org/links.html for links to other linux sites
This should be enough to start you off. There are tons of sites out there and a million books.