OK, basics first
1. You definitely want to go 64-bit. Just about every smart trick in the book relies on some type of caching (cursors, data blocks, parsed code etc), so going with a 64-bit server simply gives You more breathing space.
2. In the x86-64 space, Oracle 10g runs beautifully on both Windows Server 2003 (64 bit) and on the newer 64 bit Enterprise Linux offerings. Choosing one or the other should be based on Your existing skill set and application needs.
3. Raw physical random i/o capacity is Your last line of defense against performance problems. Make sure that You have a sufficient number of disk drives or independent lun's and multipath i/o.
Feel free to elaborate a little bit with regards to the type of load You envision, number of users, number of executions etc.
Regards
Bjornar Nying