Solution #1 (Windows 95/98 only):
Include the command NUMLOCK = OFF or NUMLOCK = ON (depending on your preference) somewhere in your CONFIG.SYS file (on its own line).
Solution #2 (if you have Intellipoint installed):
Run the Registry Editor (REGEDIT.EXE).
Open HKEY_CURRENT_USER\ Control Panel\ Microsoft Input Devices\ Keyboard (If the Keyboard key isn't there, add it.)
Select New from the Edit menu, then String Value, and type NumLock for the name of the new value.
Double-click on this new value, and type either ON or OFF in the box that appears, depending on your preference.
Solution #3
Open your registry and find the key below.
Change the value 'InitialKeyboardIndicators' to either '0' for off, or '2' for on.
Restart Windows for the change to take effect.
Note: This change will affect all users but value can also be changed on a user-by-user basis by modifying [HKEY_CURRENT_USER\Control Panel\Keyboard] using the same values.
Also, you can download a software from http://www.rjlsoftware.com/software/utility/numlock/