Will downloading files to Desktop slow Windows boot-up and overall speed

I’ve been creating Windows shortcuts on the desktop to folders I use often. That way I can open the folder and access files quickly.

I also created a folder on the desktop called ‘downloads’ where I download files until a time when I can move them to folders under ‘My Documents’. Does the number of files on the desktop affect Windows speed and bootup, and if so, does the shortcut to another folder which is placed on the desktop affect speed as well?

Am I better off dragging files to the shortcut to My Documents, or just to a folder created ON the desktop?