Hi.
Yes, of course it seems to run faster. There is much less loaded, or in operation.
No, you can't simply remove drivers. They're all necessary. In special bsod cases, I direct people to uninstall certain drivers under certain circumstances. You have to be 110% sure you know what you're doing and why. You will certainly damage your computer with relation to it's installed software if you start uninstalling drivers. You'd need a new Windows install after that.
What you can do is type msconfig in the start menu then press enter. Go to the startup tab. Uncheck the boxes next to all unnecessary software so that they will not start with Windows. Save and reboot.