If all you have is shortcuts then it is quite small and not worth moving but many people use it like you would the documents or download folder. Put some excel spreadsheets, a few avi files and an mkv on your desktop (not just a pointer to them) and it will be quite large.
I suspect from the question that this poster may use their desktop this way, so I answered the question as best I could to handle this scenerio.
Some background on me:
I was searching for a method to change the start menu back to classic view and a replacement for explorer that functioned like the old explorer. The first forum I found in my search didn't seem to answer any questions, they just asked the poster why they would want to do that and said things like "this is the way it is now, get used to it". I found it to be a very unwelcoming place and so I ended up in here.
Here, the people actually try to answer questions and I thought, wow this is a much friendlier place. So if I answer a question it is because I think I can help and I will try not to judge why they asked, I assume they have a reason. I may also offer other recommendations or alternatives if I think it might help.
On occasion, it's possible I may misunderstand the question or give advice that is outdated for the Win 7 environment, heck, sometimes I may be flat out wrong (though not as often as my ex-GF said I was), so please correct me (politely) in the interest of helping the poster and improving my knowledge if this happens. I'm not perfect, just forgiven, but I will also try to keep my answers in the friendly tone I perceived when I arrived.