“My computer” is displayed many times on Taskbar

I am suffering from a problem that the programs in my computer are displaying more and more times if I access any one of a folder in my hard drive and eventually my Taskbar fills with many 'My computer' windows. Would you educate me what is the problem that I am facing and how can I get free from this problem?
