I am doing this from memory as I can't switch to XP for a while but I am pretty sure this is how to get rid of it.
Under Tools in Explorer (not Internet Explorer) You should find "folder options"
When you click on that under the General tab you can choose use Windows classic folders or something very similar, and then click apply.
This should resolve your problem.