I assume you're using skin placeholders, if you get a missing attachment error, simply delete said attachment inside that skin, which means inside the skin placeholder, with the current skin selected. When you change skin you'll see that it will disappear from the currently selected one, but it will still be present in the others!