Windows won't let you delete, move, or rename a file if a program is using it. Frustratingly, it also won't tell you which program is using the file so that you can solve the problem.

When you delete that file, the disc doesn't actually "unwrite" it and get rid of it completely. Instead, the file is still there, but it won't be visible to you.