A ghost? You know who to call...
But seriously my money's on the 4 window control unit in your driver door. Mine failed and did erratic things with the windows about 6 years back. I've read of a few people experiencing similar things. It can also make the other door's window switches do odd things when it fails. I couldn't open the passenger front window, but could close it. The passenger side switch could open the window but couldn't close it. Same with the back windows after a while. When the back windows went, it was time to sort it out. I took it in, explained the issue and they knew exactly what to do, straight away. I think it's something Honda mechanics are aware of and therefore must be fairly common.
See if you can pick one up from a breakers yard for a tenner. Swap them over. If it solves it, awesome, if not, then you're only ten pounds out of pocket.