Since users tab through forms when entering data, having a Close Form (or similarly redundant) button in the tab flow allows the user to stay "on the keyboard," instead of having to grab the mouse to click the window's upper right close button.

Workflow is important to the poor schlubs entering data (in my case, me, since I'm a hobbyist)!