Have you thought about buying an old system?
With a Linux distro, you could slap together a tolerable server for under 60 bucks (if you watch eBay really closely, and never go above a set mark no matter how bad you want the machine). That includes shipping (IMHO).
I even got a machine once that had 128 Mb RAM for $50. 6.4 Gb HD and a CD-ROM -- everything you will ever need for a small website. Plus, they all have network cards (nobody wastes the effort to remove them).
Slap a junky old monitor on it (usually won't run above 640x480), and you have all the machine you need. May or may not need a mouse, keyboard, etc.
Do all your pages on your main Windows machine, then burn them to disc and move them your server.
May have to do some CGI on the Linux machine, but that's all. Really, Perl would be better, since you could run it on Windows as a test server, and the reasonably expect to move it to Linux.
We can't stop here! This is bat country!