Turns out, even better than my HTTP Server in 5 Lines With Webrick is this one-liner:
python -m SimpleHTTPServer
This will serve on port 8000 by default, but you can add the port number as the last argument to override. Nice! Credits go to this article.