sphinx-build has an htmlhelp builder. It would be nice to consolidate our documentation infrastructure, though we may end up checking in the generated sources in the tree so as to avoid requiring more dependencies for windows build.