Add more package index projects

[EpicWink]

Add many more package index projects to the "Project Summaries" page, add a table comparing these projects in the "Hosting your own simple repository" page, add another table comparing these projects in the "Package index mirrors and caches" page, and update the intro to "Package index mirrors and caches" to reflect the multitude of options

An alternative to #1202

Previews:

• https://python-packaging-user-guide--1366.org.readthedocs.build/en/1366/guides/index-mirrors-and-caches/
• https://python-packaging-user-guide--1366.org.readthedocs.build/en/1366/guides/hosting-your-own-index/

[sinoroc]

Previews:

• https://python-packaging-user-guide--1366.org.readthedocs.build/en/1366/guides/index-mirrors-and-caches/
• https://python-packaging-user-guide--1366.org.readthedocs.build/en/1366/guides/hosting-your-own-index/

[jeanas]

Let's merge this?

[webknjaz]

@EpicWink let's maybe mention dumb-pypi which is essentially a static site generator that makes a simple index for a bunch of pre-downloaded/created wheels.
As for the hosting, there's GitHub Pages that I use for having extra indexes with "nightly" bleeding-edge dists. So mentioning GitHub/GitLab Pages (or any static hosting for that matter) as possible solutions for limited use-cases would be useful too.
Here's an example: https://ansible.github.io/pylibssh/.

Finally, you mention Twisted, but omit the built-in web server that ships with Python — python -Im http.server. It's more of a local testing tool since it's not really designed to serve HTTP under the high load, but I believe does still deserve an honorary mention. After all, Twisted would be a production-side solution (although, this does omit all the other web servers capable of the same).

Could you bake these tools into the contributed documents, please?

[EpicWink]

let's maybe mention dumb-pypi which is essentially a static site generator that makes a simple index for a bunch of pre-downloaded/created wheels.

@webknjaz I've included dumb-pypi in the latest change-set.

---

As for the hosting, there's GitHub Pages

GitHub pages and GitLab pages aren't really "projects", but services. Per this comment, we don't want to list commercial services.

I guess there's an opportunity to explicitly say package indexes can be static file servers.

---

Finally, you mention Twisted, but omit the built-in web server that ships with Python — python -Im http.server

I have already included it: see source/guides/hosting-your-own-index.rst:113

[edgarrmondragon]

Would it be worth including https://github.com/gorilla-co/s3pypi?

[EpicWink]

Would it be worth including https://github.com/gorilla-co/s3pypi?

@edgarrmondragon I don't think so, as it relies on a commercial solution, and is not a self-contained project.

[webknjaz]

@EpicWink re:gitlab — it can be a self-hosted platform with a free version, since it's an Open Core project. But yeah, maybe a more generic "use any web server to serve static if you want your index accessible over web" would be better (mentioning that it's also possible to point installers to a simple index / wheelhouse on the local file system). I was also thinking that we could mention such examples, but not link them, maybe? Anyway, these two platforms already host the majority of open source and do so for free. So while they're commercial, they also do a lot for the sustainability of the open source. I think it might be fine to mention them in a restricted context with disclaimers — it wouldn't be an advertisement but an acknowledgement that these things exists.

[webknjaz]

Finally, you mention Twisted, but omit the built-in web server that ships with Python — python -Im http.server

I have already included it: see source/guides/hosting-your-own-index.rst:113

Ah, maybe I missed it because it doesn't have a dot in RST. Though, I was thinking more in the context of having it instead of twisted in the paragraph since it wouldn't be something dependent on the presence of an external project.

[EpicWink]

maybe a more generic "use any web server to serve static if you want your index accessible over web" would be better

@webknjaz re-reading the page, the current main version already discusses static file serving (with Twisted as an example), and this pull-request doesn't make changes to that discussion. I think making it more generic, and discussing other services, would better be served in another pull-request.

[webknjaz]

Okay, fair.

[webknjaz]

Per this comment, we don't want to list commercial services.

Looks like S3 is still linked?

[EpicWink]

Looks like S3 is still linked?

@webknjaz my understanding is that PyPA doesn't want to promote or recommend commercial services. I don't think listing a project which has optional functionality to utilise a commercial service (in this case S3) can be considered recommending.

A previous comment suggests s3pypi, which requires S3, which I think means that if s3pypi is listed, S3 is de-facto being recommended.

We could remove the explicit reference to S3, and just say "cloud object storage services", but honestly I left in S3 because I think it helps with Google (and other search engines!) searches, which helps novice package distributors who are familiar with cloud services.

[webknjaz]

Alright, that's fair. Just wanted to clarify.

[webknjaz]

@EpicWink thanks!