Move to only using pyproject.toml

[silv-io]

Motivation

Using only pyproject.toml to define project metadata and dependencies is the new preferred way of doing things. Future distributions will only use pyproject.toml instead of a combination of pyproject.toml, setup.py and setup.cfg. Having all those things homogenized is helpful for introducing a multi-distribution project.

Changes

• Remove setup.cfg and setup.py (and all references thereof) in favor of storing all this information in pyproject.toml
• To define relationships between optional dependencies, we now don't use the %(extra)s syntax from the setup.cfg but recursively reference the package itself (so if extra test depends on extra runtime, extra test needs to contain "localstack-ext[runtime]"). This means that the package itself needs to be marked as unsafe for the pinning of dependencies.
• Upgrade all pinned dependencies, because the build package needs to be added, and the unsafe packages need to be adapted.
• Use the build package for building distributions instead of setup.py
• Use plux for creating the entrypoints instead of setup.py
• Update pre-commit hooks (adding support for pyproject.toml in pinned dependency checker and align black version with pinned version)
• Note: Beforehand the setup.cfg defined the minimum Python version. This got transferred to the pyproject.toml. black beforehand did not properly deduce from the setup.cfg that it should only produce 3.8 compatible code. With this information now being in the pyproject.toml it does. For this reason some of the existing code needs to be reformatted (every single generated AWS API)

Testing

The pipeline should be green and the produced artifacts should remain equivalent

TODO

What's left to do:

• Green pipeline

[github-actions]

S3 Image Test Results (AMD64 / ARM64)

  2 files  ±0    2 suites  ±0   3m 30s ⏱️ -5s
393 tests ±0  342 ✅ ±0   51 💤 ±0  0 ❌ ±0 
786 runs  ±0  684 ✅ ±0  102 💤 ±0  0 ❌ ±0 

Results for commit 68da688. ± Comparison against base commit 5d27f04.

♻️ This comment has been updated with latest results.

[github-actions]

LocalStack Community integration with Pro

    2 files  ±0      2 suites  ±0   1h 29m 8s ⏱️ -22s
2 705 tests ±0  2 449 ✅ ±0  256 💤 ±0  0 ❌ ±0 
2 707 runs  ±0  2 449 ✅ ±0  258 💤 ±0  0 ❌ ±0 

Results for commit 68da688. ± Comparison against base commit 5d27f04.

♻️ This comment has been updated with latest results.

[coveralls]

coverage: 85.69%. remained the same
when pulling 9ba53d5 on move-to-pyproject-toml-core
into 5d27f04 on master.

[alexrashed]

Awesome! This is quite a step forward towards up-to-date best-practices with python project config / packaging! 🚀
I only had a few questions (basically just for comments), afterwards we are good to go! 🚀 💯 🧹