Implement directory-based plugin system

[erik-megarad]

Background

When developing and using plugins it is onerous to download a zip file manually and to download a new zip file each time the source changes. It also makes it difficult to inspect and make changes to plugins if they're not working right (e.g. the recent change to AutoGPTPluginTemplate which broke all plugins).

A solution which seems straightforward is to allow directories in the plugins directory. Each directory can be either a normal directory or, importantly, a cloned github repo. This makes it easier for 3rd party plugins to be used without being part of the official plugin repository.

It also includes changes to plugin dependencies in that now each plugin has the ability to have its own requirements.txt file. Now, all plugins don't need to share the same dependency list, and you only install dependencies of plugins you actually will use. This was necessary to support directory plugins as their requirements couldn't be installed otherwise.

Changes

• Add directory-based plugin support when loading plugins
• Add directory-based plugin support when installing plugin dependencies
• Necessary test changes to accommodate

Documentation

• A little bit of inline comments, but significant documentation changes would need to be made to the plugins repo documentation if/when this is merged. I can take care of that.

Test Plan

• Created my own plugin and tested it in a directory
• Split out plugins that I want from the main plugins repo and using them as directories
• Adding a directory-based plugin into the unit tests

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes.
• I have run the following commands against my code to ensure it passes our linters:

  black .
  isort .
  mypy
  autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports autogpt tests --in-place

[vercel]

Deployment failed with the following error:

Resource is limited - try again in 5 minutes (more than 100, code: "api-deployments-free-per-day").

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[codecov]

Codecov Report

Patch coverage: 84.61% and project coverage change: +0.05 🎉

Comparison is base (6ff8478) 68.81% compared to head (d8bdf17) 68.87%.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #4548      +/-   ##
==========================================
+ Coverage   68.81%   68.87%   +0.05%     
==========================================
  Files          72       72              
  Lines        3585     3598      +13     
  Branches      574      578       +4     
==========================================
+ Hits         2467     2478      +11     
- Misses        927      928       +1     
- Partials      191      192       +1     

Impacted Files	Coverage Δ
autogpt/plugins.py	76.15% <84.61%> (+0.79%)	⬆️

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[vercel]

Deployment failed with the following error:

Resource is limited - try again in 4 minutes (more than 100, code: "api-deployments-free-per-day").

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[reconsumeralization]

Check it on another cloned repo first?

[erik-megarad]

Check it on another cloned repo first?

Yep it works

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
docs	⬜️ Ignored (Inspect)	Visit Preview		Jun 10, 2023 7:54pm

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[github-actions]

This PR exceeds the recommended size of 200 lines. Please make sure you are NOT addressing multiple issues with one PR. Note this PR might be rejected due to its size

[Anhmarukita123]

I have successfully installed auto GPT and shutdown, now I want to use Auto GPT, what should I do? Please show me how to use Auto GPT

[lc0rp]

I have successfully installed auto GPT and shutdown, now I want to use Auto GPT, what should I do? Please show me how to use Auto GPT

Wrong place to post this. Please refer to https://github.com/Significant-Gravitas/Auto-GPT/tree/release-v0.4.5#quickstart