fix: ignore the gitignored files in the scan to improve performance

[aminya]

Fixes #3047

This uses globify-gitignore to get the glob patterns of the gitignore file at the root and appends those to the ignore pattern of the glob package. This significantly improves the performance of cspell as those directories are excluded in the scan.

I see speeds up of 3x to 10x depending on the size of the project!

• (Edit: fixed in v1.0.3) Because cspell uses glob instead of fast-glob, I had to make some changes in the output of globify-gitignore. I will modify the API of globify-gitignore a bit so that we don't have to do these changes here:
  feat: return an object to indicate inclusion + use relative globs aminya/globify-gitignore#1

[Jason3S]

@aminya,

Thank you for the PR. I'll take a closer look in a few days.

[Jason3S]

@aminya,

Thank you for the PR. After reading through your suggestion, I realized that the GitIgnore code already had a list of globs, it just wasn't exposing them. I have added an interface in #4009. Please see if that works in your PR.

[Jason3S]

@aminya,

Thank you for trying this approach. I'm going to close this PR. A deeper dive is needed to make it work.

Kind regards,
Jason