feat(rule-finder): Omit deprecated rules #270

randycoulman · 2017-05-19T18:28:09Z

Filter out deprecated rules in _getAllAvailableRules() and _getPluginRules(). With this change, the lists of rules displayed with the -a and -u flags will not include deprecated rules.

Breaking: The output is now different from what it was, as deprecated rules are now omitted by default.

Breaking: The getRuleFinder() API has changed. Previously, it took an optional filename and an optional boolean, noCore. Now, it takes the optional filename and an options object:

omitCore: Exclude core rules from the output
includeDeprecated: Include deprecated rules in the output

Both options default to false if they are not provided.

Per a review request, I've added a flag to allow deprecated rules to be included. Adding --include deprecated or -i deprecated will include deprecated rules in the output; they're not included by default.

To make the implementation of this flag cleaner, I refactored getRuleFinder() to take an options object instead of a boolean as the second argument. Adding a second boolean (includeDeprecated) made it a difficult interface to use.

Note that eslint.linter.getRules() returns an ES6 Map, which cannot be directly filtered. Also, its keys() function returns an iterable, so we have to spread that into an array before we can filter it. That's why the code is written the way it is.

To make this feature have a cleaner implementation, I also performed the following refactorings:

Don't pass plugin rules to _getAllAvailableRules. Plugin rules are now merged with core rules directly in RuleFinder instead.
Rename _getAllAvailableRules -> _getCoreRules to better reflect its purpose.

I also:

Removed the nc option; it isn't documented and isn't being used.
Split some of the find tests into two it blocks. I found that calling proxyquire twice in the same test wasn't doing anything, so was potentially hiding failures.
Renamed some rule-finder tests to result in more consistent output.

Fixes #172

ljharb

I'm hesitant to make this breaking change; I think an option might be better.

ljharb · 2017-05-19T18:29:38Z

src/lib/rule-finder.js

-          return normalized.prefix + '/' + rule;
-        })
+        Object.keys(rules)
+        .filter(rule => !_isDeprecated(rules[rule]))


I would expect this line to be indented one level farther

Yes, good catch. I think I was following the pattern of something else in the file. I'll fix that up.

ljharb · 2017-05-19T18:30:52Z

src/lib/rule-finder.js

-        })
+        Object.keys(rules)
+        .filter(rule => !_isDeprecated(rules[rule]))
+        .map(rule => normalized.prefix + '/' + rule)


This should use a template literal

Agreed; I just moved the existing code around a bit. I'll take care of it.

ljharb · 2017-05-19T18:32:16Z

src/lib/rule-finder.js

-  ];
+function _getCoreRules() {
+  const rules = eslint.linter.getRules()
+  return [...rules.keys()]


Nbd but this would be slightly more efficient as Array.from(rules.keys(), rule => !_isDeprecated(rules.get(rule))).filter(Boolean)

Ah, cool! That's way better. I didn't know about Array.from. I tend to use Ramda for stuff like this. I'll fix that up.

Wait, no, that doesn't work. We need the actual keys out, and this is mapping them to Booleans, returning a list of true values.

Ah, good point. Yours is fine then :-)

I switched it to Array.from instead - seems a bit clearer.

randycoulman · 2017-05-19T18:51:01Z

Regarding the "breaking-ness" of the change: IMO, this is more like the expected behavior and so should be the default. Also, we're already in breaking-change land due to #237, which this PR depends on. But if you really want this to be behind an option, I can do that.

ljharb · 2017-05-19T19:00:24Z

Regardless of which is the default, we'd need an option for it - I'd want to be able to include deprecated rules.

codecov-io · 2017-05-19T19:02:53Z

Codecov Report

Merging #270 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff          @@
##           master   #270   +/-   ##
=====================================
  Coverage     100%   100%           
=====================================
  Files           9      9           
  Lines         179    186    +7     
=====================================
+ Hits          179    186    +7

Impacted Files	Coverage Δ
src/lib/rule-finder.js	`100% <100%> (ø)`	⬆️
src/bin/find.js	`100% <100%> (ø)`	⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0cd85c8...0931677. Read the comment docs.

randycoulman · 2017-05-19T19:04:18Z

Code comments addressed; I'll take a look at adding the option later today (hopefully).

ljharb

LGTM, pending the option.

To restate: I'm content with the default being "filter out the deprecated rules", making this PR semver-major, as long as there's an option to explicitly restore the behavior where deprecated rules are included.

randycoulman · 2017-05-19T20:04:30Z

@ljharb I could use some input on the flag to use for including/excluding deprecated rules; I'm trying to keep #188 in mind as well.

It feels like #188 should be another "option" (similar to -c, -a, etc), and I was thinking of naming it -d/--deprecated.

If that's what we do there, then I'm not sure what to use for the flag for this rule. Maybe --include-deprecated? Would that be too confusing? And what should the short version of the option be? -id?

ljharb · 2017-05-19T20:08:08Z

I think --include=deprecated would be good, and then the short one could be -i deprecated?

randycoulman · 2017-05-21T00:14:01Z

I've added the --include deprecated/-i deprecated flag now. I did some additional refactoring as part of that; see the commit comments for details. I also updated the main PR description.

Let me know if you want me to remove the backwards-compatibility handling for the getRuleFinder() interface.

I see that the tests are failing on Travis; I'm not sure what's happening there. They're all passing locally.

ljharb · 2017-05-21T05:59:49Z

README.md

@@ -42,15 +42,21 @@ The intended usage is as an npm script:
 }
 ```

+Then run it with: `$ npm run -s eslint-find-option-rules` (the `-s` is to silence npm output).


probably best to use --silent, rather than abbreviations - it's also more googleable.

ljharb · 2017-05-21T06:00:17Z

README.md

+
+By default, core rules will be included in the output of `-c|--current`, `-a|--all-available`, and `-u|--unused`.  If you want to report on plugin rules only, use the `--no-core` flag.
+
+By default, deprecated rules will be omitted from the output of `-a|--all-available`, `-p|--plugin` and `-u|--unused`.  If you want to report on deprecated rules as well, use the `--include deprecated` or `-i deprecated` flag.


not --include=deprecated?

yargs works both ways. I updated the test and the doc to use the =, if only to have Travis try again and hopefully pass this time.

ta2edchimp · 2017-05-21T06:19:13Z

Thanks so much for the work on this! Looks great and I'm looking forward to us finally supporting this long awaited and discussed feature.

Re: Failing tests on Travis
@randycoulman On what version of node did the tests pass for you locally? Travis runs against 6.10.3 and 7.10 ...

Re: Versioning and breaking changes
@ljharb So you would propose, we go "full semver", making the release including the PR this one depends on, as well as this one a major each?

ljharb · 2017-05-21T06:36:57Z

@ta2edchimp we should always go full semver :-) that doesn't, however, mean that we need two majors - they can be bunched up as one.

ta2edchimp · 2017-05-21T07:17:02Z

"full semver"... didn't know how to put it otherwise 😜
Of course, I'm with you to fully comply to semver. So, in the end, we get a new version with this cool feature! And it should then be a new major ...
I'm still puzzled as to why the Travis builds may fail and cannot look deeper into it until tomorrow, but I will try to then, and also try to get the time to release the previous one ( @ljharb I think you also have publish rights? So if you should have the time, feel free to npm publish it ).

randycoulman · 2017-05-21T13:48:13Z

@ta2edchimp I'm running 6.10.3 locally and having no problems with the tests. I just pushed up a new commit, so I'll see what happens.

randycoulman · 2017-05-21T13:57:52Z

The builds are still failing on Travis. From the failures, it looks like it's not picking up the changes I made to the RuleFinder constructor. It's acting as though it's treating the options object as a simple Boolean instead of as an object.

Perhaps I should try taking out the backwards-compatibility code to see what happens? Any other ideas?

ta2edchimp · 2017-05-21T15:59:26Z

Perhaps I should try taking out the backwards-compatibility code to see what happens?

If you don't mind, please give that a try.
We have a breaking change anyways, so I see no problem in changing the argument to be required to be an object.

Nevertheless, I'm curious to find out what happens there.

randycoulman · 2017-05-21T19:26:32Z

OK, backwards-compatibility code removed. I also realized that I forgot to update the signature of the exported rule finder function; I was changing the constructor, but not the exported function. Maybe that will help on Travis?

randycoulman · 2017-05-21T19:39:14Z

I'm not sure what was going on, but I reversed the sense of the includeCore flag and renamed it to omitCore. That makes both flags consistently default to false, and also lets the build pass.

I think this is finally ready to merge. If you want me to squash commits and rebase on master, I'm happy to do that. Or, you can just squash when you merge.

randycoulman · 2017-05-21T19:42:12Z

PR description updated to make clear what the breaking changes are.

ta2edchimp · 2017-05-21T20:01:30Z

Yes, please rebase on master. We can squash on merge.

randycoulman · 2017-05-21T20:30:43Z

I just squashed and rebased both. Should be ready to go now.

randycoulman · 2017-05-26T16:12:03Z

Is there anything else I need to do with this before it can be merged? I'd like to start working on #188 soon, and I'll need this merged in order to do that. Thanks!

ljharb

Seems legit. Thanks!

ta2edchimp · 2017-05-27T07:41:08Z

Sorry, I found a few issues with the automatism for releasing and "lost my time". I will get back to this tomorrow at the earliest (releasing the previous, merging and releasing this).

ta2edchimp · 2017-06-13T09:17:49Z

Hey @randycoulman, sorry for the long break.
Could you please, for one last time, rebase your working branch on master and push your changes? When all tests still pass, we could then immediately merge and cut a release (v3.0.0).

Filter out deprecated rules in `_getAllAvailableRules()` and `_getPluginRules()`. With this change, the lists of rules displayed with the `-a` and `-u` flags will not include deprecated rules. Breaking: The output is now different from what it was, as deprecated rules are now omitted by default. Breaking: The `getRuleFinder()` API has changed. Previously, it took an optional filename and an optional boolean, `noCore`. Now, it takes the optional filename and an options object: * `omitCore`: Exclude core rules from the output * `includeDeprecated`: Include deprecated rules in the output Both options default to `false` if they are not provided. Per a review request, I've added a flag to allow deprecated rules to be included. Adding `--include deprecated` or `-i deprecated` will include deprecated rules in the output; they're not included by default. To make the implementation of this flag cleaner, I refactored `getRuleFinder()` to take an options object instead of a boolean as the second argument. Adding a second boolean (`includeDeprecated`) made it a difficult interface to use. Note that `eslint.linter.getRules()` returns an ES6 Map, which cannot be directly filtered. Also, its `keys()` function returns an iterable, so we have to spread that into an array before we can filter it. That's why the code is written the way it is. To make this feature have a cleaner implementation, I also performed the following refactorings: * Don't pass plugin rules to `_getAllAvailableRules`. Plugin rules are now merged with core rules directly in `RuleFinder` instead. * Rename `_getAllAvailableRules` -> `_getCoreRules` to better reflect its purpose. I also: * Removed the `nc` option; it isn't documented and isn't being used. * Split some of the `find` tests into two `it` blocks. I found that calling `proxyquire` twice in the same test wasn't doing anything, so was potentially hiding failures. * Renamed some `rule-finder` tests to result in more consistent output.

randycoulman · 2017-06-13T15:28:56Z

@ta2edchimp Done!

randycoulman · 2017-06-13T15:47:01Z

@ta2edchimp CI is failing because of test coverage. The line it's reporting as uncovered is function RuleFinder(specifiedFile, options = {}) {, which is definitely called a lot in the tests with various combinations of arguments, so I'm not sure why it's complaining.

ta2edchimp · 2017-06-13T15:47:36Z

src/lib/rule-finder.js

@@ -103,6 +108,6 @@ function RuleFinder(specifiedFile, noCore) {
  this.getUnusedRules = () => getSortedRules(unusedRules);
 }

-module.exports = function (specifiedFile, noCore) {
-  return new RuleFinder(specifiedFile, noCore);
+module.exports = function (specifiedFile, options = {}) {


If you leave out the default value (... (specifiedFile, options) {) here, the tests will pass.
(It's left to RuleFinder then, to assign a default value).

CI is complaining, because the branch where RuleFinder assigns the default value to its options parameter never gets called (because the exported function already assigns an empty object as default value to option).

It is understandable, that this fails ... this should not have been passing previously.

Yeah, that's it, thanks. I can't tell you how many times I've forgotten that there's that other function sitting there.

The default is supplied by the exported function, so doesn't need to be repeated here.

Putting them on `RuleFinder` instead of the exported function so that they're closer to where they're used.

ljharb · 2017-06-13T16:04:22Z

src/lib/rule-finder.js

@@ -108,6 +108,6 @@ function RuleFinder(specifiedFile, options) {
  this.getUnusedRules = () => getSortedRules(unusedRules);
 }

-module.exports = function (specifiedFile, options = {}) {
+module.exports = function (specifiedFile, options) {


Please continue specifying the default here also; it avoids contributing to the functions length.

For coverage, are you calling the function in tests without an options arg, so as to cover the defaulting?

@ljharb This is well-covered in the tests; the problem is that specifying the default in both places means that the one on the RuleFinder constructor isn't covered by tests because it's only ever called through this exported function.

Exactly that.

it should be specified in the exported place then; since that's what consumers see.

I would have thought exactly the other way around, the reason being the exported function only "dispatching" its arguments through, to the original RuleFinder. And exactly that is the place where errors would occur, when no option parameter would be specified.

@ta2edchimp Can you just revert my last commit, or do you need me to submit a new PR with this change?

I cannot simply push to this repo after using the git scalpel locally. So I would have reverted this with another separate commit when bumping the version number.

That's what git revert does, isn't it? My understanding is that it makes a new commit that backs out the changes that were made in the commit being reverted.

You're right. I have no idea what I was thinking about.
Feel free to open a new PR regarding this.

ljharb · 2017-06-13T16:04:46Z

@ta2edchimp please hold off before releasing; this should have been fixed prior to merging.

ta2edchimp · 2017-06-13T18:07:23Z

I think we covered everything. If I'm still missing something, please add a comment to #277

ljharb reviewed May 19, 2017

View reviewed changes

ljharb reviewed May 21, 2017

View reviewed changes

randycoulman force-pushed the omit-deprecated-rules branch from 389e82e to d777afd Compare May 21, 2017 20:30

ljharb approved these changes May 27, 2017

View reviewed changes

This was referenced Jun 9, 2017

chore(release): releasing 2.0.0 manually #274

Merged

Prepare 2.1.0 #275

Merged

randycoulman force-pushed the omit-deprecated-rules branch from d777afd to 0dc7434 Compare June 13, 2017 15:28

ta2edchimp reviewed Jun 13, 2017

View reviewed changes

randycoulman added 2 commits June 13, 2017 08:50

feat(rule-finder): Remove default parameter value from RuleFinder

7b9df81

The default is supplied by the exported function, so doesn't need to be repeated here.

feat(rule-finder): Switch up where the default options are specified

0931677

Putting them on `RuleFinder` instead of the exported function so that they're closer to where they're used.

ta2edchimp merged commit 2e68098 into sarbbottam:master Jun 13, 2017

ljharb reviewed Jun 13, 2017

View reviewed changes

randycoulman deleted the omit-deprecated-rules branch June 13, 2017 16:06

randycoulman mentioned this pull request Jun 13, 2017

revert: feat(rule-finder): Default options on exported function #276

Merged

randycoulman mentioned this pull request Feb 23, 2018

Prepare 3.2.1 #289

Merged


		By default, core rules will be included in the output of `-c\|--current`, `-a\|--all-available`, and `-u\|--unused`. If you want to report on plugin rules only, use the `--no-core` flag.

		By default, deprecated rules will be omitted from the output of `-a\|--all-available`, `-p\|--plugin` and `-u\|--unused`. If you want to report on deprecated rules as well, use the `--include deprecated` or `-i deprecated` flag.

feat(rule-finder): Omit deprecated rules #270

feat(rule-finder): Omit deprecated rules #270

Conversation

randycoulman commented May 19, 2017 • edited

ljharb left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

randycoulman commented May 19, 2017

ljharb commented May 19, 2017

codecov-io commented May 19, 2017 • edited

Codecov Report

randycoulman commented May 19, 2017

ljharb left a comment

Choose a reason for hiding this comment

randycoulman commented May 19, 2017

ljharb commented May 19, 2017

randycoulman commented May 21, 2017

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

ta2edchimp commented May 21, 2017

ljharb commented May 21, 2017

ta2edchimp commented May 21, 2017

randycoulman commented May 21, 2017

randycoulman commented May 21, 2017 • edited

ta2edchimp commented May 21, 2017

randycoulman commented May 21, 2017

randycoulman commented May 21, 2017

randycoulman commented May 21, 2017

ta2edchimp commented May 21, 2017

randycoulman commented May 21, 2017

randycoulman commented May 26, 2017

ljharb left a comment

Choose a reason for hiding this comment

ta2edchimp commented May 27, 2017

ta2edchimp commented Jun 13, 2017

randycoulman commented Jun 13, 2017

randycoulman commented Jun 13, 2017

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

randycoulman Jun 13, 2017 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

ljharb commented Jun 13, 2017

ta2edchimp commented Jun 13, 2017

randycoulman commented May 19, 2017 •

edited

codecov-io commented May 19, 2017 •

edited

randycoulman commented May 21, 2017 •

edited

randycoulman Jun 13, 2017 •

edited