Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New: Add option to allow use of file contents for cache #63

Merged
merged 3 commits into from Sep 9, 2020
Merged
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
58 changes: 58 additions & 0 deletions designs/2020-cache-contents-option/README.md
@@ -0,0 +1,58 @@
- Start Date: 2020-07-15
- RFC PR: https://github.com/eslint/rfcs/pull/63
- Authors: @c-home

# Allow use of file contents for cache

## Summary

This RFC proposes improving cache for CI by providing an option to use a hash (instead of `mtime` and `fsize`) comparison to determine whether a file has changed.

## Motivation

Motivation for this change is the same as [#11490](https://github.com/eslint/eslint/issues/11490), where details of files like `mtime` are not preserved in the CI environment. With a hash comparison, the cache can be used in CI and would significantly reduce the time ESLint takes to run.

ESLint uses [`file-entry-create`](https://github.com/royriojas/file-entry-cache) as its cache provider. [fileEntryCache#create](https://github.com/royriojas/file-entry-cache#createcachename-directory-usechecksum) gives the option to use a md5 hash through the `useChecksum` argument, but ESLint currently does not utilize it.

## Detailed Design

This RFC adds a `--cache-strategy` CLI option. Users can specify the option to be:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please describe the details of the implementation here? Which files would be changed?

- `contents`, for the use of an md5 hash
- `metadata`, for the use of `mtime` and `fsize`

Modified time and size (`metadata`), does not need to be specified as it will remain the default.

The implementation will be similar to [#11487](https://github.com/eslint/eslint/pull/11487), with differences in the naming of the options. The options were kept general so if the underlying implementation of the comparison method were to change, the usage and documentation can remain the same.

## Documentation

Documentation for ESLint CLI will be updated with a description of the option.

## Drawbacks

- Specifying the details of the cache behaviour through a public option can make it more difficult to change the design and implementation [without breaking its usage](https://github.com/eslint/eslint/issues/11490#issuecomment-471400143).
- Comparing files based on their contents is slower than comparing files by their file metadata. However, a file contents comparison is not the default.
- Like any new feature, this flag will slightly increase the complexity and maintenance costs of ESLint.

## Backwards Compatibility Analysis

This change is backwards-compatible. It adds a new CLI option while keeping the behavior the same if the option is not specified.

## Alternatives

Mentioned as an alternative in [#11487](https://github.com/eslint/eslint/pull/11487), and if `file-entry-cache` [#14](https://github.com/royriojas/file-entry-cache/pull/14) were to be merged, an environment variable could be passed through `eslint` to `file-entry-cache`.

## Open Questions

None

## Frequently Asked Questions

None yet

## Related Discussions

- https://github.com/eslint/eslint/issues/11319
- https://github.com/eslint/eslint/issues/11490
- https://github.com/eslint/eslint/pull/11487
- https://github.com/royriojas/file-entry-cache/pull/14