Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* 📝 Add CHANGELOG.md initial from 2.0.8.dev to 1.4.0 * 🔥 remove filter warning in setup.cfg
- Loading branch information
Showing
2 changed files
with
139 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,139 @@ | ||
| # Changelog | ||
| All notable changes to charset-normalizer will be documented in this file. This project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). | ||
| The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/). | ||
|
|
||
| ## [2.0.8.dev3](https://github.com/Ousret/charset_normalizer/compare/2.0.7...master) (unreleased) | ||
| ### Changed | ||
| - Improvement over Vietnamese detection (PR #126) | ||
| - MD improvement on trailing data and long foreign (non-pure latin) data (PR #124) | ||
| - Efficiency improvements in cd/alphabet_languages from [@adbar](https://github.com/adbar) (PR #122) | ||
| - call sum() without an intermediary list following PEP 289 recommendations from [@adbar](https://github.com/adbar) (PR #129) | ||
| - Code style as refactored by Sourcery-AI (PR #131) | ||
| - Minor adjustment on the MD around european words (PR #133) | ||
| - Remove and replace SRTs from assets / tests (PR #139) | ||
|
|
||
| ### Fixed | ||
| - Fix large (misleading) sequence giving UnicodeDecodeError (PR #137) | ||
| - Avoid using too insignificant chunk (PR #137) | ||
|
|
||
| ## [2.0.7](https://github.com/Ousret/charset_normalizer/compare/2.0.6...2.0.7) (2021-10-11) | ||
| ### Added | ||
| - Add support for Kazakh (Cyrillic) language detection (PR #109) | ||
|
|
||
| ### Changed | ||
| - Further, improve inferring the language from a given single-byte code page (PR #112) | ||
| - Vainly trying to leverage PEP263 when PEP3120 is not supported (PR #116) | ||
| - Refactoring for potential performance improvements in loops from [@adbar](https://github.com/adbar) (PR #113) | ||
| - Various detection improvement (MD+CD) (PR #117) | ||
|
|
||
| ### Removed | ||
| - Remove redundant logging entry about detected language(s) (PR #115) | ||
|
|
||
| ### Fixed | ||
| - Fix a minor inconsistency between Python 3.5 and other versions regarding language detection (PR #117 #102) | ||
|
|
||
| ## [2.0.6](https://github.com/Ousret/charset_normalizer/compare/2.0.5...2.0.6) (2021-09-18) | ||
| ### Fixed | ||
| - Unforeseen regression with the loss of the backward-compatibility with some older minor of Python 3.5.x (PR #100) | ||
| - Fix CLI crash when using --minimal output in certain cases (PR #103) | ||
|
|
||
| ### Changed | ||
| - Minor improvement to the detection efficiency (less than 1%) (PR #106 #101) | ||
|
|
||
| ## [2.0.5](https://github.com/Ousret/charset_normalizer/compare/2.0.4...2.0.5) (2021-09-14) | ||
| ### Changed | ||
| - The project now comply with: flake8, mypy, isort and black to ensure a better overall quality (PR #81) | ||
| - The BC-support with v1.x was improved, the old staticmethods are restored (PR #82) | ||
| - The Unicode detection is slightly improved (PR #93) | ||
| - Add syntax sugar \_\_bool\_\_ for results CharsetMatches list-container (PR #91) | ||
|
|
||
| ### Removed | ||
| - The project no longer raise warning on tiny content given for detection, will be simply logged as warning instead (PR #92) | ||
|
|
||
| ### Fixed | ||
| - In some rare case, the chunks extractor could cut in the middle of a multi-byte character and could mislead the mess detection (PR #95) | ||
| - Some rare 'space' characters could trip up the UnprintablePlugin/Mess detection (PR #96) | ||
| - The MANIFEST.in was not exhaustive (PR #78) | ||
|
|
||
| ## [2.0.4](https://github.com/Ousret/charset_normalizer/compare/2.0.3...2.0.4) (2021-07-30) | ||
| ### Fixed | ||
| - The CLI no longer raise an unexpected exception when no encoding has been found (PR #70) | ||
| - Fix accessing the 'alphabets' property when the payload contains surrogate characters (PR #68) | ||
| - The logger could mislead (explain=True) on detected languages and the impact of one MBCS match (PR #72) | ||
| - Submatch factoring could be wrong in rare edge cases (PR #72) | ||
| - Multiple files given to the CLI were ignored when publishing results to STDOUT. (After the first path) (PR #72) | ||
| - Fix line endings from CRLF to LF for certain project files (PR #67) | ||
|
|
||
| ### Changed | ||
| - Adjust the MD to lower the sensitivity, thus improving the global detection reliability (PR #69 #76) | ||
| - Allow fallback on specified encoding if any (PR #71) | ||
|
|
||
| ## [2.0.3](https://github.com/Ousret/charset_normalizer/compare/2.0.2...2.0.3) (2021-07-16) | ||
| ### Changed | ||
| - Part of the detection mechanism has been improved to be less sensitive, resulting in more accurate detection results. Especially ASCII. (PR #63) | ||
| - According to the community wishes, the detection will fall back on ASCII or UTF-8 in a last-resort case. (PR #64) | ||
|
|
||
| ## [2.0.2](https://github.com/Ousret/charset_normalizer/compare/2.0.1...2.0.2) (2021-07-15) | ||
| ### Fixed | ||
| - Empty/Too small JSON payload miss-detection fixed. Report from [@tseaver](https://github.com/tseaver) (PR #59) | ||
|
|
||
| ### Changed | ||
| - Don't inject unicodedata2 into sys.modules from [@akx](https://github.com/akx) (PR #57) | ||
|
|
||
| ## [2.0.1](https://github.com/Ousret/charset_normalizer/compare/2.0.0...2.0.1) (2021-07-13) | ||
| ### Fixed | ||
| - Make it work where there isn't a filesystem available, dropping assets frequencies.json. Report from [@sethmlarson](https://github.com/sethmlarson). (PR #55) | ||
| - Using explain=False permanently disable the verbose output in the current runtime (PR #47) | ||
| - One log entry (language target preemptive) was not show in logs when using explain=True (PR #47) | ||
| - Fix undesired exception (ValueError) on getitem of instance CharsetMatches (PR #52) | ||
|
|
||
| ### Changed | ||
| - Public function normalize default args values were not aligned with from_bytes (PR #53) | ||
|
|
||
| ### Added | ||
| - You may now use charset aliases in cp_isolation and cp_exclusion arguments (PR #47) | ||
|
|
||
| ## [2.0.0](https://github.com/Ousret/charset_normalizer/compare/1.4.1...2.0.0) (2021-07-02) | ||
| ### Changed | ||
| - 4x to 5 times faster than the previous 1.4.0 release. At least 2x faster than Chardet. | ||
| - Accent has been made on UTF-8 detection, should perform rather instantaneous. | ||
| - The backward compatibility with Chardet has been greatly improved. The legacy detect function returns an identical charset name whenever possible. | ||
| - The detection mechanism has been slightly improved, now Turkish content is detected correctly (most of the time) | ||
| - The program has been rewritten to ease the readability and maintainability. (+Using static typing)+ | ||
| - utf_7 detection has been reinstated. | ||
|
|
||
| ### Removed | ||
| - This package no longer require anything when used with Python 3.5 (Dropped cached_property) | ||
| - Removed support for these languages: Catalan, Esperanto, Kazakh, Baque, Volapük, Azeri, Galician, Nynorsk, Macedonian, and Serbocroatian. | ||
| - The exception hook on UnicodeDecodeError has been removed. | ||
|
|
||
| ### Deprecated | ||
| - Methods coherence_non_latin, w_counter, chaos_secondary_pass of the class CharsetMatch are now deprecated and scheduled for removal in v3.0 | ||
|
|
||
| ### Fixed | ||
| - The CLI output used the relative path of the file(s). Should be absolute. | ||
|
|
||
| ## [1.4.1](https://github.com/Ousret/charset_normalizer/compare/1.4.0...1.4.1) (2021-05-28) | ||
| ### Fixed | ||
| - Logger configuration/usage no longer conflict with others (PR #44) | ||
|
|
||
| ## [1.4.0](https://github.com/Ousret/charset_normalizer/compare/1.3.9...1.4.0) (2021-05-21) | ||
| ### Removed | ||
| - Using standard logging instead of using the package loguru. | ||
| - Dropping nose test framework in favor of the maintained pytest. | ||
| - Choose to not use dragonmapper package to help with gibberish Chinese/CJK text. | ||
| - Require cached_property only for Python 3.5 due to constraint. Dropping for every other interpreter version. | ||
| - Stop support for UTF-7 that does not contain a SIG. | ||
| - Dropping PrettyTable, replaced with pure JSON output in CLI. | ||
|
|
||
| ### Fixed | ||
| - BOM marker in a CharsetNormalizerMatch instance could be False in rare cases even if obviously present. Due to the sub-match factoring process. | ||
| - Not searching properly for the BOM when trying utf32/16 parent codec. | ||
|
|
||
| ### Changed | ||
| - Improving the package final size by compressing frequencies.json. | ||
| - Huge improvement over the larges payload. | ||
|
|
||
| ### Added | ||
| - CLI now produces JSON consumable output. | ||
| - Return ASCII if given sequences fit. Given reasonable confidence. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters