Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Simplify Sphinx's Stemmer #10467

Merged
merged 37 commits into from Jun 16, 2022
Merged

Simplify Sphinx's Stemmer #10467

merged 37 commits into from Jun 16, 2022

Commits on May 23, 2022

  1. Inline the adjusted .stem() method into PorterStemmer

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    f9bc6a0 View commit details
    Browse the repository at this point in the history

  2. Add tests

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    904f332 View commit details
    Browse the repository at this point in the history

  3. Simplify the docstring in PorterStemmer.stem()

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    f73d39b View commit details
    Browse the repository at this point in the history

  4. Make the short-string check more explicit in PorterStemmer.stem()

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    0a75457 View commit details
    Browse the repository at this point in the history

  5. Add annotations to instance variables in PorterStemmer

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    adb1bdb View commit details
    Browse the repository at this point in the history

  6. PorterStemmer.k0 is always 0

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    1caf546 View commit details
    Browse the repository at this point in the history

  7. PorterStemmer.cons -> PorterStemmer.is_consonant

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    879e2ff View commit details
    Browse the repository at this point in the history

  8. PorterStemmer.doublec -> PorterStemmer.double_consonant

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    af29f11 View commit details
    Browse the repository at this point in the history

  9. Inplace arithmetic

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    851bbac View commit details
    Browse the repository at this point in the history

  10. PorterStemmer.m -> PorterStemmer.measure_consonant_sequences

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    4ebf4fe View commit details
    Browse the repository at this point in the history

  11. PorterStemmer.vowelinstem -> PorterStemmer.vowel_in_stem

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    7a31c2a View commit details
    Browse the repository at this point in the history

  12. PorterStemmer.cvc -> PorterStemmer.consonant_vowel_consonant

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    50063b3 View commit details
    Browse the repository at this point in the history

  13. Simplify PorterStemmer.ends

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    6150784 View commit details
    Browse the repository at this point in the history

  14. Add tests

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    188b5f5 View commit details
    Browse the repository at this point in the history

  15. PorterStemmer.setto -> PorterStemmer.set_to

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    a31c6ae View commit details
    Browse the repository at this point in the history

  16. Store locals

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    5ae826c View commit details
    Browse the repository at this point in the history

  17. Calculate self.k based on len(self.b)

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    36ad9a7 View commit details
    Browse the repository at this point in the history

  18. Inline self.k

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    380d50e View commit details
    Browse the repository at this point in the history

  19. Simplify

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    e6f3dab View commit details
    Browse the repository at this point in the history

  20. Simplify

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    a77533b View commit details
    Browse the repository at this point in the history

  21. Simplify

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    1334e9c View commit details
    Browse the repository at this point in the history

  22. Remove set_to

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    703417a View commit details
    Browse the repository at this point in the history

  23. Use PorterStemmer for static methods

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    227a71f View commit details
    Browse the repository at this point in the history

  24. Replace .r with .replace

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    a3c4a29 View commit details
    Browse the repository at this point in the history

  25. Replace .r with .replace

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    ac493e4 View commit details
    Browse the repository at this point in the history

  26. Remove more .js

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    af3ca7a View commit details
    Browse the repository at this point in the history

  27. Methods -> functions

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    4e07483 View commit details
    Browse the repository at this point in the history

  28. snowball

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    523918a View commit details
    Browse the repository at this point in the history

  29. set

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    496352e View commit details
    Browse the repository at this point in the history

  30. self.b -> self.word

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    e5a753d View commit details
    Browse the repository at this point in the history

  31. s -> string

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    161e63d View commit details
    Browse the repository at this point in the history

  32. Simplify self.ends and self.replace

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    409733a View commit details
    Browse the repository at this point in the history

  33. Revert "Add tests" 

    This reverts commit 115250f
    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    b983eb5 View commit details
    Browse the repository at this point in the history

  34. Revert experimentation

    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    0f5c22c View commit details
    Browse the repository at this point in the history

  35. Deprecate sphinx.util.stemmer in favour of snowballstemmer 

    PorterStemmer, BaseStemmer, PyStemmer, StandardStemmer, and get_stemmer are deprecated
sphinx.util.stemmer.porter is removed
    @AA-Turner
    AA-Turner committed May 23, 2022
    Copy the full SHA
    b5d50fe View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2022

  1. Merge branch '5.x' into stemmer

    @AA-Turner
    AA-Turner committed Jun 16, 2022
    Copy the full SHA
    23dd223 View commit details
    Browse the repository at this point in the history

  2. Update docs

    @AA-Turner
    AA-Turner committed Jun 16, 2022
    Copy the full SHA
    7c53a6b View commit details
    Browse the repository at this point in the history