Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

More sensible default for extreme case of 1 none ascii char. #153

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

More sensible default for extreme case of 1 none ascii char. #153

wants to merge 3 commits into from

Commits on May 12, 2020

  1. guarantee to be prefered over ISO-8859-1 

    the problem was the confidence function is quadratic for char hit = 1 it's too low.
Examples for 1 up to 3 char hits. For 6 or more it default's to 99%.
So why not default for 1 char hit to 73,1% instead of 50.5%
1-(0.5**1*0.99) = 0.505     -> new 0.731
1-(0.5**2*0.99) = 0.7525
1-(0.5**3*0.99) = 0.87625
6 or more = 0.99

ISO-8859-1 is limited to 0.73
    @elcolumbio
    elcolumbio committed May 12, 2020
    Configuration menu
    Copy the full SHA
    52e066f View commit details
    Browse the repository at this point in the history

  2. small fix to allow use of ONE_CHAR_PROB parameter

    @elcolumbio
    elcolumbio committed May 12, 2020
    Configuration menu
    Copy the full SHA
    257cca6 View commit details
    Browse the repository at this point in the history

  3. typos resolved

    @elcolumbio
    elcolumbio committed May 12, 2020
    Configuration menu
    Copy the full SHA
    e0721c6 View commit details
    Browse the repository at this point in the history