Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rework Lexer to use extendable array of tokenizer functions #1872

Closed
wants to merge 11 commits into from
Closed

Rework Lexer to use extendable array of tokenizer functions #1872

wants to merge 11 commits into from

Commits on Dec 13, 2020

  1. Move BlockTokenizers to array

    @calculuschild
    calculuschild committed Dec 13, 2020
    Configuration menu
    Copy the full SHA
    4ce28a2 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2020

  1. Array to Map, Fixed Links

    @calculuschild
    calculuschild committed Dec 15, 2020
    Configuration menu
    Copy the full SHA
    63973e6 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2020

  1. Converted inline Tokenizers over

    @calculuschild
    calculuschild committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    2595fb8 View commit details
    Browse the repository at this point in the history

  2. Change Maps to Arrays of Objects 

    Much faster
    @calculuschild
    calculuschild committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    e79cbaf View commit details
    Browse the repository at this point in the history

  3. Lint

    @calculuschild
    calculuschild committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    a6741f1 View commit details
    Browse the repository at this point in the history

  4. Remove redundant variable declarations 

    Some variables aren't used until the params object. No need to separately declare them before.
    @calculuschild
    calculuschild committed Dec 16, 2020
    Configuration menu
    Copy the full SHA
    196686c View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2020

  1. Array loop to Array.some 

    Also remove i, l, token from params. Generating/accessing these from the params object is slower than just declaring them within the tokenizer.
    @calculuschild
    calculuschild committed Dec 25, 2020
    Configuration menu
    Copy the full SHA
    df2f852 View commit details
    Browse the repository at this point in the history

Commits on Jan 7, 2021

  1. Move src and tokens out of Params

    @calculuschild
    calculuschild committed Jan 7, 2021
    Configuration menu
    Copy the full SHA
    583f18e View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2021

  1. Arrow function to normal

    @calculuschild
    calculuschild committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    91016c7 View commit details
    Browse the repository at this point in the history

  2. Clear up leftover comments

    @calculuschild
    calculuschild committed Jan 8, 2021
    Configuration menu
    Copy the full SHA
    db494ce View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2021

  1. Pass this as parameter instead of .call()

    @calculuschild
    calculuschild committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    4707ad8 View commit details
    Browse the repository at this point in the history