Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] tools: Add pygments import script #100

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

[WIP] tools: Add pygments import script #100

wants to merge 10 commits into from

Commits on Dec 18, 2018

  1. tools: Add pygments import script 

    Currently, we can retrieve the regex patterns for the required tokens
of all languages not found in the coAST schema.

Closes coala#96
    @iamkroot
    iamkroot committed Dec 18, 2018
    Copy the full SHA
    f9e73aa View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2018

  1. tools: Add keywords extraction logic for pygments 

    Many edge cases are yet to be covered. For now, the script simply skips
over all the languages for which it was unable to parse the patterns
properly.
    @iamkroot
    iamkroot committed Dec 21, 2018
    Copy the full SHA
    e7b6db4 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2018

  1. tools: pygments: Verify extracted keyword using regex 

    A simple way to check the correctness of the keyword, is to  ensure that
it matches the regex pattern that it was extracted from.
    @iamkroot
    iamkroot committed Dec 23, 2018
    Copy the full SHA
    05173cc View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2019

  1. tools: Break up pygments import script

    @iamkroot
    iamkroot committed Jan 2, 2019
    Copy the full SHA
    896c3e4 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2019

  1. pygments: Use words.words instead of words.get

    @iamkroot
    iamkroot committed Jan 3, 2019
    Copy the full SHA
    0cba7a9 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2019

  1. pygments: Update coast lang defs from lexers

    @iamkroot
    iamkroot committed Jan 16, 2019
    Copy the full SHA
    a47c373 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2019

  1. pygments-parser: Raise exception on failure

    @iamkroot
    iamkroot committed Mar 6, 2019
    Copy the full SHA
    9bc0f90 View commit details
    Browse the repository at this point in the history

  2. pygments: Overhaul processing logic

    @iamkroot
    iamkroot committed Mar 6, 2019
    Copy the full SHA
    0238800 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2019

  1. pygments: Save definitions to YAML files

    @iamkroot
    iamkroot committed Mar 10, 2019
    Copy the full SHA
    2603dc2 View commit details
    Browse the repository at this point in the history

Commits on Dec 24, 2019

  1. pygments: Use sre_yield to generate regexes

    @iamkroot
    iamkroot committed Dec 24, 2019
    Copy the full SHA
    6466539 View commit details
    Browse the repository at this point in the history