Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor parsing completely #203

Merged
merged 90 commits into from Feb 13, 2021
Merged

Refactor parsing completely #203

merged 90 commits into from Feb 13, 2021

Commits on Dec 30, 2020

  1. Add TokenStream

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    6c8eee2 View commit details
    Browse the repository at this point in the history

  2. Add token type identifier

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    c36150b View commit details
    Browse the repository at this point in the history

  3. Add DocStream

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    0e19aa2 View commit details
    Browse the repository at this point in the history

  4. Refactor: Lexer -> Parser -> ParseStream

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    3846ac8 View commit details
    Browse the repository at this point in the history

  5. Push rather than throw errors

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    d258b35 View commit details
    Browse the repository at this point in the history

  6. lexer: Harmonise scalar unindent/doc-end detection

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    17c9b4b View commit details
    Browse the repository at this point in the history

  7. lexer: Fix indent handling for maps in sequences

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    eebbe89 View commit details
    Browse the repository at this point in the history

  8. Add some d.ts files next to their js sources, for now copying content… 

    … from those in root
    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    69ca08d View commit details
    Browse the repository at this point in the history

  9. Refactor & fix type declarations

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    b270dfb View commit details
    Browse the repository at this point in the history

  10. Add initial dev-only build for mixed JS+TS sources 

    For now with separate build steps:
    npx rollup -c rollup.dev-config.js
    npx tsc
    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    fdd0971 View commit details
    Browse the repository at this point in the history

  11. Add StreamDirectives

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    6fc22cb View commit details
    Browse the repository at this point in the history

  12. Add composeScalar() + scalar value folding

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    9d09709 View commit details
    Browse the repository at this point in the history

  13. Split src/stream/ into src/{parse,compose}/

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    c409eee View commit details
    Browse the repository at this point in the history

  14. Add optional onNewLine(offset) callback to parser

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    b59e930 View commit details
    Browse the repository at this point in the history

  15. lexer: Require more indent in top-level mapping values

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    3041d04 View commit details
    Browse the repository at this point in the history

  16. Add starting offset to all block & flow tokens

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    e4d2de3 View commit details
    Browse the repository at this point in the history

  17. Refactor scalar composition to also determine node [start, end) range

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    b2ca63f View commit details
    Browse the repository at this point in the history

  18. Refactor compose error callback to always use offset from beginning o… 

    …f stream
    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    54e9d2e View commit details
    Browse the repository at this point in the history

  19. Start on supporting collection composition, with block sequences

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    3e61321 View commit details
    Browse the repository at this point in the history

  20. Add initial block mapping composition, refactoring around it

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    37004ce View commit details
    Browse the repository at this point in the history

  21. lexer: Fix for lines without value

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    ba7ef7b View commit details
    Browse the repository at this point in the history

  22. parser: Start new document on doc-start after content

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    94942b5 View commit details
    Browse the repository at this point in the history

  23. Add document composition, with test wrapper at compose/parse-docs

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    153f816 View commit details
    Browse the repository at this point in the history

  24. Overload token arg of composeNode() for empty node support

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    99f27ce View commit details
    Browse the repository at this point in the history

  25. Prop resolution fixes

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    4a1d99b View commit details
    Browse the repository at this point in the history

  26. Add initial flow collection composition

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    217f9fe View commit details
    Browse the repository at this point in the history

  27. Fix config to allow TS sources in tests

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    f3a51f8 View commit details
    Browse the repository at this point in the history

  28. Add minimal scaffold for using stream parser via old API

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    1b037f0 View commit details
    Browse the repository at this point in the history

  29. Add directives to Document, use for proper tag names

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    c21b375 View commit details
    Browse the repository at this point in the history

  30. Refactor index.js as index.ts & adjust scripts accordingly

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    ac36361 View commit details
    Browse the repository at this point in the history

  31. Use LOG_TOKENS and LOG_STREAM env vars to control debug prints

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    7cff090 View commit details
    Browse the repository at this point in the history

  32. Add & use a new Node.Parsed interface when range is known

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    3443d08 View commit details
    Browse the repository at this point in the history

  33. Make Collection schema not enumerable to hide it from logging

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    138087c View commit details
    Browse the repository at this point in the history

  34. Handle composition of all supported collections, not just map & seq

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    2fc9e65 View commit details
    Browse the repository at this point in the history

  35. Return null from parse() & parseDocument() for empty input

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    88ca375 View commit details
    Browse the repository at this point in the history

  36. Fix various bugs

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    a8fe00f View commit details
    Browse the repository at this point in the history

  37. Adjust tests

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    264c1c5 View commit details
    Browse the repository at this point in the history

  38. Fix some map parsing cases

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    d5d3542 View commit details
    Browse the repository at this point in the history

  39. Allow flow collections to grab line-end comments & act as implicit ma… 

    …p keys
    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    f7a89a9 View commit details
    Browse the repository at this point in the history

  40. Drop YAML 1.0 tests

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    51f9615 View commit details
    Browse the repository at this point in the history

  41. Resolve merge pairs

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    2401304 View commit details
    Browse the repository at this point in the history

  42. Fix alias parsing

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    4fce392 View commit details
    Browse the repository at this point in the history

  43. Ensure Anchors#setAnchor() follows its documented behaviour

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    4ae6927 View commit details
    Browse the repository at this point in the history

  44. Fix top-level block scalar parsing

    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    f68fc4f View commit details
    Browse the repository at this point in the history

  45. Lexer fixes: Empty scalars, tabs, cr-lf after plain, colon after plai… 

    …n in flow
    @eemeli
    eemeli committed Dec 30, 2020
    Copy the full SHA
    ec6835d View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2021

  1. Add strict option (default true), to allow being less pedantic

    @eemeli
    eemeli committed Jan 1, 2021
    Copy the full SHA
    93975fa View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2021

  1. Loads of debugging for various tests

    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    182a2de View commit details
    Browse the repository at this point in the history

  2. Assign map & first-key props correctly

    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    b3a9783 View commit details
    Browse the repository at this point in the history

  3. Include offset in error tokens where possible

    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    0f84d86 View commit details
    Browse the repository at this point in the history

  4. Fix block-scalar indentation control

    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    3f0d5ec View commit details
    Browse the repository at this point in the history

  5. Require space before comment

    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    26c3a52 View commit details
    Browse the repository at this point in the history

  6. Allow skipping some yaml-test-suite tests

    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    1472244 View commit details
    Browse the repository at this point in the history

  7. Drop Document method listNonDefaultTags() 

    BREAKING CHANGE: The public method is no longer available, as its
internal use for it is being refactored to StreamDirectives. An
alternative pattern will need to be documented for any current users,
once the visitor API is available to use as a base for it. (#190)
    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    5ff783d View commit details
    Browse the repository at this point in the history

  8. Use doc.directives.tags rather than doc.tagPrefixes 

    Also add exports config for importing TS files into JS and refactor
listTagNames as TS.
    @eemeli
    eemeli committed Jan 2, 2021
    Copy the full SHA
    afe6ac6 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2021

  1. Loads more debugging for various tests

    @eemeli
    eemeli committed Jan 3, 2021
    Copy the full SHA
    05f5c75 View commit details
    Browse the repository at this point in the history

  2. Refactor doc-end parsing

    @eemeli
    eemeli committed Jan 3, 2021
    Copy the full SHA
    dbe74f1 View commit details
    Browse the repository at this point in the history

  3. Miscellaneous debugging

    @eemeli
    eemeli committed Jan 3, 2021
    Copy the full SHA
    d4b3276 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2021

  1. Check for outer block indent when parsing flow collections 

    Adds a new control character \x18 (Cancel) to lexer output, marking
unexpected end of flow mode.
    @eemeli
    eemeli committed Jan 6, 2021
    Copy the full SHA
    14585f5 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2021

  1. Fix tests to expect new error message strings

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    8e722ff View commit details
    Browse the repository at this point in the history

  2. Refactor directives to support version-specific behaviour

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    2be7e80 View commit details
    Browse the repository at this point in the history

  3. Allow for byte-order-mark in stream

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    816db58 View commit details
    Browse the repository at this point in the history

  4. Refactor parseDocs() into composeStream(), adding empty-stream handling

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    fb1a65a View commit details
    Browse the repository at this point in the history

  5. Fix bugs, mostly with tag parsing and error reporting

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    f16333d View commit details
    Browse the repository at this point in the history

  6. Check implicit key lengths, refactoring also contains-newline check

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    70bb49c View commit details
    Browse the repository at this point in the history

  7. Improve null value printing 

    Now either the collection needs to be a Set (!!set), or have a truly
empty value in order to print as `? foo` rather than `foo: null`. This
is necessary, as more empty strings are now parsed as `Scalar<null>`
rather than just `null`.
    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    2d63b15 View commit details
    Browse the repository at this point in the history

  8. Bugfixes, mostly for comment & whitespace handling

    @eemeli
    eemeli committed Jan 9, 2021
    Copy the full SHA
    0f5bf20 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2021

  1. Fix document comment parsing; add directives to EmptyStream

    @eemeli
    eemeli committed Jan 10, 2021
    Copy the full SHA
    5e8ad7e View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2021

  1. Assign collection comments separated by empty line to preceding node

    @eemeli
    eemeli committed Jan 24, 2021
    Copy the full SHA
    8587841 View commit details
    Browse the repository at this point in the history

  2. Do not include trailing lines for strip & clip chomped block scalars

    @eemeli
    eemeli committed Jan 24, 2021
    Copy the full SHA
    eebde3c View commit details
    Browse the repository at this point in the history

  3. Grab trailing less-indented comments from inner block map/seq to parent

    @eemeli
    eemeli committed Jan 24, 2021
    Copy the full SHA
    20f4220 View commit details
    Browse the repository at this point in the history

  4. ci: Tweak GitHub Action workflow, for now skipping browser & dist tests

    @eemeli
    eemeli committed Jan 24, 2021
    Copy the full SHA
    bb211fc View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2021

  1. Rename files in src/parse/, mark class private members as such

    @eemeli
    eemeli committed Jan 30, 2021
    Copy the full SHA
    88b6cbd View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2021

  1. Merge branch 'master' into stream

    @eemeli
    eemeli committed Jan 31, 2021
    Copy the full SHA
    20ced9c View commit details
    Browse the repository at this point in the history

  2. Refactor visit() as TypeScript

    @eemeli
    eemeli committed Jan 31, 2021
    Copy the full SHA
    2bfb11c View commit details
    Browse the repository at this point in the history

  3. Include source string value for all scalars

    @eemeli
    eemeli committed Jan 31, 2021
    Copy the full SHA
    87e0e23 View commit details
    Browse the repository at this point in the history

  4. Use new parser for test-events; fix bugs as needed

    @eemeli
    eemeli committed Jan 31, 2021
    Copy the full SHA
    db96f63 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2021

  1. Drop Document#parse(cst) method

    @eemeli
    eemeli committed Feb 1, 2021
    Copy the full SHA
    fec3ca0 View commit details
    Browse the repository at this point in the history

  2. Only test for default tag matches when stringifying a string

    @eemeli
    eemeli committed Feb 1, 2021
    Copy the full SHA
    15f8871 View commit details
    Browse the repository at this point in the history

  3. Drop all code in src/resolve/ as unused

    @eemeli
    eemeli committed Feb 1, 2021
    Copy the full SHA
    dd0198e View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2021

  1. Drop all code in & references to src/cst/ as obsolete

    @eemeli
    eemeli committed Feb 7, 2021
    Copy the full SHA
    f9451ef View commit details
    Browse the repository at this point in the history

  2. Drop YAMLReferenceError, YAMLSemanticError & YAMLSyntaxError in favou… 

    …r of YAMLParseError
    @eemeli
    eemeli committed Feb 7, 2021
    Copy the full SHA
    beb8d8b View commit details
    Browse the repository at this point in the history

  3. Refactor errors.js as TypeScript

    @eemeli
    eemeli committed Feb 7, 2021
    Copy the full SHA
    0e7ea1c View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2021

  1. Refactor composeStream function into Composer class

    @eemeli
    eemeli committed Feb 8, 2021
    Copy the full SHA
    5bc1066 View commit details
    Browse the repository at this point in the history

  2. Add lineCounter option to parse methods & LineCounter class

    @eemeli
    eemeli committed Feb 8, 2021
    Copy the full SHA
    bcc0420 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2021

  1. Re-rename CSTParser as just Parser

    @eemeli
    eemeli committed Feb 12, 2021
    Copy the full SHA
    a6d9bcf View commit details
    Browse the repository at this point in the history

  2. Add exports & API docs for Lexer, Parser & Composer

    @eemeli
    eemeli committed Feb 12, 2021
    Copy the full SHA
    9dd0cb1 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2021

  1. Refactor options & tags/options as TypeScript

    @eemeli
    eemeli committed Feb 13, 2021
    Copy the full SHA
    cef8489 View commit details
    Browse the repository at this point in the history

  2. Include TS support in Node.js & browser builds; drop separate dev build

    @eemeli
    eemeli committed Feb 13, 2021
    Copy the full SHA
    ff8bdca View commit details
    Browse the repository at this point in the history

  3. ci: Re-enable browser & dist tests

    @eemeli
    eemeli committed Feb 13, 2021
    Copy the full SHA
    3ac4a33 View commit details
    Browse the repository at this point in the history

  4. Drop example/test files from src/parse/

    @eemeli
    eemeli committed Feb 13, 2021
    Copy the full SHA
    d1e59c5 View commit details
    Browse the repository at this point in the history