Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature/reduce-and-fan-ngram-index #189

Merged
merged 18 commits into from Jun 15, 2022
Merged

feature/reduce-and-fan-ngram-index #189

merged 18 commits into from Jun 15, 2022

Commits on Mar 3, 2022

  1. Always upload 500 grams at a time

    JacksonMaxfield committed Mar 3, 2022
    Copy the full SHA
    f856597 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2022

  1. Ignore all files in index/

    JacksonMaxfield committed Mar 4, 2022
    Copy the full SHA
    ac3a4e1 View commit details
    Browse the repository at this point in the history

  2. Reorg index generation from upload

    JacksonMaxfield committed Mar 4, 2022
    Copy the full SHA
    539f706 View commit details
    Browse the repository at this point in the history

  3. Rename bin script

    JacksonMaxfield committed Mar 4, 2022
    Copy the full SHA
    a5bb872 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2022

  1. Merge branch 'main' into feature/reduce-ngram-index

    JacksonMaxfield committed Mar 10, 2022
    Copy the full SHA
    e5b3c11 View commit details
    Browse the repository at this point in the history

  2. Fix tests and lint

    JacksonMaxfield committed Mar 10, 2022
    Copy the full SHA
    600b237 View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2022

  1. Merge branch 'main' into feature/reduce-ngram-index

    JacksonMaxfield committed Jun 2, 2022
    Copy the full SHA
    99a56af View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2022

  1. Add workflow and bin for upload, cleanup generate

    JacksonMaxfield committed Jun 12, 2022
    Copy the full SHA
    837fce3 View commit details
    Browse the repository at this point in the history

  2. Lint and format

    JacksonMaxfield committed Jun 12, 2022
    Copy the full SHA
    da80b16 View commit details
    Browse the repository at this point in the history

  3. Move pyarrow for test to pipeline deps

    JacksonMaxfield committed Jun 12, 2022
    Copy the full SHA
    0407c49 View commit details
    Browse the repository at this point in the history

  4. Fix filenaming in pipeline and tests

    JacksonMaxfield committed Jun 12, 2022
    Copy the full SHA
    fde67fe View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2022

  1. Start on store remote work

    JacksonMaxfield committed Jun 13, 2022
    Copy the full SHA
    ad8fbc4 View commit details
    Browse the repository at this point in the history

  2. Upgrade pyarrow version

    JacksonMaxfield committed Jun 13, 2022
    Copy the full SHA
    824f41f View commit details
    Browse the repository at this point in the history

  3. Add download functionality and finish processing index chunks

    JacksonMaxfield committed Jun 13, 2022
    Copy the full SHA
    a5d8a77 View commit details
    Browse the repository at this point in the history

  4. gitignore, and lint and format

    JacksonMaxfield committed Jun 13, 2022
    Copy the full SHA
    652dea1 View commit details
    Browse the repository at this point in the history

  5. Mock indexing tests

    JacksonMaxfield committed Jun 13, 2022
    Copy the full SHA
    148b5c7 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. Merge branch 'main' into feature/reduce-ngram-index

    JacksonMaxfield committed Jun 15, 2022
    Copy the full SHA
    ae7e4bb View commit details
    Browse the repository at this point in the history

  2. Parametrize chunk and batch sizes

    JacksonMaxfield committed Jun 15, 2022
    Copy the full SHA
    3f8c9bf View commit details
    Browse the repository at this point in the history