Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement model evaluation API (part 1) #5069

Merged
merged 61 commits into from Dec 7, 2021
Merged

Implement model evaluation API (part 1) #5069

merged 61 commits into from Dec 7, 2021

Commits on Nov 15, 2021

  1. init 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    e2c5aff View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 15, 2021
    Configuration menu
    Copy the full SHA
    91a6e1c View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    071e86b View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    e7d8a76 View commit details
    Browse the repository at this point in the history

  3. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    7499ac6 View commit details
    Browse the repository at this point in the history

  4. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    f1819a4 View commit details
    Browse the repository at this point in the history

  5. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    aa397e1 View commit details
    Browse the repository at this point in the history

  6. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 16, 2021
    Configuration menu
    Copy the full SHA
    981164a View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 17, 2021
    Configuration menu
    Copy the full SHA
    593bec8 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    2240d0a View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 18, 2021
    Configuration menu
    Copy the full SHA
    0e54b97 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    6ee4367 View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 19, 2021
    Configuration menu
    Copy the full SHA
    15712e0 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    63b1d2b View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    afc52e8 View commit details
    Browse the repository at this point in the history

  3. rename module 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 21, 2021
    Configuration menu
    Copy the full SHA
    feddc1e View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2021

  1. address comments 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    27814cf View commit details
    Browse the repository at this point in the history

  2. address comments 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    fc9cf1a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into eval_api

    @WeichenXu123
    WeichenXu123 committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    1f0c12d View commit details
    Browse the repository at this point in the history

  4. revert black change 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    d642309 View commit details
    Browse the repository at this point in the history

  5. change module path 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    2a67297 View commit details
    Browse the repository at this point in the history

  6. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 22, 2021
    Configuration menu
    Copy the full SHA
    66f760d View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    f7d6738 View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    c7f0360 View commit details
    Browse the repository at this point in the history

  3. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 23, 2021
    Configuration menu
    Copy the full SHA
    c2b673e View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2021

  1. address comments 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 25, 2021
    Configuration menu
    Copy the full SHA
    b046af3 View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2021

  1. Merge branch 'master' into eval_api

    @WeichenXu123
    WeichenXu123 committed Nov 27, 2021
    Configuration menu
    Copy the full SHA
    d7620e6 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2021

  1. fix 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 28, 2021
    Configuration menu
    Copy the full SHA
    14c8e82 View commit details
    Browse the repository at this point in the history

  2. refactor 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 28, 2021
    Configuration menu
    Copy the full SHA
    25101f9 View commit details
    Browse the repository at this point in the history

  3. lazy load pyspark 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 28, 2021
    Configuration menu
    Copy the full SHA
    a4db525 View commit details
    Browse the repository at this point in the history

  4. revert export 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 28, 2021
    Configuration menu
    Copy the full SHA
    035346f View commit details
    Browse the repository at this point in the history

  5. fix curcit import 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 28, 2021
    Configuration menu
    Copy the full SHA
    3422781 View commit details
    Browse the repository at this point in the history

  6. update tests 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 28, 2021
    Configuration menu
    Copy the full SHA
    0ad527e View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2021

  1. fix conftest.py 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    2ea29c6 View commit details
    Browse the repository at this point in the history

  2. Revert "fix conftest.py" 

    This reverts commit 2ea29c6.
    @WeichenXu123
    WeichenXu123 committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    6bcbb0c View commit details
    Browse the repository at this point in the history

  3. fix tests 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    46f3264 View commit details
    Browse the repository at this point in the history

  4. update doc 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 29, 2021
    Configuration menu
    Copy the full SHA
    d310359 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2021

  1. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    1b3519b View commit details
    Browse the repository at this point in the history

  2. default evaluator 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    09099de View commit details
    Browse the repository at this point in the history

  3. update 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    2f3faa6 View commit details
    Browse the repository at this point in the history

  4. fix 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Nov 30, 2021
    Configuration menu
    Copy the full SHA
    9aff5e8 View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2021

  1. fix 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    1dd0617 View commit details
    Browse the repository at this point in the history

  2. address comments 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    57012d3 View commit details
    Browse the repository at this point in the history

  3. merge master 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    cf5cb34 View commit details
    Browse the repository at this point in the history

  4. fix doc 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    21538cb View commit details
    Browse the repository at this point in the history

  5. fix doc 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    812f0df View commit details
    Browse the repository at this point in the history

  6. update import 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    cc2ac8e View commit details
    Browse the repository at this point in the history

  7. fix doc 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    226d54b View commit details
    Browse the repository at this point in the history

  8. update hash algo 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 1, 2021
    Configuration menu
    Copy the full SHA
    c20ccdc View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2021

  1. update import 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    68842fe View commit details
    Browse the repository at this point in the history

  2. address comment 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    755639b View commit details
    Browse the repository at this point in the history

  3. add tests 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    73cd704 View commit details
    Browse the repository at this point in the history

  4. fix lint 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 2, 2021
    Configuration menu
    Copy the full SHA
    010f225 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2021

  1. add tests 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    e2f9c89 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into eval_api

    @WeichenXu123
    WeichenXu123 committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    22b0bbd View commit details
    Browse the repository at this point in the history

  3. add more tests 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    b1b34f8 View commit details
    Browse the repository at this point in the history

  4. add tests 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    a51bd1f View commit details
    Browse the repository at this point in the history

  5. fix lint 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 3, 2021
    Configuration menu
    Copy the full SHA
    c82eaa6 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2021

  1. address comments 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    5413290 View commit details
    Browse the repository at this point in the history

  2. export EvaluationDataset 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    7d14373 View commit details
    Browse the repository at this point in the history

  3. update _load_content_from_file 

    Signed-off-by: Weichen Xu <weichen.xu@databricks.com>
    @WeichenXu123
    WeichenXu123 committed Dec 6, 2021
    Configuration menu
    Copy the full SHA
    779f22e View commit details
    Browse the repository at this point in the history