From 826c9ed2556cf5391c68edba4801b8b2aa0f7976 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Pawe=C5=82=20Redzy=C5=84ski?= Date: Tue, 21 Jun 2022 12:15:18 +0200 Subject: [PATCH] cmd-ref: plots: flexible plots docs Related: iterative/dvc#7477 Related: #2956 --- content/docs/command-reference/plots/diff.md | 8 +- content/docs/command-reference/plots/index.md | 393 +++++++++++++++--- .../docs/command-reference/plots/modify.md | 13 +- content/docs/command-reference/plots/show.md | 48 +-- .../project-structure/dvcyaml-files.md | 28 ++ static/img/plots_diff.svg | 2 +- static/img/plots_diff_two_revs.svg | 1 + static/img/plots_show.svg | 2 +- static/img/plots_show_confusion.svg | 2 +- .../img/plots_show_confusion_normalized.svg | 1 + static/img/plots_show_field.svg | 2 +- static/img/plots_show_no_smooth.svg | 2 +- static/img/plots_show_smooth.svg | 2 +- .../img/plots_show_spec_conf_train_test.svg | 1 + static/img/plots_show_spec_default.svg | 1 + .../img/plots_show_spec_multiple_columns.svg | 1 + static/img/plots_show_spec_simple_custom.svg | 1 + 17 files changed, 417 insertions(+), 91 deletions(-) create mode 100644 static/img/plots_diff_two_revs.svg create mode 100644 static/img/plots_show_confusion_normalized.svg create mode 100644 static/img/plots_show_spec_conf_train_test.svg create mode 100644 static/img/plots_show_spec_default.svg create mode 100644 static/img/plots_show_spec_multiple_columns.svg create mode 100644 static/img/plots_show_spec_simple_custom.svg diff --git a/content/docs/command-reference/plots/diff.md b/content/docs/command-reference/plots/diff.md index eb91dc2f92..16e91c26c1 100644 --- a/content/docs/command-reference/plots/diff.md +++ b/content/docs/command-reference/plots/diff.md @@ -1,7 +1,7 @@ # plots diff -Show multiple versions of [plot metrics](/doc/command-reference/plots) by -overlaying them in a single image. This allows to compare them easily. +Show multiple versions of [plots](/doc/command-reference/plots) by overlaying +them in a single image. This allows to compare them easily. ## Synopsis @@ -122,11 +122,11 @@ file:///Users/usr/src/dvc_plots/index.html Compare two specific versions (commit hashes, tags, or branches): ```cli -$ dvc plots diff HEAD 0135527 --targets logs.csv +$ dvc plots diff HEAD^ 0135527 --targets logs.csv file:///Users/usr/src/dvc_plots/index.html ``` -![](/img/plots_diff.svg) +![](/img/plots_diff_two_revs.svg) ## Example: Confusion matrix diff --git a/content/docs/command-reference/plots/index.md b/content/docs/command-reference/plots/index.md index 545f52db5e..620ea29b18 100644 --- a/content/docs/command-reference/plots/index.md +++ b/content/docs/command-reference/plots/index.md @@ -1,7 +1,7 @@ # plots -A set of commands to visualize and compare _plot metrics_: -[show](/doc/command-reference/plots/show), +A set of commands to visualize and compare data series or images from ML +projects: [show](/doc/command-reference/plots/show), [diff](/doc/command-reference/plots/diff), [modify](/doc/command-reference/plots/modify) and [templates](/doc/command-reference/plots/templates). @@ -13,31 +13,22 @@ usage: dvc plots [-h] [-q | -v] {show,diff,modify,templates} ... positional arguments: COMMAND - show Generate plot from a metrics file. - diff Plot differences in metrics between commits. - modify Modify display properties of data-series plots (has no effect on image-type plots). - templates Write built-in plots templates to a directory (.dvc/plots by default). + show Generate plots from target files or from `plots` + definitions in `dvc.yaml`. + diff Show multiple versions of a plot by overlaying them + in a single image. + modify Modify display properties of data-series plots + defined in stages (has no effect on image plots). + templates Write built-in plots templates to a directory (.dvc/plots by default). ``` -## Types of metrics - -DVC has two concepts for metrics, that represent different results of machine -learning training or data processing: - -1. `dvc metrics` represent **scalar numbers** such as AUC, _true positive rate_, - etc. -2. `dvc plots` can be used to visualize **data series** such as AUC curves, loss - functions, confusion matrices, etc. - ## Description -DVC provides a set of commands to visualize certain metrics of machine learning -experiments as plots. Usual plot examples are AUC curves, loss functions, -confusion matrices, among others. - -This type of metrics files are created by users, or generated by user data -processing code, and can be defined in `dvc.yaml` (`plots` field) for tracking -(optional). +DVC provides a set of commands to visualize data produced by machine learning +projects. Usual plots include AUC curves, loss functions, or confusion matrices, +for example. Plots are a great alternative to `dvc metrics` when working with +multi-dimensional performance data. They also help you present and compare +[experiments](/doc/command-reference/exp) effectively. DVC can work with two types of plots files: @@ -48,12 +39,21 @@ DVC generates plots as static HTML webpages that can be open with a web browser. They can also be saved as SVG or PNG image files from the browser. Data-series plots utilize [Vega-Lite](https://vega.github.io/vega-lite/) for -rendering (declarative JSON grammar for defining graphics). Image-type plots are -rendered using `` tags directly. +rendering (declarative JSON grammar for defining graphics). Images are rendered +using `` tags directly. -## Supported file formats + -Image-type plots are included in HTML as-is, without additional processing. +**New!** DVC Plots are available [inside the VS Code IDE], a quick and intuitive +UI for DVC Experiments. + +[inside the vs code ide]: /doc/vs-code-extension + + + +### Supported file formats + +Images are included in HTML as-is, without additional processing. > We recommend to track these source image files with DVC instead of Git, to > prevent the repository from bloating. @@ -98,7 +98,144 @@ names in the `train` array below: } ``` -## Plot templates (data series only) +## Configuring a plot + +In order to create visualizations, users need to provide the data and +(optionally) configuration that will help customize the plot. DVC provides two +ways to configure visualizations. Users can mark specific stage +outputs as plot or define plot configuration inside `dvc.yaml` +under `plots` key. + +### Top-level plot definitions + +Plots can be defined in `dvc.yaml` under the `plots` key. Unlike +[stage plots](#stage-plots), these are especially useful when users want to +compare data from different data sources residing on the same version of the +project. For example, comparing training versus test results on current branch. + +### Stage plots + +When using `dvc stage add`, instead of using `--outs/--outs-no-cache` particular +outputs can be marked with `--plots/--plots-no-cache`. This will tell DVC that +they are intended for visualizations. + +Upon running `dvc plots show/diff` DVC will collect stage plots alongside the +top-level plot definitions and display them conforming to their configuration. +Note, that if there are stage plots in the project and they are also used in +some top-level definitions, DVC will create separate rendering for the stage +plots and all definitions using them. + +This special type of outputs might come in hand if users want to visually +compare experiments results with other experiments versions and not bother with +writing top-level plots definitions into the `dvc.yaml`. + +### Syntax (top-level plot definitions only) + +In order to define the plot users need to provide data and an optional +configuration for the plot. The plots should be defined in `dvc.yaml` file under +`plots` key. + +```yaml +# dvc.yaml +stages: ... + +plots: ... +``` + +Every plots has to have its own id. Configuration, if provided, should be a +dictionary. + +In simplest use case, user can provide file path as the plot id and don't +provide configuration at all: + +```yaml +# dvc.yaml +--- +plots: + logs.csv: +``` + +In that case the default behavior will be applied. DVC will take data from +`logs.csv` file and apply `linear` plot +[template](/doc/command-reference/plots#plot-templates) to the last found column +(CSV, TSV files) or field (JSON, YAML). + +We can customize the plot by adding appropriate fields to the configuration: + +```yaml +# dvc.yaml +--- +plots: + confusion_matrix: + y: + confusion_matrix_data.csv: predicted_class + x: actual_class + template: confusion +``` + +In this case we provided `confusion_matrix` as a plot id. It will be displayed +in the plot as a title, unless we override it with `title` field. In this case +we provided data source in `y` axis definition. Data will be sourced from +`confusion_matrix_data.csv`. As `y` axis we will use `predicted_class` field. On +`x` axis we will have `actual_class` field. Note that DVC will assume that +`actual_class` is inside `confusion_matrix_data.csv`. + +We can provide multiple columns/fields from the same file: + +```yaml +#dvc.yaml +--- +plots: + multiple_series: + y: + logs.csv: [accuracy, loss] + x: epoch +``` + +In this case, we will take `accuracy` and `loss` fields and display them agains +`epoch` column, all coming from `logs.csv` file. + +We can source the data from multiple files too: + +```yaml +#dvc.yaml +--- +plots: + multiple_files: + y: + train_logs.csv: accuracy + test_logs.csv: accuracy + x: epoch +``` + +In this case we will plot `accuracy` field from both `train_logs.csv` and +`test_logs.csv` against the `epoch`. Note that both files have to have `epoch` +field. + +### Available configuration fields + +- `x` - field name from which the X axis data comes from. An auto-generated + _step_ field is used by default. It has to be a string. + +- `y` - field name from which the Y axis data comes from. + - Top-level plots: It can be a string, list or dictionary. If its a string or + list, it is assumed that plot id will be the path to the data source. + String, or list elements will be the names of data columns or fields withing + the source file. If this field is a dictionary, it is assumed that its keys + are paths to data sources. The values have to be either strings or lists, + and are treated as column(s)/field(s) within respective files. + - Plot outputs: It is a field name from which the Y axis data comes from. +- `x_label` - X axis label. The X field name is the default. +- `y_label` - Y axis label. If all provided Y entries have the same field name, + this name will be the default, `y` string otherwise. +- `title` - Plot title. Defaults: + - Top-level plots: `path/to/dvc.yaml::plot_id` + - Plot outputs: Path to the file. + +Refer to the [examples](/doc/command-reference/plots#top-level-plots) for more +syntax insight. + +## Plot templates (data-series only) DVC uses [Vega-Lite](https://vega.github.io/vega-lite/) JSON specifications to create plots from user data. A set of built-in _plot templates_ are included. @@ -180,7 +317,7 @@ important fields that DVC adds to the plot data: Refer to [`templates`](/doc/command-reference/plots/templates) command for more information on how to prepare your own template from pre-defined ones. -## HTML templates +## Custom HTML templates It's possible to supply an HTML file to `dvc plot show` and `dvc plot diff` by using the the `--html-template` option. This allows you to customize the @@ -202,20 +339,20 @@ this feature to render DVC plots without an Internet connection, below. - `-v`, `--verbose` - displays detailed tracing information. -## Example: Tabular data +## Examples -We'll use tabular metrics file `logs.csv` for this example: +### Raw data files + +#### Tabular data + +We'll use tabular data file `logs.csv` for this example: ``` -epoch,accuracy,loss,val_accuracy,val_loss -0,0.9418667,0.19958884770199656,0.9679,0.10217399864746257 -1,0.9763333,0.07896138601688048,0.9768,0.07310650711813942 -2,0.98375,0.05241111190887168,0.9788,0.06665669009438716 -3,0.98801666,0.03681169906261687,0.9781,0.06697812260198989 -4,0.99111664,0.027362171787042946,0.978,0.07385754839298315 -5,0.9932333,0.02069501801203781,0.9771,0.08009233058886166 -6,0.9945,0.017702101902437668,0.9803,0.07830339228538505 -7,0.9954,0.01396906608727198,0.9802,0.07247738889862157 +epoch,loss,accuracy +1,0.19,0.81 +2,0.11,0.89 +3,0.07,0.93 +4,0.04,0.96 ``` Let's plot the last column (default behavior): @@ -237,19 +374,19 @@ file:///Users/usr/src/dvc_plots/index.html ![](/img/plots_diff.svg) -Visualize a specific field: +Visualize a specific field (`loss`) as y. Use `epoch` as x: ```dvc -$ dvc plots show -y loss logs.csv +$ dvc plots show logs.csv -y loss -x epoch file:///Users/usr/src/dvc_plots/index.html ``` ![](/img/plots_show_field.svg) -## Example: Smooth plot +#### Smooth plot In some cases we would like to smooth our plot. In this example we will use a -plot with 1000 data points: +noisy plot with 100 data points: ```dvc $ dvc plots show data.csv @@ -267,7 +404,7 @@ file:///Users/usr/src/dvc_plots/index.html ![](/img/plots_show_smooth.svg) -## Example: Confusion matrix +#### Confusion matrix We'll use `classes.csv` for this example: @@ -295,9 +432,171 @@ file:///Users/usr/src/dvc_plots/index.html ![](/img/plots_show_confusion.svg) > A confusion matrix [template](/doc/command-reference/plots#plot-templates) is -> predefined in DVC (found in `.dvc/plots/confusion.json`). +> predefined in DVC. + +We can use `confusion_normalized` template to normalize the results: + +```dvc +$ dvc plots show classes.csv --template confusion_normalized -x actual -y predicted +file:///Users/usr/src/dvc_plots/index.html +``` + +![](/img/plots_show_confusion_normalized.svg) + +### Top-level plots + +#### Simple plot definition + +Let's get back to the `logs.csv` data: + +``` +# logs.csv +epoch,loss,accuracy +1,0.19,0.81 +2,0.11,0.89 +3,0.07,0.93 +4,0.04,0.96 +``` + +Minimal plot configuration we can put in `dvc.yaml` is simply data source path +relative to `dvc.yaml` file: + +```yaml +# dvc.yaml +stages: + train: + cmd: echo "Training the model..." + +plots: + logs.csv: +``` + +```dvc +$ dvc plots show +file:///Users/usr/src/dvc_plots/index.html +``` + +![](/img/plots_show_spec_default.svg) + +We can customize it: + +```yaml +# dvc.yaml +stages: + train: + cmd: echo "Training the model..." + +plots: + logs.csv: + x: epoch + y: accuracy + title: Displaying accuracy + x_label: This is epoch + y_label: This is accuracy +``` + +```dvc +$ dvc plots show +file:///Users/usr/src/dvc_plots/index.html +``` + +![](/img/plots_show_spec_simple_custom.svg) + +#### Multiple data series plot + +Data in `training_data.csv`: + +```csv +epoch,train_loss,test_loss +1,0.33,0.4 +2,0.3,0.28 +3,0.2,0.25 +4,0.1,0.23 +``` + +```yaml +# dvc.yaml +stages: + train: + cmd: echo "Training the model..." + +plots: + test_vs_train_loss: + x: epoch + y: + training_data.csv: [test_loss, train_loss] + title: Compare loss training versus test +``` + +```dvc +$ dvc plots show +file:///Users/usr/src/dvc_plots/index.html +``` + +![](/img/plots_show_spec_multiple_columns.svg) + +#### Sourcing data from different files + +Lets prepare comparison for confusion matrix data between test set and training +set: + +```csv +# train_classes.csv +actual_class,predicted_class +dog,dog +dog,dog +dog,dog +dog,bird +cat,cat +cat,cat +cat,cat +cat,dog +bird,bird +bird,bird +bird,bird +bird,dog +``` + +```csv +# test_classes.csv +actual_class,predicted_class +dog,dog +dog,dog +dog,cat +bird,bird +bird,bird +bird,cat +cat,cat +cat,cat +cat,bird +``` + +```yaml +# dvc.yaml +stages: + train: + cmd: echo "Training the model..." + +plots: + test_vs_train_confusion: + x: actual_class + y: + train_classes.csv: predicted_class + test_classes.csv: predicted_class + title: Compare test vs train confusion matrix + template: confusion + x_label: Actual class + y_label: Predicted class +``` + +```dvc +$ dvc plots show +file:///Users/usr/src/dvc_plots/index.html +``` + +![](/img/plots_show_spec_conf_train_test.svg) -## Example: Offline HTML Template +### Offline HTML Template The plots generated by `dvc plots` uses Vega-Lite JavaScript libraries, and by default these load [online resources](https://vega.github.io/vega/usage/#embed). diff --git a/content/docs/command-reference/plots/modify.md b/content/docs/command-reference/plots/modify.md index bbfe226431..4b87215cc0 100644 --- a/content/docs/command-reference/plots/modify.md +++ b/content/docs/command-reference/plots/modify.md @@ -1,10 +1,10 @@ # plots modify -Modify display properties of [plot metrics](/doc/command-reference/plots) files. +Modify display properties of data-series [plots](/doc/command-reference/plots) +defined in stages. > ⚠️ Note that this command can modify only data-series plots. It has no effect -> on image-type plots. See -> [Types of metrics](/doc/command-reference/plots#types-of-metrics). +> on image-type plots and top-level plot definitions. ## Synopsis @@ -16,7 +16,8 @@ usage: dvc plots modify [-h] [-q | -v] [-t ] [-x ] target positional arguments: - target Metrics file to set properties to + target Plot file to set properties for + (defined at the stage level) ``` ## Description @@ -24,9 +25,9 @@ positional arguments: It might be not convenient for users or automation systems to specify all the _display properties_ (such as `y-label`, `template`, `title`, etc.) each time plots are generated with `dvc plot show` or `dvc plot diff`. This command sets -(or unsets) default display properties for a specific metrics file. +(or unsets) default display properties for a specific plots file. -The path to the metrics file `target` is required. It must be listed in a +The path to the plots file `target` is required. It must be listed in a `dvc.yaml` file (see the `--plots` option of `dvc stage add`). `dvc plots modify` adds the display properties to `dvc.yaml`. diff --git a/content/docs/command-reference/plots/show.md b/content/docs/command-reference/plots/show.md index 16f0b6445a..30424be28e 100644 --- a/content/docs/command-reference/plots/show.md +++ b/content/docs/command-reference/plots/show.md @@ -1,6 +1,6 @@ # plots show -Generate [plot](/doc/command-reference/plots) from a metrics file. +Generate [plot](/doc/command-reference/plots) from a plots file. ## Synopsis @@ -12,15 +12,15 @@ usage: dvc plots show [-h] [-q | -v] [-t ] [-x ] [targets [targets ...]] positional arguments: - targets Metrics files to visualize. + targets Plot files or plot id's from `dvc.yaml` to visualize. Shows all plots by default. ``` ## Description This command provides a quick way to visualize -[certain metrics](/doc/command-reference/plots#supported-file-formats) such as -loss functions, AUC curves, confusion matrices, etc. +[certain data](/doc/command-reference/plots#supported-file-formats) such as loss +functions, AUC curves, confusion matrices, etc. All plots defined in `dvc.yaml` are used by default, but specific plots files can be specified as `targets` (note that targets don't necessarily have to be @@ -28,11 +28,11 @@ defined in `dvc.yaml`). The plot style can be customized with [plot templates](/doc/command-reference/plots#plot-templates), using the -`--template` option. To learn more about metrics file formats and templates -please see `dvc plots`. +`--template` option. To learn more about plots file formats and templates please +see `dvc plots`. -> Note that the default behavior of this command can be modified per metrics -> file with `dvc plots modify`. +> Note that the default behavior of this command can be modified per plots file +> with `dvc plots modify`. ## Options @@ -48,11 +48,11 @@ please see `dvc plots`. auto-generated `index` field is used by default. See [Custom templates](/doc/command-reference/plots#custom-templates) for more information on this `index` field. Column names or numbers are expected for - tabular metrics files. + tabular plots files. - `-y ` - field name from which the Y axis data comes from. The last field found in the `targets` is used by default. Column names or numbers are - expected for tabular metrics files. + expected for tabular plots files. - `--x-label ` - X axis label. The X field name is the default. @@ -143,15 +143,11 @@ file:///Users/usr/src/dvc_plots/index.html We'll use tabular metrics file `logs.csv` for these examples: ``` -epoch,accuracy,loss,val_accuracy,val_loss -0,0.9418667,0.19958884770199656,0.9679,0.10217399864746257 -1,0.9763333,0.07896138601688048,0.9768,0.07310650711813942 -2,0.98375,0.05241111190887168,0.9788,0.06665669009438716 -3,0.98801666,0.03681169906261687,0.9781,0.06697812260198989 -4,0.99111664,0.027362171787042946,0.978,0.07385754839298315 -5,0.9932333,0.02069501801203781,0.9771,0.08009233058886166 -6,0.9945,0.017702101902437668,0.9803,0.07830339228538505 -7,0.9954,0.01396906608727198,0.9802,0.07247738889862157 +epoch,loss,accuracy +1,0.19,0.81 +2,0.11,0.89 +3,0.07,0.93 +4,0.04,0.96 ```
@@ -161,15 +157,11 @@ epoch,accuracy,loss,val_accuracy,val_loss Here's a corresponding `train.tsv` metrics file: ``` -epoch accuracy loss val_accuracy val_loss -0 0.9418667 0.19958884770199656 0.9679 0.10217399864746257 -1 0.9763333 0.07896138601688048 0.9768 0.07310650711813942 -2 0.98375 0.05241111190887168 0.9788 0.06665669009438716 -3 0.988016 0.03681169906261687 0.9781 0.06697812260198989 -4 0.991116 0.027362171787042946 0.978 0.07385754839298315 -5 0.9932333 0.02069501801203781 0.9771 0.08009233058886166 -6 0.9945 0.017702101902437668 0.9803 0.07830339228538505 -7 0.9954 0.01396906608727198 0.9802 0.07247738889862157 +epoch loss accuracy +1 0.19 0.81 +2 0.11 0.89 +3 0.07 0.93 +4 0.04 0.96 ```
diff --git a/content/docs/user-guide/project-structure/dvcyaml-files.md b/content/docs/user-guide/project-structure/dvcyaml-files.md index f747374819..38368de6a0 100644 --- a/content/docs/user-guide/project-structure/dvcyaml-files.md +++ b/content/docs/user-guide/project-structure/dvcyaml-files.md @@ -460,6 +460,34 @@ validation and auto-completion. ⚠️ Note that using the `checkpoint` field in `dvc.yaml` is not compatible with `dvc repro`. +## Top-level plot definitions + +The list of plots contains one or more user-defined +[plots](/doc/command-reference/plots#standalone-plots). Here's an example that +tells DVC that `auc.json` is viable for visualization: + +```yaml +stages: + build: + cmd: python train.py + deps: + - features.csv + outs: + - model.pt + - auc.json + metrics: + - accuracy.txt: + cache: false +plots: + auc.json: + x: fpr + y: tpr +``` + +Note that we didn't have to specify `auc.json` as a plot in the stage. In fact, +top-level `plots` can use any file in the project. [top-level +`plots`]: /doc/command-reference/plots#top-level-plot-definitions + ## dvc.lock file > ⚠️ Avoid editing these files. DVC will create and update them for you. diff --git a/static/img/plots_diff.svg b/static/img/plots_diff.svg index 229ff28129..9e0b88e002 100644 --- a/static/img/plots_diff.svg +++ b/static/img/plots_diff.svg @@ -1 +1 @@ -01234567index0.000.020.040.060.080.10val_loss0135527HEADrev \ No newline at end of file +0.00.51.01.52.02.53.0step0.760.780.800.820.840.860.880.900.920.940.96accuracyHEAD^workspacerevlogs.csv \ No newline at end of file diff --git a/static/img/plots_diff_two_revs.svg b/static/img/plots_diff_two_revs.svg new file mode 100644 index 0000000000..2d8ff1f58c --- /dev/null +++ b/static/img/plots_diff_two_revs.svg @@ -0,0 +1 @@ +0.00.51.01.52.02.53.0step0.740.760.780.800.820.840.860.880.900.920.940.96accuracy0135527HEAD^revlogs.csv \ No newline at end of file diff --git a/static/img/plots_show.svg b/static/img/plots_show.svg index 2e49efef9c..533b9486a5 100644 --- a/static/img/plots_show.svg +++ b/static/img/plots_show.svg @@ -1 +1 @@ -01234567index0.070.080.090.10val_lossworkspacerev \ No newline at end of file +0.00.51.01.52.02.53.0step0.800.820.840.860.880.900.920.940.96accuracyworkspacerevlogs.csv \ No newline at end of file diff --git a/static/img/plots_show_confusion.svg b/static/img/plots_show_confusion.svg index 7e843281cf..d72f5762ea 100644 --- a/static/img/plots_show_confusion.svg +++ b/static/img/plots_show_confusion.svg @@ -1 +1 @@ -revbirdcatdinosaurdogturtleactualbirdcatdinosaurdogturtlepredicted362236121362113621136211000000workspace010203040 \ No newline at end of file +revbirdcatdinosaurdogturtlepredictedbirdcatdinosaurdogturtleactual264532265342262723265135265720workspace0510152025classes.csv \ No newline at end of file diff --git a/static/img/plots_show_confusion_normalized.svg b/static/img/plots_show_confusion_normalized.svg new file mode 100644 index 0000000000..199a93e852 --- /dev/null +++ b/static/img/plots_show_confusion_normalized.svg @@ -0,0 +1 @@ +revbirdcatdinosaurdogturtlepredictedbirdcatdinosaurdogturtleactual0.670.090.120.090.050.670.110.090.100.050.790.050.150.050.080.620.110.030.080.130.550.130.170.050.00workspace0.00.20.40.60.81.0classes.csv \ No newline at end of file diff --git a/static/img/plots_show_field.svg b/static/img/plots_show_field.svg index ddaabf710b..79f17e9f2d 100644 --- a/static/img/plots_show_field.svg +++ b/static/img/plots_show_field.svg @@ -1 +1 @@ -01234567index0.000.050.100.150.20lossworkspacerev \ No newline at end of file +1.01.52.02.53.03.54.0epoch0.040.060.080.100.120.140.160.180.20lossworkspacerevlogs.csv \ No newline at end of file diff --git a/static/img/plots_show_no_smooth.svg b/static/img/plots_show_no_smooth.svg index bae27f1407..c23eb82a5d 100644 --- a/static/img/plots_show_no_smooth.svg +++ b/static/img/plots_show_no_smooth.svg @@ -1 +1 @@ -02004006008001,000index0.00.51.01.5yworkspacerev \ No newline at end of file +0102030405060708090100step−0.050.000.050.100.150.200.250.300.35lossworkspacerevdata.csv \ No newline at end of file diff --git a/static/img/plots_show_smooth.svg b/static/img/plots_show_smooth.svg index 934fc97de0..4240286f66 100644 --- a/static/img/plots_show_smooth.svg +++ b/static/img/plots_show_smooth.svg @@ -1 +1 @@ -02004006008001,000index0.20.40.60.81.01.2yworkspacerev \ No newline at end of file +0102030405060708090100step0.000.050.100.150.200.25lossworkspacerevdata.csv \ No newline at end of file diff --git a/static/img/plots_show_spec_conf_train_test.svg b/static/img/plots_show_spec_conf_train_test.svg new file mode 100644 index 0000000000..9f2bf7e3a1 --- /dev/null +++ b/static/img/plots_show_spec_conf_train_test.svg @@ -0,0 +1 @@ +revbirdcatdogPredicted classbirdcatdogActual classbirdcatdogActual class212121000test_classes.csv313131000train_classes.csv0123Compare test vs train confusion matrix \ No newline at end of file diff --git a/static/img/plots_show_spec_default.svg b/static/img/plots_show_spec_default.svg new file mode 100644 index 0000000000..5b78e1b365 --- /dev/null +++ b/static/img/plots_show_spec_default.svg @@ -0,0 +1 @@ +0.00.51.01.52.02.53.0step0.800.820.840.860.880.900.920.940.96accuracyworkspacerevdvc.yaml::logs.csv \ No newline at end of file diff --git a/static/img/plots_show_spec_multiple_columns.svg b/static/img/plots_show_spec_multiple_columns.svg new file mode 100644 index 0000000000..24c338ad5d --- /dev/null +++ b/static/img/plots_show_spec_multiple_columns.svg @@ -0,0 +1 @@ +1.01.52.02.53.03.54.0epoch0.100.150.200.250.300.350.40ytest_losstrain_lossrevCompare loss training versus test \ No newline at end of file diff --git a/static/img/plots_show_spec_simple_custom.svg b/static/img/plots_show_spec_simple_custom.svg new file mode 100644 index 0000000000..ed69a15a71 --- /dev/null +++ b/static/img/plots_show_spec_simple_custom.svg @@ -0,0 +1 @@ +1.01.52.02.53.03.54.0This is epoch0.800.820.840.860.880.900.920.940.96This is accuracyworkspacerevDisplaying accuracy \ No newline at end of file