refresh main with changes after 0.2.0 - 0.2.1 (#804)

* bump up the version

* copying over the items from platform-demo

* minor edits to the self-hosting-demo

* Update README.md

* Update README.md

* update demo notebook tagging

* Add tutorials to docs

* first attempt at the github action. flood gates will open after MJL finishes his copy

* also copy our favourite tutorial for the same treatment as other demos.

* Add artifact store file for main PR (#798)

* Update and reorganize RTD docs (#795)

* Move intro text to pipeline's TOC section

* Reorganize RTD pages related to artifact storage

* Add a new section on using existing artifacts

* Update index.rst

minor change

* Update index.rst

minor tweaks

* Update s3.rst

minor tweak

* Update s3.rst

@yoonspark let me know if this modification makes sense

* Fix typos; remove duplacate doc

* For Postgres and S3, make clearer distinction between storing artifact values vs. metadata

* Add phrasing suggested by MMA

Co-authored-by: Moustafa AbdelBaky <9140797+moustafa-a@users.noreply.github.com>

* Add mkdir step before cp (#799)

* Lin 621 migrate everything from demos repo to lineapy examples (#794)

* Copy demos repo stories
* Exclude self-hosting-lineapy notebooks from CI
* Use zip artifact store file
* Skip cell due to bugs in pandas
Only happen in python 3.10, so not going to force updating pandas version in requirements.
Related pandas-dev/pandas#41935

Co-authored-by: Humble bot servant <infra@linea.ai>

* Add tutorials to docs

* Lin 621 cleanup nbval prefix (#800)

* Fix mkdir demos error and remove NBVAL_prefix in demos notebooks
* Exclude notebooks in demos from CI

* Modify a comment to trigger demo copy (#803)

* Modify a comment
* Add tutorials to docs

Co-authored-by: Humble bot servant <infra@linea.ai>

* get rid of is_demo. es confuso

* add lineapy install at the top.

* Add tutorials to docs

* load lineapy as an extension.

* Add tutorials to docs

* refresh all the tags and rebuild demos.

* Add tutorials to docs

* two actions were competing with each other. arranging for both demos and docs folder to sync together and commit only once (might need to merge into main for this to work)

* add explicit image for colab

* Refresh demos folder and update docs

Co-authored-by: Moustafa <9140797+moustafa-a@users.noreply.github.com>
Co-authored-by: dorx <doris.s.xin@gmail.com>
Co-authored-by: Humble bot servant <infra@linea.ai>
Co-authored-by: Mingjer Lee <mingjerli@gmail.com>
Co-authored-by: Sangyoon Park <datumvitae@gmail.com>

.github/workflows/sync_notebooks.yml

@@ -0,0 +1,42 @@
+name: Sync Demos and docs
+
+on:
+  push:
+    branches-ignore: [main]
+    paths:
+      - "examples/use_cases/**/*.ipynb"
+      - "examples/tutorials/00_api_basics.ipynb"
+
+jobs:
+  sync-notebooks:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v2
+        with:
+          fetch-depth: 0 # otherwise, there would be errors pushing refs to the destination repository.
+
+      - name: "Copy demo notebooks to top level demos folder"
+        run: mkdir -p demos/ && cp -R examples/use_cases/* demos/ && cp examples/tutorials/00_api_basics.ipynb demos/
+
+      - name: "copy example notebooks to docs"
+        run: cp examples/tutorials/00_api_basics.ipynb docs/source/tutorials/
+
+      - name: "Regex out the NBVAL_SKIP and NBVAL_IGNORE_OUTPUT comments"
+        run: |
+          cd demos/ 
+          find ./ -type f -name "*.ipynb" -exec sed -i 's/\#[\ ]*NBVAL_SKIP//g' {} \;
+          find ./ -type f -name "*.ipynb" -exec sed -i 's/\#[\ ]*NBVAL_IGNORE_OUTPUT//g' {} \;
+
+      - name: Commit files
+        run: |
+          git config --local user.email "infra@linea.ai"
+          git config --local user.name "Humble bot servant"
+          git add .
+          (git diff --quiet && git diff --staged --quiet) || git commit -m "Refresh demos folder and update docs"
+      - name: push synced changes
+        uses: ad-m/github-push-action@master
+        with:
+          github_token: ${{ secrets.GITHUB_TOKEN }}
+          branch: ${{ github.ref }}
+
+

.gitignore

@@ -154,6 +154,7 @@ tests/integration/venvs/
 *.sqlite
 *.db
 *.png
+!lineapy_artifact.png
 
 tmp_*
 *.temp