New markdown parser

[darrenburns]

Type of changes

• Bug fix
• New feature
• Documentation / docstrings
• Tests
• Other

Checklist

• I've run the latest black with default args on new code.
• I've updated CHANGELOG.md and CONTRIBUTORS.md where appropriate.
• I've added tests for new code.
• I accept that @willmcgugan may be pedantic in the code review.

Description

Work in progress.

Switches over to markdown-it-py instead of commonmark for Markdown parsing.

[willmcgugan]

Nice work. It's quite a small footprint for such a significant change. Love that the public interface doesn't change.

Approving, but let's not merge just yet. Would like to do one last Python3.6 release.

[synrg]

I realize this might be slightly out of scope of this PR, as it does not enable strikethrough extension, but I thought I'd mention it here in case it indicates an issue that is better to address now.

I found that merely enabling the extension was not enough to make ~~strike~~ work. That resulted in an empty string when rendered. What I found in my debugging is that strikethrough markup is being tokenized as tag s, not strike. In order to make it work, I had to both enable the strikethrough extension and modify the tag to process, as per:

diff --git a/rich/markdown.py b/rich/markdown.py
index 36d6491e..3b75c579 100644
--- a/rich/markdown.py
+++ b/rich/markdown.py
@@ -427,7 +427,7 @@ class Markdown(JupyterMixin):
         "image": ImageItem,
     }

-    inlines = {"em", "strong", "code", "strike"}
+    inlines = {"em", "strong", "code", "s"}

     def __init__(
         self,
@@ -439,7 +439,7 @@ class Markdown(JupyterMixin):
         inline_code_lexer: Optional[str] = None,
         inline_code_theme: Optional[str] = None,
     ) -> None:
-        parser = MarkdownIt().enable("table")
+        parser = MarkdownIt().enable(["table", "strikethrough"])
         self.markup = markup
         self.parsed = parser.parse(markup)
         self.code_theme = code_theme

Furthermore, since the default theme has "markdown.strike": Style(strike=True), I had to use a custom theme to set the strikethrough style for the s tag:

from rich.console import Console
from rich.theme import Theme
from rich.style import Style
our_theme = Theme({
    "markdown.s": Style(strike=True),
})
console = Console(theme=our_theme)

[daniloegea]

Hi all,

considering commonmark is not being maintained anymore, are there plans to merge this PR in the near future?

[darrenburns]

@synrg That's great, thanks! I've added that to this PR so that we support strikethrough (cc @willmcgugan).

@daniloegea Just polishing this up now, so should be getting merged relatively soon.

[darrenburns]

We were missing 3.11.

[willmcgugan]

Nice. This will make some folks happy.

[daniloegea]

That's brilliant. Thanks so much! :)

[synrg]

superb! many thanks

[slyon]

Awesome, thank you! Will there be a new release including this change, soon?

Oh, nevermind :) https://github.com/Textualize/rich/releases/tag/v13.2.0

[chrisjsewell]

FYI as the maintainer of markdown-it-py, I approve 😄 was wondering why there was a sudden spike in pypi downloads 😆

Love rich, keep up the good work!