Pytest discovery is not corretly displyed in the UI

[lbenka]

Type: Bug

Behaviour

When using pytest-mypy extension UI is not correctly showing all tests that were discovered.

Steps to reproduce:

1. in pyproject.toml setup
   [tool.pytest.ini_options]
   minversion = "6.0"
   addopts = """--mypy"""
2. execute test discovery via UI

Diagnostic data

Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

XXX

Extension version: 2024.6.0
VS Code version: Code 1.89.0 (b58957e67ee1e712cebf466b995adf4c5307b2bd, 2024-05-01T02:10:13.496Z)
OS version: Darwin arm64 23.4.0
Modes:

• Python version (& distribution if applicable, e.g. Anaconda): 3.11.9
• Type of virtual environment used (e.g. conda, venv, virtualenv, etc.): Poetry
• Value of the python.languageServer setting: Pylance

User Settings

languageServer: "Pylance"

testing
• pytestArgs: "<placeholder>"
• pytestEnabled: true

Installed Extensions

Extension Name	Extension Id	Version
Ansible	redhat.ansible	24.5.2
AsciiDoc	asciidoctor.asciidoctor-vscode	3.2.3
autoDocstring - Python Docstring Generator	njpwerner.autodocstring	0.6.1
Azure Account	ms-vscode.azure-account	0.11.7
Azure App Service	ms-azuretools.vscode-azureappservice	0.25.2
Azure Container Apps	ms-azuretools.vscode-azurecontainerapps	0.7.0
Azure Databases	ms-azuretools.vscode-cosmosdb	0.22.0
Azure Developer CLI	ms-azuretools.azure-dev	0.8.2
Azure Functions	ms-azuretools.vscode-azurefunctions	1.14.3
Azure Kubernetes Service	ms-kubernetes-tools.vscode-aks-tools	1.4.4
Azure Resources	ms-azuretools.vscode-azureresourcegroups	0.8.6
Azure Static Web Apps	ms-azuretools.vscode-azurestaticwebapps	0.12.2
Azure Storage	ms-azuretools.vscode-azurestorage	0.15.3
Azure Tools	ms-vscode.vscode-node-azure-pack	1.2.0
Azure Virtual Machines	ms-azuretools.vscode-azurevirtualmachines	0.6.5
Azurite	Azurite.azurite	3.30.0
Bash Debug	rogalmic.bash-debug	0.3.9
Better Comments	aaron-bond.better-comments	3.0.2
Better Jinja	samuelcolvin.jinjahtml	0.20.0
Black Formatter	ms-python.black-formatter	2024.2.0
Code Spell Checker	streetsidesoftware.code-spell-checker	3.0.1
Dev Containers	ms-vscode-remote.remote-containers	0.362.0
Docker	ms-azuretools.vscode-docker	1.29.1
Even Better TOML	tamasfe.even-better-toml	0.19.2
Git Graph	mhutchie.git-graph	1.30.0
GitHub Codespaces	GitHub.codespaces	1.16.22
GitLab Workflow	GitLab.gitlab-workflow	4.10.0
GitLens — Git supercharged	eamodio.gitlens	14.9.1
Go	golang.go	0.41.4
Gradle for Java	vscjava.vscode-gradle	3.13.5
HashiCorp Terraform	hashicorp.terraform	2.30.1
Helm Intellisense	Tim-Koehler.helm-intellisense	0.14.3
HOCON	sabieber.HOCON	0.0.1
IntelliJ IDEA Keybindings	k--kato.intellij-idea-keybindings	1.7.2
isort	ms-python.isort	2023.10.1
JavaScript Debugger	ms-vscode.js-debug	1.89.0
JavaScript Debugger Companion Extension	ms-vscode.js-debug-companion	1.1.2
Jinja	wholroyd.jinja	0.0.8
Jupyter	ms-toolsai.jupyter	2024.4.0
Jupyter Cell Tags	ms-toolsai.vscode-jupyter-cell-tags	0.1.9
Jupyter Keymap	ms-toolsai.jupyter-keymap	1.1.2
Jupyter Notebook Renderers	ms-toolsai.jupyter-renderers	1.0.17
Jupyter Slide Show	ms-toolsai.vscode-jupyter-slideshow	0.1.6
Kotlin	fwcd.kotlin	0.2.34
Kotlin Language	mathiasfrohlich.Kotlin	1.7.1
Kubernetes	ms-kubernetes-tools.vscode-kubernetes-tools	1.3.16
Live Share	ms-vsliveshare.vsliveshare	1.0.5918
Markdown All in One	yzhang.markdown-all-in-one	3.6.2
Markdown Preview Mermaid Support	bierner.markdown-mermaid	1.23.0
markdownlint	DavidAnson.vscode-markdownlint	0.55.0
Mermaid Markdown Syntax Highlighting	bpruitt-goddard.mermaid-markdown-syntax-highlighting	1.6.3
Mermaid Preview	vstirbu.vscode-mermaid-preview	1.6.3
NGINX Configuration	william-voyek.vscode-nginx	0.7.2
NGINX Configuration Language Support	ahmadalli.vscode-nginx-conf	0.3.5
PlantUML	jebbs.plantuml	2.18.1
Presentation Mode	jspolancor.presentationmode	1.1.5
Pylance	ms-python.vscode-pylance	2024.5.1
Python	ms-python.python	2024.6.0
Python Debugger	ms-python.debugpy	2024.6.0
Rainbow CSV	mechatroner.rainbow-csv	3.11.0
Remote - SSH	ms-vscode-remote.remote-ssh	0.110.1
Remote - SSH: Editing Configuration Files	ms-vscode-remote.remote-ssh-edit	0.86.0
Remote - Tunnels	ms-vscode.remote-server	1.5.1
Remote Explorer	ms-vscode.remote-explorer	0.4.3
shell-format	foxundermoon.shell-format	7.2.5
SQLTools	mtxr.sqltools	0.28.3
SQLTools PostgreSQL/Cockroach Driver	mtxr.sqltools-driver-pg	0.5.4
Swagger Viewer	Arjun.swagger-viewer	3.1.2
Table Visualizer for JavaScript Profiles	ms-vscode.vscode-js-profile-table	1.0.9
Terraform	4ops.terraform	0.2.5
vscode-icons	vscode-icons-team.vscode-icons	12.7.0
XML Tools	DotJoshJohnson.xml	2.5.1
YAML	redhat.vscode-yaml	1.14.0

System Info

Item	Value
CPUs	Apple M2 Max (12 x 24)
GPU Status	2d_canvas: enabled canvas_oop_rasterization: enabled_on direct_rendering_display_compositor: disabled_off_ok gpu_compositing: enabled multiple_raster_threads: enabled_on opengl: enabled_on rasterization: enabled raw_draw: disabled_off_ok skia_graphite: disabled_off video_decode: enabled video_encode: enabled webgl: enabled webgl2: enabled webgpu: enabled
Load (avg)	3, 3, 3
Memory (System)	32.00GB (0.05GB free)
Process Argv	--crash-reporter-id 8ade26d5-93d0-4a16-b43c-d2967432e626
Screen Reader	no
VM	0%

A/B Experiments

vsliv368:30146709
vspor879:30202332
vspor708:30202333
vspor363:30204092
vswsl492:30256859
vscod805cf:30301675
binariesv615:30325510
vsaa593cf:30376535
py29gd2263:31024239
vscaat:30438848
c4g48928:30535728
azure-dev_surveyone:30548225
vscrpc:30673769
962ge761:30959799
pythongtdpath:30769146
welcomedialogc:30910334
pythonidxpt:30866567
pythonnoceb:30805159
asynctok:30898717
pythontestfixt:30902429
pythonregdiag2:30936856
pyreplss1:30897532
pythonmypyd1:30879173
pythoncet0:30885854
2e7ec940:31000449
pythontbext0:30879054
accentitlementst:30995554
dsvsc016:30899300
dsvsc017:30899301
dsvsc018:30899302
cppperfnew:31000557
ccp2r3:30993541
dsvsc020:30976470
pythonait:31006305
jchc7451:30973076
chatpanelc:31018788
dsvsc021:30996838
945dj816:31013170
pythoncenvpt:31022790
dwnewjupytercf:31035177

[eleanorjboyd]

Hi! Can you clarify what you mean by the pytest-mypy extension? Additionally do you have a minimal repro I can try myself? From what I understand, you are saying that the 12 tests get discovered but none are shown in the UI right? Are these normal pytest tests or do they require a plugin to use? If so please let me know the plugin too as we might not support that test type right now.