BMW Connected Drive permanentally closes connection #72054

arboeh · 2022-05-18T05:19:51Z

The problem

BMW Connected Drive "drives" me crazy. It permanetally closes connection and gives the following error:

What version of Home Assistant Core has the issue?

core-2022.5.4

What was the last working version of Home Assistant Core?

No response

What type of installation are you running?

Home Assistant Container

Integration causing the issue

BMW Connected Drive

Link to integration documentation on our website

https://www.home-assistant.io/integrations/bmw_connected_drive

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

Protokolldetails (FEHLER)
Dieser Fehler wurde von einer benutzerdefinierten Integration verursacht
Logger: custom_components.bmw_connected_drive.coordinator
Source: custom_components/bmw_connected_drive/coordinator.py:54
Integration: BMW Connected Drive
First occurred: 07:04:03 (1 occurrences)
Last logged: 07:04:03

Unexpected error fetching bmw_connected_drive-xxx.yyy@zzz.de data: The connection pool was closed while 1 HTTP requests/responses were still in-flight.
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/anyio/streams/tls.py", line 108, in _call_sslobject_method
    result = func(*args)
  File "/usr/local/lib/python3.9/ssl.py", line 888, in read
    v = self._sslobj.read(len)
ssl.SSLWantReadError: The operation did not complete (read) (_ssl.c:2633)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/httpcore/backends/asyncio.py", line 31, in read
    return await self._stream.receive(max_bytes=max_bytes)
  File "/usr/local/lib/python3.9/site-packages/anyio/streams/tls.py", line 171, in receive
    data = await self._call_sslobject_method(self._ssl_object.read, max_bytes)
  File "/usr/local/lib/python3.9/site-packages/anyio/streams/tls.py", line 115, in _call_sslobject_method
    data = await self.transport_stream.receive()
  File "/usr/local/lib/python3.9/site-packages/anyio/_backends/_asyncio.py", line 1105, in receive
    await self._protocol.read_event.wait()
  File "/usr/local/lib/python3.9/asyncio/locks.py", line 226, in wait
    await fut
asyncio.exceptions.CancelledError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/httpcore/_exceptions.py", line 8, in map_exceptions
    yield
  File "/usr/local/lib/python3.9/site-packages/httpcore/backends/asyncio.py", line 33, in read
    return b""
  File "/usr/local/lib/python3.9/site-packages/anyio/_core/_tasks.py", line 103, in __exit__
    raise TimeoutError
TimeoutError

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 60, in map_httpcore_exceptions
    yield
  File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 253, in handle_async_request
    raise exc
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 237, in handle_async_request
    response = await connection.handle_async_request(request)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection.py", line 90, in handle_async_request
    return await self._connection.handle_async_request(request)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/http11.py", line 102, in handle_async_request
    raise exc
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/http11.py", line 81, in handle_async_request
    ) = await self._receive_response_headers(**kwargs)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/http11.py", line 143, in _receive_response_headers
    event = await self._receive_event(timeout=timeout)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/http11.py", line 172, in _receive_event
    data = await self._network_stream.read(
  File "/usr/local/lib/python3.9/site-packages/httpcore/backends/asyncio.py", line 33, in read
    return b""
  File "/usr/local/lib/python3.9/contextlib.py", line 137, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_exceptions.py", line 12, in map_exceptions
    raise to_exc(exc)
httpcore.ReadTimeout

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/bimmer_connected/account.py", line 78, in get_vehicles
    vehicles_responses: List[httpx.Response] = await asyncio.gather(*vehicles_tasks)
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1729, in get
    return await self.request(
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1506, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1593, in send
    response = await self._send_handling_auth(
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1621, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1658, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1695, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/usr/local/lib/python3.9/contextlib.py", line 137, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ReadTimeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/update_coordinator.py", line 191, in _async_refresh
    self.data = await self._async_update_data()
  File "/config/custom_components/bmw_connected_drive/coordinator.py", line 54, in _async_update_data
    await self.account.get_vehicles()
  File "/usr/local/lib/python3.9/site-packages/bimmer_connected/account.py", line 87, in get_vehicles
    self.vehicles.append(MyBMWVehicle(self, vehicle_dict))
  File "/usr/local/lib/python3.9/site-packages/httpx/_client.py", line 1975, in __aexit__
    await self._transport.__aexit__(exc_type, exc_value, traceback)
  File "/usr/local/lib/python3.9/site-packages/httpx/_transports/default.py", line 332, in __aexit__
    await self._pool.__aexit__(exc_type, exc_value, traceback)
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 326, in __aexit__
    await self.aclose()
  File "/usr/local/lib/python3.9/site-packages/httpcore/_async/connection_pool.py", line 312, in aclose
    raise RuntimeError(
RuntimeError: The connection pool was closed while 1 HTTP requests/responses were still in-flight.

Additional information

No response

probot-home-assistant · 2022-05-18T05:19:57Z

bmw_connected_drive documentation
bmw_connected_drive source
_{^{(message by IssueLinks)}}

probot-home-assistant · 2022-05-18T05:20:00Z

Hey there @gerard33, @rikroe, mind taking a look at this issue as it has been labeled with an integration (bmw_connected_drive) you are listed as a code owner for? Thanks!
_{^{(message by CodeOwnersMention)}}

BinnenBeest · 2022-05-18T06:11:14Z

I have the same issue. Enjoying 🥹

wokkeltje13 · 2022-05-18T10:52:25Z

seems like issue is solved now, probably an issue in the BMW backend (or maintenance)

rssgonzalez · 2022-05-18T11:35:10Z

For me, is also available again. it seems ok.

wokkeltje13 · 2022-05-18T11:37:35Z

Think it is not stable, here it is not working anymore again.

rssgonzalez · 2022-05-18T12:14:36Z

Think it is not stable, here it is not working anymore again.

That's right! Unavailable again

sdemmery · 2022-05-18T13:01:56Z

Yep unavailable for me too. Removed the integration used the latest Beta via HACs now cant login at all. Only started playing as have been getting lots of unavailable messages triggering my badly coded NodeRed flows last few days was driving me crazy :-)

Erisvaenget27 · 2022-05-18T13:20:48Z

Dosnt work for me as well. Quite sure its a BMW problem. Although its kind of funny the app is working? LOG saying: API error

mimainka · 2022-05-18T17:30:38Z

BMW is currently working on their backend. So it’s not a homeassistant issue.

arboeh · 2022-05-19T17:38:20Z

API seems to run again, but I have still problem with disconnections.
It happens right now when this Log-Message occurs:

Logger: bimmer_connected.utils
Source: /usr/local/lib/python3.9/site-packages/bimmer_connected/utils.py:79
First occurred: 17:28:30 (54 occurrences)
Last logged: 19:30:06

DeprecationWarning:/config/custom_components/bmw_connected_drive/lock.py:87: 'VehicleStatus.door_lock_state' is deprecated. Please change to 'vehicle.doors_and_windows.door_lock_state'.
DeprecationWarning:/config/custom_components/bmw_connected_drive/lock.py:94: 'VehicleStatus.door_lock_state' is deprecated. Please change to 'vehicle.doors_and_windows.door_lock_state'.

The amount of occurrences makes me wonder...

rikroe · 2022-05-19T17:56:46Z

Does it always happen if the DeprecationWarning is coming up?

I could be either BMW working on their servers and the requests taking longer (i.e. more than 10 seconds) or it could be httpx related (the library we use to call the API endpoints). I think I've seen some regression in one of their releases but have to find out if it is in the exact version that HA is using.

rikroe · 2022-05-19T18:21:13Z

Ok, found the issue in httpx - it has been fixed, but not released yet:
PR for next release: encode/httpx#2214
PR that fixed the issue: encode/httpx#2156

I will try increasing the timeout to 30 seconds, maybe that helps for now if BMW servers are slow.

rikroe · 2022-05-21T14:51:46Z

Actually it was wasn't only httpx, but also myself. This should be fixed by #71827.

Mithrox · 2022-05-26T12:15:00Z

This issue above, does it also effect the integration function like on the screenshot below? The integration is working off and on through the day, and it results on the unknown/unavailable status like shown below.

Mithrox · 2022-05-26T12:44:56Z

These are the errors I get over and over again

rikroe · 2022-05-27T12:23:02Z

Yes, the unavailable state is a result of not being able to communicate with the API.
There are two reasons:

timeout issues with httpx and how we integrated it (which should be fixed with 2022.6)
429 Too Many Requests is thrown by the BMW servers, I'll have to check the retry strategy in HA to somehow limit it

arboeh · 2022-05-28T08:02:39Z

I can't login any more...

rikroe · 2022-05-28T10:40:48Z

BMW decided to block the specific user agent we were using, disableing the library completely.
There will be a release of the library today that fixes it (for now) which should get included in HA 2022.6.

probot-home-assistant bot added the integration: bmw_connected_drive label May 18, 2022

arboeh changed the title ~~BMW Connected Drive permanentally closing connection~~ BMW Connected Drive permanentally closes connection May 18, 2022

uvjustin mentioned this issue May 27, 2022

Bump httpx to 0.23.0 #72573

Merged

22 tasks

rikroe mentioned this issue May 28, 2022

Bump bimmer_connected to 0.9.2 #72653

Merged

22 tasks

thecode closed this as completed in #72653 May 28, 2022

github-actions bot locked and limited conversation to collaborators Jun 27, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

BMW Connected Drive permanentally closes connection #72054

BMW Connected Drive permanentally closes connection #72054

arboeh commented May 18, 2022 •

edited

probot-home-assistant bot commented May 18, 2022

probot-home-assistant bot commented May 18, 2022

BinnenBeest commented May 18, 2022

wokkeltje13 commented May 18, 2022

rssgonzalez commented May 18, 2022

wokkeltje13 commented May 18, 2022

rssgonzalez commented May 18, 2022

sdemmery commented May 18, 2022

Erisvaenget27 commented May 18, 2022

mimainka commented May 18, 2022

arboeh commented May 19, 2022

rikroe commented May 19, 2022

rikroe commented May 19, 2022

rikroe commented May 21, 2022

Mithrox commented May 26, 2022

Mithrox commented May 26, 2022

rikroe commented May 27, 2022

arboeh commented May 28, 2022 •

edited

rikroe commented May 28, 2022

BMW Connected Drive permanentally closes connection #72054

BMW Connected Drive permanentally closes connection #72054

Comments

arboeh commented May 18, 2022 • edited

The problem

What version of Home Assistant Core has the issue?

What was the last working version of Home Assistant Core?

What type of installation are you running?

Integration causing the issue

Link to integration documentation on our website

Diagnostics information

Example YAML snippet

Anything in the logs that might be useful for us?

Additional information

probot-home-assistant bot commented May 18, 2022

probot-home-assistant bot commented May 18, 2022

BinnenBeest commented May 18, 2022

wokkeltje13 commented May 18, 2022

rssgonzalez commented May 18, 2022

wokkeltje13 commented May 18, 2022

rssgonzalez commented May 18, 2022

sdemmery commented May 18, 2022

Erisvaenget27 commented May 18, 2022

mimainka commented May 18, 2022

arboeh commented May 19, 2022

rikroe commented May 19, 2022

rikroe commented May 19, 2022

rikroe commented May 21, 2022

Mithrox commented May 26, 2022

Mithrox commented May 26, 2022

rikroe commented May 27, 2022

arboeh commented May 28, 2022 • edited

rikroe commented May 28, 2022

arboeh commented May 18, 2022 •

edited

arboeh commented May 28, 2022 •

edited