CI error: System.Net.Quic.QuicException: The connection timed out from inactivity #91757

steveharter · 2023-09-07T20:09:14Z

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=640353
Build error leg or test failing: System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_MaxResponseHeadersLength_Http3.LargeSingleHeader_ThrowsException

Error Message

Multiple System.Net.Quic.QuicException : The connection timed out from inactivity. in System.Net.Quic tests on "smaller" platforms, e.g. Alpine3.15 arm 32

 System.Net.Quic.QuicException : The connection timed out from inactivity.
      Stack Trace:
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(547,0): at System.Net.Quic.QuicConnection.HandleConnectionEvent(QUIC_CONNECTION_EVENT& connectionEvent)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(581,0): at System.Net.Quic.QuicConnection.NativeCallback(QUIC_HANDLE* connection, Void* context, QUIC_CONNECTION_EVENT* connectionEvent)
        --- End of stack trace from previous location ---
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ValueTaskSource.cs(176,0): at System.Net.Quic.ValueTaskSource.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(324,0): at System.Net.Quic.QuicConnection.FinishConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(72,0): at System.Net.Quic.QuicConnection.<ConnectAsync>g__StartConnectAsync|2_0(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(77,0): at System.Net.Quic.QuicConnection.<ConnectAsync>g__StartConnectAsync|2_0(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicTestBase.cs(214,0): at System.Net.Quic.Tests.QuicTestBase.CreateConnectedQuicConnection(QuicClientConnectionOptions clientOptions, QuicListener listener)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicTestBase.cs(245,0): at System.Net.Quic.Tests.QuicTestBase.CreateConnectedQuicConnection(QuicClientConnectionOptions clientOptions, QuicListener listener)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicConnectionTests.cs(315,0): at System.Net.Quic.Tests.QuicConnectionTests.AcceptStreamAsync_ConnectionDisposed_Throws()

{
  "ErrorPattern": "System.Net.Quic.QuicException ?: The connection timed out from inactivity",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=640353
Error message validated: [System.Net.Quic.QuicException ?: The connection timed out from inactivity]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/16/2024 11:07:05 AM UTC

Report

Build	Definition	Test	Pull Request
687411	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_ConnectionFrame_UpgradeFrom20_Success	#100951
686471	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
686486	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently
685210	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#100951
685128	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_Header_Upgrade_Success	#100951
684602	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#100951
684157	dotnet/runtime	System.Net.Http.Functional.Tests.WorkItemExecution	#100951
682562	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
682544	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
682572	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
682569	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
682542	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
682550	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently
682021	dotnet/runtime	System.Net.Http.Functional.Tests.SyncHttpHandlerTest_Cookies.GetAsync_SetCookieContainer_CookieSent
681977	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#100951
681837	dotnet/runtime	System.Net.Http.Functional.Tests.Http2ResponseStreamZeroByteReadTest.ZeroByteRead_BlocksUntilDataIsAvailable
681508	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_Header_Upgrade_Success	#100951
681252	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
681239	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
681241	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
681226	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
681186	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_ConnectionFrame_UpgradeFrom20_Success	#100951
680562	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.ReadWrite_Success_Large
680561	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680548	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680555	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680543	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680549	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently
680194	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680201	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680190	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
680182	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
679966	dotnet/runtime	System.Net.Http.Functional.Tests.SocksProxyTest_Http2.TestLoopbackAsync
679003	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
679013	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
678985	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
678988	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
678721	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Headers_Http3.SendAsync_Expires_Success
678685	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_Cancellation_Test_Http3.RequestSent_HandlerDisposed_RequestIsUnaffected	#102362
678603	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#102357
678427	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#102351
677554	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.ReadWrite_Success_Large
676197	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
676184	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
676182	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently
674899	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#101531
674771	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
674765	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
674768	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
674647	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#100951
673432	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
673429	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
673417	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
672864	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.ReadWrite_Success_Large
672871	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
672885	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
672859	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
672860	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
672506	dotnet/runtime	System.Net.Quic.Tests.MsQuicTests.IdleTimeout_ThrowsQuicException
671701	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Headers_Http3.SendAsync_Expires_Success
671414	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
671411	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
671408	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
671393	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
670354	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
670346	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
669294	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
669277	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
669275	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
668063	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
668067	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
668052	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
666557	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
666551	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
666506	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_ConnectionFrame_UpgradeFrom20_Success	#100951
666017	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
666013	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
665518	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.ReadWrite_Success_Large
665513	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
665532	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
665533	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
665536	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
664482	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
664478	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
664470	dotnet/runtime	System.Net.Quic.Tests.QuicStreamConformanceTests.Parallel_ReadWriteMultipleStreamsConcurrently
664378	dotnet/runtime	System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws	#101624
664107	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream
664022	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http3.GetAsync_SetCookieContainerAndCookieHeader_BothCookiesSent	#101828
663982	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Headers_Http3.SendAsync_Expires_Success
663692	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_ConnectionFrame_UpgradeFrom20_Success	#101818
663649	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_Finalization_Http3.IncompleteResponseStream_ResponseDropped_CancelsRequestToServer
663200	dotnet/runtime	System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws	#101624
663076	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_AltSvc_Test_Http3.AltSvc_ConnectionFrame_UpgradeFrom20_Success	#100951
662970	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
662984	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
662966	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
662938	dotnet/runtime	System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_HttpClientHandlerTest_Http3.ReadAsStreamAsync_HandlerProducesWellBehavedResponseStream	#100951
662347	dotnet/runtime	System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws	#101624
661869	dotnet/runtime	System.Net.Quic.Tests.QuicStreamTests.WriteAsync_LocalAbort_Throws	#101624
661725	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
Displaying 100 of 132 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	28	132

The text was updated successfully, but these errors were encountered:

ghost · 2023-09-07T20:09:20Z

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=398498
Build error leg or test failing: System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_MaxResponseHeadersLength_Http3.LargeSingleHeader_ThrowsException
Pull request: #91290

Error Message

  Starting:    System.Net.Http.Functional.Tests (parallel test collections = on, max threads = 2)
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientEKUTest.HttpClient_ClientEKUServerAuth_Fails [SKIP]
      Condition(s) not met: "CanTestCertificates"
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientEKUTest.HttpClient_NoEKUServerAuth_Ok [SKIP]
      Condition(s) not met: "CanTestCertificates"
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientEKUTest.HttpClient_NoEKUClientAuth_Ok [SKIP]
      Condition(s) not met: "CanTestCertificates"
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientEKUTest.HttpClient_ServerEKUClientAuth_Fails [SKIP]
      Condition(s) not met: "CanTestCertificates"
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClient_SelectedSites_Test.RetrieveSite_Succeeds [SKIP]
      Condition(s) not met: "IsSelectedSitesTestEnabled"
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClient_SelectedSites_Test.RetrieveSite_Debug_Helper [SKIP]
      Condition(s) not met: "IsSelectedSitesTestEnabled"
    System.Net.Http.Functional.Tests.SyncHttpHandler_HttpClientHandler_Authentication_Test.Credentials_ServerUsesWindowsAuthentication_Success [SKIP]
      Condition(s) not met: "IsWindowsServerAvailable"
    System.Net.Http.Functional.Tests.SocketsHttpHandler_HttpClientHandler_MaxResponseHeadersLength_Http3.LargeSingleHeader_ThrowsException(maxResponseHeadersLength: 1) [FAIL]
      System.AggregateException : One or more errors occurred. (Assert.Contains() Failure
      Not found: 1024
      In value:  System.Net.Http.HttpRequestException: An error occurred while sending the request.
                  ---> System.Net.Quic.QuicException: The connection timed out from inactivity.
                    at System.Net.Quic.ResettableValueTaskSource.TryComplete(Exception exception, Boolean final) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ResettableValueTaskSource.cs:line 169
                    at System.Net.Quic.ResettableValueTaskSource.TrySetException(Exception exception, Boolean final) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ResettableValueTaskSource.cs:line 233
                    at System.Net.Quic.QuicStream.HandleEventShutdownComplete(_SHUTDOWN_COMPLETE_e__Struct& data) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs:line 589
                    at System.Net.Quic.QuicStream.HandleStreamEvent(QUIC_STREAM_EVENT& streamEvent) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs:line 611
                    at System.Net.Quic.QuicStream.NativeCallback(QUIC_HANDLE* connection, Void* context, QUIC_STREAM_EVENT* streamEvent) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs:line 640
                 --- End of stack trace from previous location ---
                    at System.Net.Quic.ResettableValueTaskSource.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ResettableValueTaskSource.cs:line 247
                    at System.Net.Quic.QuicStream.ReadAsync(Memory`1 buffer, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicStream.cs:line 305
                    at System.Net.Http.Http3RequestStream.ReadFrameEnvelopeAsync(CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3RequestStream.cs:line 815
                    at System.Net.Http.Http3RequestStream.ReadResponseAsync(CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3RequestStream.cs:line 339
                    at System.Net.Http.Http3RequestStream.SendAsync(CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3RequestStream.cs:line 206
                    --- End of inner exception stack trace ---
                    at System.Net.Http.Http3RequestStream.SendAsync(CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3RequestStream.cs:line 310
                    at System.Net.Http.Http3RequestStream.SendAsync(CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3RequestStream.cs:line 324
                    at System.Net.Http.Http3Connection.SendAsync(HttpRequestMessage request, Int64 queueStartingTimestamp, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3Connection.cs:line 234
                    at System.Net.Http.Http3Connection.SendAsync(HttpRequestMessage request, Int64 queueStartingTimestamp, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/Http3Connection.cs:line 248
                    at System.Net.Http.HttpConnectionPool.TrySendUsingHttp3Async(HttpRequestMessage request, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/HttpConnectionPool.cs:line 999
                    at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/HttpConnectionPool.cs:line 1053
                    at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/SocketsHttpHandler/RedirectHandler.cs:line 30
                    at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) in /_/src/libraries/System.Net.Http/src/System/Net/Http/HttpClient.cs:line 530
                    at Xunit.Assert.RecordExceptionAsync(Func`1 testCode) in /_/src/Microsoft.DotNet.XUnitAssert/src/Record.cs:line 113) (The connection timed out from inactivity.)

{
  "ErrorMessage": "System.Net.Quic.QuicException: The connection timed out from inactivity.",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Author:	steveharter
Assignees:	-
Labels:	`area-System.Net.Http`, `blocking-clean-ci`, `Known Build Error`
Milestone:	-

liveans · 2023-09-07T20:12:16Z

This test was activated for the #74896 issue. The failures are different but they're coming from the same test, I'm investigating that.

Disabling HTTP/3 test `LargeSingleHeader_ThrowsException` against #74896 because it's happening quite often until we're back to investigate it. Related to #91757

lewing · 2023-11-04T23:11:27Z

This is causing a lot of failures, is there a timeline for a fix?

liveans · 2023-11-05T18:05:13Z

Looks like recent failures are coming from different tests and from Alpine.315.Arm32.Open mostly.

cc: @ManickaP

ManickaP · 2023-11-06T07:56:47Z

The newly reported errors do have the same error message, but that are coming from System.Net.Quic tests, not HTTP/3. So could you file it separately, as this has nothing to do with that particular disabled test.

ManickaP · 2023-11-08T09:26:55Z

I've separated the disabled test into a new issue and I'm keeping this for the QUIC timeout

ghost · 2023-11-08T09:30:07Z

Tagging subscribers to this area: @dotnet/ncl
See info in area-owners.md if you want to be subscribed.

Issue Details

Multiple System.Net.Quic.QuicException : The connection timed out from inactivity. in System.Net.Quic tests on "smaller" platforms, e.g. Alpine3.15 arm 32

Error message example from console.log:

Error Message

 System.Net.Quic.QuicException : The connection timed out from inactivity.
      Stack Trace:
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(547,0): at System.Net.Quic.QuicConnection.HandleConnectionEvent(QUIC_CONNECTION_EVENT& connectionEvent)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(581,0): at System.Net.Quic.QuicConnection.NativeCallback(QUIC_HANDLE* connection, Void* context, QUIC_CONNECTION_EVENT* connectionEvent)
        --- End of stack trace from previous location ---
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/Internal/ValueTaskSource.cs(176,0): at System.Net.Quic.ValueTaskSource.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(324,0): at System.Net.Quic.QuicConnection.FinishConnectAsync(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(72,0): at System.Net.Quic.QuicConnection.<ConnectAsync>g__StartConnectAsync|2_0(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/src/System/Net/Quic/QuicConnection.cs(77,0): at System.Net.Quic.QuicConnection.<ConnectAsync>g__StartConnectAsync|2_0(QuicClientConnectionOptions options, CancellationToken cancellationToken)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicTestBase.cs(214,0): at System.Net.Quic.Tests.QuicTestBase.CreateConnectedQuicConnection(QuicClientConnectionOptions clientOptions, QuicListener listener)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicTestBase.cs(245,0): at System.Net.Quic.Tests.QuicTestBase.CreateConnectedQuicConnection(QuicClientConnectionOptions clientOptions, QuicListener listener)
        /_/src/libraries/System.Net.Quic/tests/FunctionalTests/QuicConnectionTests.cs(315,0): at System.Net.Quic.Tests.QuicConnectionTests.AcceptStreamAsync_ConnectionDisposed_Throws()

{
  "ErrorMessage": "System.Net.Quic.QuicException: The connection timed out from inactivity.",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=398498
Error message validated: System.Net.Quic.QuicException: The connection timed out from inactivity.
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 9/7/2023 8:21:44 PM UTC

Report

Build	Definition	Test	Pull Request
462927	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94503
462918	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94396
462899	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#90970
462874	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94501
462830	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94193
462795	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94470
462717	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94497
462563	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#88620
462544	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94387
462519	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93517
462490	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#92709
462461	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
462448	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94285
462443	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94104
462407	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93823
462402	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94485
462324	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93901
462256	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94219
462253	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#90436
462229	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94454
462219	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94239
462187	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94285
462161	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94363
462138	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93220
462104	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94470
462056	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
462013	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#90527
462016	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94239
461980	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94462
461937	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94292
461905	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94453
461839	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94454
461761	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93220
461751	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94453
461739	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#90436
461709	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94450
461706	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
461699	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94449
461624	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94363
461607	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93535
461412	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94239
461482	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94292
461457	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94396
461449	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94441
461304	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94123
461262	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94432
461243	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
461144	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94309
461102	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94123
461058	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93223
461064	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94413
461025	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94418
460991	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93220
460851	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94382
460793	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94409
460934	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#90436
460876	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94292
460786	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93220
460656	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94405
460645	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94404
460639	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94396
460583	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93220
460577	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94402
459087	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94328
460511	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93220
460504	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
460494	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#92994
460487	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94287
460484	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94342
460480	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94396
460433	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94340
460425	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94347
459399	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94343
460397	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94387
460391	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
460384	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94387
460367	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93879
460328	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94382
460307	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94292
460109	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94347
460206	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
460171	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#93907
460132	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
459570	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94350
460043	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94368
460017	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94292
459947	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94347
459918	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94361
459485	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94347
459904	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution
459871	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94361
459840	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94123
459837	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94361
459812	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94159
459782	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94363
459777	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94123
459766	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94361
459752	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94239
459697	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94353
459710	dotnet/runtime	System.Net.Quic.Functional.Tests.WorkItemExecution	#94359
Displaying 100 of 349 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
38	166	349

Author:	steveharter
Assignees:	liveans
Labels:	`disabled-test`, `test-run-core`, `blocking-clean-ci`, `area-System.Net.Quic`, `Known Build Error`
Milestone:	9.0.0

CarnaViire · 2023-11-24T14:21:34Z

Added "disabled-test" tag, as the issue was just temporarily mitigated by pinning older docker tag (with older msquic revision) in #94683 and #94609. Tracking external issue is microsoft/msquic#3958

CarnaViire · 2023-11-24T14:34:49Z

Also, trying to pin the image to a specific msquic commit instead of main in dotnet/dotnet-buildtools-prereqs-docker#933, to be able to start tracking docker image changes again (by reverting #94683 and #94609).

It doesn't yet seem that the external issue would be fixed soon, so we cannot block everyone else on this (e.g. dotnet/dnceng#1423)

cc @wfurt @ManickaP

karelz · 2023-11-27T20:18:32Z

@wfurt can you please help merge the image? This is hitting CI badly. Thanks!

CarnaViire · 2023-11-28T09:11:59Z

@karelz this exact problem should not affect CI currently (because of #94683 and #94609)... is it still appearing? Or are you talking about dotnet/dnceng#1423?

karelz · 2023-11-28T12:19:20Z

This specific issue had a lot of hits in last month. Perhaps it was just stale data showing there.

MihaZupan · 2024-04-16T10:44:22Z

This was tracking the same pattern as #94507 and #97259 with the only differences being
QuicException: The vs QuicException : The vs the trailing dot at the end.
I've updated the pattern here to match all of them.

steveharter added area-System.Net.Http blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels Sep 7, 2023

ghost added the untriaged New issue has not been triaged by the area owner label Sep 7, 2023

liveans self-assigned this Sep 7, 2023

liveans removed the untriaged New issue has not been triaged by the area owner label Sep 7, 2023

karelz added this to the 9.0.0 milestone Sep 8, 2023

liveans mentioned this issue Sep 12, 2023

Disable Http3 LargeSingleHeader_ThrowsException Test #91930

Merged

liveans added the disabled-test The test is disabled in source code against the issue label Sep 12, 2023

karelz added the test-run-core Test failures in .NET Core test runs label Sep 21, 2023

karelz mentioned this issue Oct 11, 2023

Failures in SocketsHttpHandler_HttpClientHandler_MaxResponseHeadersLength_Http3 test #74896

Closed

liveans mentioned this issue Oct 11, 2023

Change Active Issue Number #93333

Merged

carlossanlop mentioned this issue Oct 12, 2023

[release/8.0] Fix Options Source Gen Trimming Issues #93193

Merged

buyaa-n mentioned this issue Oct 26, 2023

Add Label support in new ILGenerator #93565

Merged

carlossanlop mentioned this issue Oct 30, 2023

[release/8.0-staging] Update dependencies from dotnet/hotreload-utils #93872

Merged

amanasifkhalid mentioned this issue Nov 2, 2023

JIT: Remove BBJ_NONE #94239

Merged

ManickaP mentioned this issue Nov 8, 2023

[HTTP/3] System.Net.Quic.QuicException: The connection timed out from inactivity #94507

Closed

ManickaP added area-System.Net.Quic and removed area-System.Net.Http labels Nov 8, 2023

ManickaP unassigned liveans Nov 8, 2023

ManickaP removed the disabled-test The test is disabled in source code against the issue label Nov 8, 2023

akoeplinger added this to the 9.0.0 milestone Nov 24, 2023

ghost removed the untriaged New issue has not been triaged by the area owner label Nov 24, 2023

CarnaViire added disabled-test The test is disabled in source code against the issue tracking-external-issue The issue is caused by external problem (e.g. OS) - nothing we can do to fix it directly labels Nov 24, 2023

CarnaViire mentioned this issue Nov 24, 2023

Pin msquic to pre-regression revision on Alpine Arm32 dotnet/dotnet-buildtools-prereqs-docker#933

Merged

karelz assigned CarnaViire and wfurt Nov 27, 2023

CarnaViire mentioned this issue Nov 28, 2023

Revert "Pin the Alpine Arm32 image to previous tag (#94683)" #95359

Merged

CarnaViire mentioned this issue Jan 3, 2024

[QUIC] Disable QUIC tests on CLR stress tests #96392

Merged

CarnaViire mentioned this issue Feb 27, 2024

Disable QUIC tests on alpine arm32 #99020

Merged

rzikm mentioned this issue Apr 2, 2024

Disable System.Net.Quic tests on arm32 #100514

Merged

ManickaP mentioned this issue Apr 3, 2024

Test failure System.Net.Quic.QuicException : The connection timed out from inactivity. #100219

Closed

MihaZupan mentioned this issue Apr 16, 2024

Disable SocketsHttpHandler_HttpClientHandler_MaxResponseHeadersLength_Http3 Test Suite #101110

Merged

MihaZupan mentioned this issue Apr 22, 2024

[Test Failure] SocketsHttpHandlerTest_Cookies_Http3.GetAsync_SetCookieContainerAndCookieHeader_BothCookiesSent #101377

Open

rzikm mentioned this issue Apr 23, 2024

Disable frequently failing tests #101439

Merged

This was referenced Apr 25, 2024

Timeout in System.Net.Http.Functional SocketsHttpHandler tests #101463

Open

Timeout in System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http3.GetAsync_SetCookieContainerAndCookieHeader_BothCookiesSent #101553

Open

kunalspathak mentioned this issue Apr 25, 2024

Timeout in System.Net.Quic #101559

Open

This was referenced Apr 25, 2024

Disable parallel test execution for QUIC and HTTP/3 #101569

Merged

[CI] Test failure from System.Net.Http.Functional.Tests.SocketsHttpHandlerTest_Cookies_Http3.GetAsync_DefaultCoookieContainer_NoCookieSent #101567

Closed

kunalspathak mentioned this issue Apr 25, 2024

Add support for Sve.UnzipEven/Odd & Sve.ZipHighLow #101294

Merged

CarnaViire removed the tracking-external-issue The issue is caused by external problem (e.g. OS) - nothing we can do to fix it directly label Apr 26, 2024

ManickaP unassigned CarnaViire and wfurt May 23, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CI error: System.Net.Quic.QuicException: The connection timed out from inactivity #91757

CI error: System.Net.Quic.QuicException: The connection timed out from inactivity #91757

steveharter commented Sep 7, 2023 •

edited by build-analysis bot

ghost commented Sep 7, 2023

Build Information

Error Message

liveans commented Sep 7, 2023 •

edited

lewing commented Nov 4, 2023

liveans commented Nov 5, 2023

ManickaP commented Nov 6, 2023

ManickaP commented Nov 8, 2023

ghost commented Nov 8, 2023

Error Message

Known issue validation

Report

Summary

CarnaViire commented Nov 24, 2023

CarnaViire commented Nov 24, 2023 •

edited

karelz commented Nov 27, 2023

CarnaViire commented Nov 28, 2023 •

edited

karelz commented Nov 28, 2023

MihaZupan commented Apr 16, 2024 •

edited

CI error: System.Net.Quic.QuicException: The connection timed out from inactivity #91757

CI error: System.Net.Quic.QuicException: The connection timed out from inactivity #91757

Comments

steveharter commented Sep 7, 2023 • edited by build-analysis bot

Build Information

Error Message

Known issue validation

Report

Summary

ghost commented Sep 7, 2023

Build Information

Error Message

liveans commented Sep 7, 2023 • edited

lewing commented Nov 4, 2023

liveans commented Nov 5, 2023

ManickaP commented Nov 6, 2023

ManickaP commented Nov 8, 2023

ghost commented Nov 8, 2023

Error Message

Known issue validation

Report

Summary

CarnaViire commented Nov 24, 2023

CarnaViire commented Nov 24, 2023 • edited

karelz commented Nov 27, 2023

CarnaViire commented Nov 28, 2023 • edited

karelz commented Nov 28, 2023

MihaZupan commented Apr 16, 2024 • edited

steveharter commented Sep 7, 2023 •

edited by build-analysis bot

liveans commented Sep 7, 2023 •

edited

CarnaViire commented Nov 24, 2023 •

edited

CarnaViire commented Nov 28, 2023 •

edited

MihaZupan commented Apr 16, 2024 •

edited