Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Intermittently, Jetty is throwing org.eclipse.jetty.io.EofException caused by: java.nio.channels.ClosedChannelException while retrieving attachment from target service #11740

Closed
gjoshi86 opened this issue May 2, 2024 · 5 comments
Closed

Intermittently, Jetty is throwing org.eclipse.jetty.io.EofException caused by: java.nio.channels.ClosedChannelException while retrieving attachment from target service #11740

gjoshi86 opened this issue May 2, 2024 · 5 comments
Labels
Question

Comments

@gjoshi86
Copy link

gjoshi86 commented May 2, 2024 •
edited by sbordet

Jetty 7.6.10.v20130312

OpenJDK 8u292 (1.8.0_292-b10)

My enterprise application has proxy api which retrieves attachment in the response from the target service. We are using soap webservice to retrieve payload and attachment.

I know, I am using older version of Jetty which is end of support. I just need your inputs on why this issue is happening intermittently and RCA on it. When this issue occurs, Jetty takes almost 2 -3 minutes before failing with org.eclipse.jetty.io.EofException.

In following case it took 340126ms before failing.

[1] ContentHandler:handleMessage()
				[1] Invoking handler: com.soa.policy.wssp.runtime.SetupSecurityContextHandler
				[1] Invoking handler: com.soa.policy.handler.audit.SoapProviderTransactionHandler
				[1] SoapProviderTransactionHandler:handleMessage()
				[1] Invoking handler: com.soa.policy.wssp.runtime.enforce.SPEnforcementHandler
				[1] Start [WSSP Enforcement Handler]
					[1] Start [.resolve(String name)]
						[1] Creating new LdapContext for proxy user [uid=akanabinddev, ou=People, ou=Special Accounts and Groups, o=ny,c=us]
						[1] [class com.soa.security.ssl.SimpleX509KeyManager] validate() returned false
						[18] Successfully verified the trust with certificate for server SSL authentication based on authType : ECDHE_RSA
						[18] 	chain[0] = X509CertImpl[subject: CN=*.ny.gov, O=New York State Office of Information Technology Services, L=Albany, ST=New York, C=US, issuer: CN=DigiCert Global G2 TLS RSA SHA256 2020 CA1, O=DigiCert Inc, C=US, serial: 16910753941145491038187284884990754625, start: Tue Mar 26 20:00:00 EDT 2024, end: Sun Apr 27 19:59:59 EDT 2025]
						[18] 	chain[1] = X509CertImpl[subject: CN=DigiCert Global G2 TLS RSA SHA256 2020 CA1, O=DigiCert Inc, C=US, issuer: CN=DigiCert Global Root G2, OU=www.digicert.com, O=DigiCert Inc, C=US, serial: 17226682543955925492517929723242541158, start: Mon Mar 29 20:00:00 EDT 2021, end: Sat Mar 29 19:59:59 EDT 2031]
						[45] Created new LdapContext for proxy user [uid=akanabinddev, ou=People, ou=Special Accounts and Groups, o=ny,c=us]
						[45] Retrieved Ldap context for proxy user
						[49] LdapContext.search(String name, String filter, SearchControls cons) took [4 milli seconds]
						[49] NamingEnumeration.hasMore() took [0 milli seconds]
					[49] End [.resolve(String name)]
					[49] Start [initialize(Subject subject, CallbackHandler callbackHandler, Map sharedState, Map options)]
					[49] End [initialize(Subject subject, CallbackHandler callbackHandler, Map sharedState, Map options)]
					[49] Start [com.soa.security.provider.pm.PMLoginModule.login()]
					[49] End [com.soa.security.provider.pm.PMLoginModule.login()]
				[49] End [WSSP Enforcement Handler]
				[49] Invoking handler: com.soa.policy.wssp.runtime.PostProcessWSSPHandler
				[49] Removing Security Header: 
				[49] Invoking handler: com.soa.policy.handler.audit.FilterHandler
				[49] FilterHandler:handleMessage()
				[49] Invoking handler: gov.nys.otda.soa.coe.virusscan.policy.VirusScanMessageHandler
				[50] Invoking handler: gov.nys.its.soa.coe.email.service.EmailServiceMessageHandler
				[50] Input message after policy enforcement
				[50] Start [com.soa.fw.transform.SOATransformer.transform()]
					[50] XmlSource class: javax.xml.transform.dom.DOMSource
					[50] Xml Source System ID: null
				[50] End [com.soa.fw.transform.SOATransformer.transform()]
				[50] <soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:qrs="http://ecmaas.its.ny.gov/QRS">
   <soapenv:Header>
      
   </soapenv:Header>
   <soapenv:Body>
      <qrs:query>
         <consumingApplication>PAYORCOMPLIANCE</consumingApplication>
         <documentClass>PayorCompliance</documentClass>
         <repositoryId>WCB_P8_PayorCompliance</repositoryId>
         <userId>Test</userId>
         <!--Optional:-->
         <includeContent>true</includeContent>
         <!--Optional:-->
         <propertiesList>
            <!--1 or more repetitions:-->
                        <propertyString displayName="DOCSubCategory" propertyDefinitionId="DOCSubCategory" queryName="DOCSubCategory"/>
                        <propertyString displayName="indexDate" propertyDefinitionId="indexDate" queryName="indexDate"/>
                        <propertyString displayName="SouRce" propertyDefinitionId="SouRce" queryName="SouRce"/>
                        <propertyString displayName="DateCreateD" propertyDefinitionId="DateCreateD" queryName="DateCreateD"/>
                        <propertyString displayName="DateLastModified" propertyDefinitionId="DateLastModified" queryName="DateLastModified"/>
         </propertiesList>
         <!--BAD FILE  2,444,159 bytes-->
         <condition>id='{D0DE3D8E-0000-C312-8AAA-187C0CBD82F3}'</condition>
<!--         <condition>id='{F0DD3D8E-0000-C91C-A0D1-F62852A60EEE}'</condition> -->


		<!--0 retrieved-->
<!--		<condition>ID = '{20EB3D8E-0000-C31F-9989-2391651C3433}'</condition>   -->

		<!--GOOD FILEs?-->
		<!-- smallish 717,146 bytes-->
		<!-- <condition>ID = '{E065528E-0000-C615-B802-74AE22440FC5}'</condition>-->
		<!-- larger 2,611,632 bytes -->
<!--		<condition>ID = '{508C2A8F-0000-C91C-8998-4CAAF53D41B6}'</condition> -->

         
         
         <!--Optional:-->
         <orderBy>DateCreateD</orderBy>
         <!--Optional:-->
         <scope>
            <!--Optional:-->
            <maxItems>15</maxItems>
            <!--Optional:-->
            <search...
...(113 more)
				[50] Start [SoapInBC.send]
					[50] delivering sync exchange to {http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0 service
					[50] Found 1 endpoints for [{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0]
					[50]     TEST2.QueryDocument2.0_potINT
					[50] SimpleRouter:send [{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0]
					[50] exchange being delivered to service: {http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0, endpoint: TEST2.QueryDocument2.0_potINT
					[50] Router:exchange being delivered to component [bpel.process.engine]
					[50] Start [ProcessSE.onExchange(MessageExchange)]
						[50] Invoking handler: com.soa.message.audit.handler.ReportHandler
						[50] ReportHandler:handleMessage()
						[50] Invoking handler: com.soa.message.handler.monitoring.pipeline.PipelineMonitoringHandler
						[50] Invoking handler: com.soa.policy.handler.metrics.MetricsHandler
						[50] Invoking handler: com.soa.policy.handler.audit.AuditLogMessageHandler
						[50] Invoking handler: gov.nys.otda.soa.coe.virusscan.policy.VirusScanMessageHandlerOut
						[50] Invoking handler: com.soa.policy.quota.concurrency.handler.ConcurrencyCloseHandler
						[50] Invoking handler: com.soa.message.handler.endpoint.ServiceHandler
						[50] ServiceHandler:handleMessage()
						[50] Endpoint Operation Handler:handleMessage() port [] service [{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0] operation [query]
						[50] Invoking handler: com.soa.policy.wspolicy.handler.ext.PolicyHandlerChain
						[50] Policy handler chain:handleMessage(null)
						[50] PolicyHandlerChain:handleMessage(): context.setProperty()
						[50] Invoking handler: com.soa.policy.handler.audit.InternalTransactionHandler
						[50] InternalTransactionHandler:handleMessage()
						[50] Invoking handler: com.soa.message.handler.ChainHandler
						[50] Invoking handler: com.soa.policy.handler.audit.AuditHandler
						[50] AuditHandler:handleMessage()
						[50] Invoking handler: com.soa.policy.handler.audit.FilterHandler
						[50] FilterHandler:handleMessage()
						[50] Invoking handler: com.soa.policy.handler.audit.HybridContentHandler
						[50] ContentHandler:handleMessage()
						[50] Invoking handler: com.soa.policy.pipeline.PipelinePolicyHandler
						[50] PipelinePolicyHandler:handleMessage()
						[50] EventId: 9879c988-0832-11ef-9204-8032079f9fb1
						[50] Start [Executing process step pre-process]
						[50] End [Executing process step pre-process]
						[50] Start [Executing process step request]
							[50] EventId: 9879c988-0832-11ef-9204-8032079f9fb1
							[50] Executing com.digev.mp.component.wss.WSSAddTimestampComp
							[50] Start [calling com.digev.mp.component.wss.WSSAddTimestampComp.execute()]
								[50] Start [WSSAddTimestampComp.executeResponse]
								[50] End [WSSAddTimestampComp.executeResponse]
							[50] End [calling com.digev.mp.component.wss.WSSAddTimestampComp.execute()]
							[50] Executing com.digev.mp.component.wss.signature.WSSignComponent
							[50] Start [calling com.digev.mp.component.wss.signature.WSSignComponent.execute()]
							[56] End [calling com.digev.mp.component.wss.signature.WSSignComponent.execute()]
						[56] End [Executing process step request]
						[56] Invoking handler: com.soa.policy.auth.AuthenticationHandler
						[56] AuthenticationAssertion: isGenerateAuditData()
						[56] Invoking handler: com.soa.analytics.metrics.handler.MetricHandler
						[56] Invoking handler: com.soa.policy.handler.audit.ConsumerContentHandler
						[56] ConsumerContentHandler:handleMessage()
						[56] Invoking handler: com.soa.message.handler.contract.ContractHandler
						[56] ContractHandler:handleMessage()
						[56] ContractHandler: authorize()
						[56] Invoking handler: com.soa.message.handler.apicontract.APIContractHandler
						[56] Invoking handler: com.soa.policy.script.handler.ScriptedPolicyHandler
						[56] Start [ScriptedPolicyHandler.perform()]
						[56] End [ScriptedPolicyHandler.perform()]
						[56] Invoking handler: com.soa.message.handler.contract.ServiceContractHandler
						[56] ServiceContractHandler:handleMessage()
						[56] Invoking handler: com.soa.policy.quota.timeout.handler.TimeoutHandler
						[56] Found 1 endpoints for [{http://ecmaas.its.ny.gov/QRS}QueryDocument2.0]
						[56]     QRSPortSoap11
						[56] SimpleRouter:send [{http://ecmaas.its.ny.gov/QRS}QueryDocument2.0]
						[56] exchange being delivered to service: {http://ecmaas.its.ny.gov/QRS}QueryDocument2.0, endpoint: QRSPortSoap11
						[56] Router:exchange being delivered to component [com.soa.soap.out.component]
						[56] Start [SoapOutBC.handle()]
							[56] SOAPOutBinding:accept()
							[56] Invoking handler: com.soa.message.handler.endpoint.EndpointHandler
							[56] EndpointHandler:handleMessage()
							[56] Endpoint Operation Handler:handleMessage() port [QRSPortSoap11] service [{http://ecmaas.its.ny.gov/QRS}QueryDocument2.0] operation [query]
							[56] Invoking handler: com.soa.message.handler.soap.contenttype.ContentTypeHandler
							[56] Invoking handler: com.soa.message.handler.soap.action.ActionHandler
							[56] Invoking handler: com.soa.policy.handler.audit.ExchangePostProcessorHandler
							[56] Invoking handler: com.soa.policy.handler.audit.OutboundAuditHandler
							[56] Invoking handler: com.soa.policy.handler.audit.ConsumerContentHandler
							[56] ConsumerContentHandler:handleMessage()
							[56] Invoking handler: com.soa.message.audit.handler.OutboundReportHandler
							[56] OutboundReportHandler:handleMessage()
							[56] Invoking handler: com.soa.message.handler.faultname.FaultNameHandler
							[56] handleMessage()
							[56] Outbound message is 
							[56] Start [com.soa.fw.transform.SOATransformer.transform()]
								[56] XmlSource class: javax.xml.transform.dom.DOMSource
								[56] Xml Source System ID: null
							[56] End [com.soa.fw.transform.SOATransformer.transform()]
							[56] <soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:qrs="http://ecmaas.its.ny.gov/QRS">
   <soapenv:Header>
<wsse:Security xmlns:wsse="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd" soapenv:mustUnderstand="1"><wsse:BinarySecurityToken xmlns:wsu="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" EncodingType="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-soap-message-security-1.0#Base64Binary" ValueType="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-x509-token-profile-1.0#X509v3" wsu:Id="CertId--930826214" xmlns:wsse="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd">MIIHCTCCBfGgAwIBAgIQBFbiPqu53hWAqIjyswOTdzANBgkqhkiG9w0BAQsFADBZMQswCQYDVQQGEwJVUzEVMBMGA1UEChMMRGlnaUNlcnQgSW5jMTMwMQYDVQQDEypEaWdpQ2VydCBHbG9iYWwgRzIgVExTIFJTQSBTSEEyNTYgMjAyMCBDQTEwHhcNMjMwNzE4MDAwMDAwWhcNMjQwODE0MjM1OTU5WjCBlTELMAkGA1UEBhMCVVMxETAPBgNVBAgTCE5ldyBZb3JrMQ8wDQYDVQQHEwZBbGJhbnkxQTA/BgNVBAoTOE5ldyBZb3JrIFN0YXRlIE9mZmljZSBvZiBJbmZvcm1hdGlvbiBUZWNobm9sb2d5IFNlcnZpY2VzMR8wHQYDVQQDExZ0ZXN0LmNyeXB0by5hcGkubnkuZ292MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAx+fPhJeiuMvexH4jhK94EEfP6WxviNjTRkzSWzxLTBWVSTl6GeaY71GDOmxHbWjBpjAhL41ONIkJZ2uku6OMH2PZT7l84rQ1JRykkJb4lY5H6D+i+qjQjS8mqbRD8TWUg2NE/CpeJWXzGhyeG2Zvn1Rn4oBzqYMMuKR6D3kTol/IYajo9ti7IEQCnsh25o50BQjoCsPUpYyA5ybpRHuEtbmdqZ/H5EJklHCPYQFFio/TFHidoGMdJ8zgITmSnXg8enWKaDT507m/PqRI9651xUUmPR6pNQuo7jLUztNep/PSKg3OsSrlksx7WIUdhILh9QtnwKHDsiX13fCrLvtjfQIDAQABo4IDjjCCA4owHwYDVR0jBBgwFoAUdIWAwGbH3zfez70pN6oDHb7tzRcwHQYDVR0OBBYEFNR7JcVc0T2t1VjLdwZaB27eBTSkMCEGA1UdEQQaMBiCFnRlc3QuY3J5cHRvLmFwaS5ueS5nb3YwDgYDVR0PAQH/BAQDAgWgMB0GA1UdJQQWMBQGCCsGAQUFBwMBBggrBgEFBQcDAjCBnwYDVR0fBIGXMIGUMEigRqBEhkJodHRwOi8vY3JsMy5kaWdpY2VydC5jb20vRGlnaUNlcnRHbG9iYWxHMlRMU1JTQVNIQTI1NjIwMjBDQTEtMS5jcmwwSKBGoESGQmh0dHA6Ly9jcmw0LmRpZ2ljZXJ0LmNvbS9EaWdpQ2VydEdsb2JhbEcyVExTUlNBU0hBMjU2MjAyMENBMS0xLmNybDA+BgNVHSAENzA1MDMGBmeBDAECAjApMCcGCCsGAQUFBwIBFhtodHRwOi8vd3d3LmRpZ2ljZXJ0LmNvbS...
...(5096 more)
							[56] Outbound exchange isAsync [false]
							[56] Start [HttpClientTransport.accept()]
								[56] Setting request header [Connection][keep-alive]
								[56] Setting request header [Accept-Encoding][gzip,deflate]
								[56] Setting request header [SOAPAction][""]
								[56] Setting request header [User-Agent][Apache-HttpClient/4.5.5 (Java/16.0.1)]
								[56] Setting request header [Content-Type][text/xml;charset=UTF-8]
								[56] Setting request header [Content-Length][2830]
								[56] Setting request header [Host][ent928dl5soand:9905]
								[56] issueHttpRequest [POST][http://dch1302dl5app.svc.ny.gov:9886/retrieve/soap/api20/retrieveDocument][HTTP/1.0]
								[56] Blocking header [content-type]
								[56] Blocking header [content-length]
								[56] Blocking header [host]
								[56] Blocking header [connection]
								[56] StreamingContentWriter: Content type is [text/xml;charset=UTF-8]
								[56] Start [com.soa.fw.transform.SOATransformer.transform()]
									[56] XmlSource class: javax.xml.transform.dom.DOMSource
									[56] Xml Source System ID: null
								[57] End [com.soa.fw.transform.SOATransformer.transform()]
								[57] Actual request header [Accept-Encoding][gzip,deflate]
								[57] Actual request header [SOAPAction][""]
								[57] Actual request header [User-Agent][Apache-HttpClient/4.5.5 (Java/16.0.1)]
								[57] Actual request header [Content-Length][7144]
								[57] Actual request header [Content-Type][text/xml;charset=UTF-8]
								[57] Actual request header [Host][dch1302dl5app.svc.ny.gov:9886]
								[57] Actual request header [Connection][Keep-Alive]
								[59] OUTGOING MESSAGE:<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:qrs="http://ecmaas.its.ny.gov/QRS">
   <soapenv:Header>
<wsse:Security xmlns:wsse="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd" soapenv:mustUnderstand="1"><wsse:BinarySecurityToken xmlns:wsu="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd" EncodingType="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-soap-message-security-1.0#Base64Binary" ValueType="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-x509-token-profile-1.0#X509v3" wsu:Id="CertId--930826214" xmlns:wsse="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd">MIIHCTCCBfGgAwIBAgIQBFbiPqu53hWAqIjyswOTdzANBgkqhkiG9w0BAQsFADBZMQswCQYDVQQGEwJVUzEVMBMGA1UEChMMRGlnaUNlcnQgSW5jMTMwMQYDVQQDEypEaWdpQ2VydCBHbG9iYWwgRzIgVExTIFJTQSBTSEEyNTYgMjAyMCBDQTEwHhcNMjMwNzE4MDAwMDAwWhcNMjQwODE0MjM1OTU5WjCBlTELMAkGA1UEBhMCVVMxETAPBgNVBAgTCE5ldyBZb3JrMQ8wDQYDVQQHEwZBbGJhbnkxQTA/BgNVBAoTOE5ldyBZb3JrIFN0YXRlIE9mZmljZSBvZiBJbmZvcm1hdGlvbiBUZWNobm9sb2d5IFNlcnZpY2VzMR8wHQYDVQQDExZ0ZXN0LmNyeXB0by5hcGkubnkuZ292MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAx+fPhJeiuMvexH4jhK94EEfP6WxviNjTRkzSWzxLTBWVSTl6GeaY71GDOmxHbWjBpjAhL41ONIkJZ2uku6OMH2PZT7l84rQ1JRykkJb4lY5H6D+i+qjQjS8mqbRD8TWUg2NE/CpeJWXzGhyeG2Zvn1Rn4oBzqYMMuKR6D3kTol/IYajo9ti7IEQCnsh25o50BQjoCsPUpYyA5ybpRHuEtbmdqZ/H5EJklHCPYQFFio/TFHidoGMdJ8zgITmSnXg8enWKaDT507m/PqRI9651xUUmPR6pNQuo7jLUztNep/PSKg3OsSrlksx7WIUdhILh9QtnwKHDsiX13fCrLvtjfQIDAQABo4IDjjCCA4owHwYDVR0jBBgwFoAUdIWAwGbH3zfez70pN6oDHb7tzRcwHQYDVR0OBBYEFNR7JcVc0T2t1VjLdwZaB27eBTSkMCEGA1UdEQQaMBiCFnRlc3QuY3J5cHRvLmFwaS5ueS5nb3YwDgYDVR0PAQH/BAQDAgWgMB0GA1UdJQQWMBQGCCsGAQUFBwMBBggrBgEFBQcDAjCBnwYDVR0fBIGXMIGUMEigRqBEhkJodHRwOi8vY3JsMy5kaWdpY2VydC5jb20vRGlnaUNlcnRHbG9iYWxHMlRMU1JTQVNIQTI1NjIwMjBDQTEtMS5jcmwwSKBGoESGQmh0dHA6Ly9jcmw0LmRpZ2ljZXJ0LmNvbS9EaWdpQ2VydEdsb2JhbEcyVExTUlNBU0hBMjU2MjAyMENBMS0xLmNybDA+BgNVHSAENzA1MDMGBmeBDAECAjApMCcGCCsGAQUFBwIBFhtodHRwOi8vd3d3L...
...(5113 more)
								[352] Request [POST http://dch1302dl5app.svc.ny.gov:9886/retrieve/soap/api20/retrieveDocument HTTP/1.0] completed in [296] mS, status [HTTP/1.1 200 ]
								[352] Response Header [Accept][text/xml, text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2]
								[352] Response Header [SOAPAction][""]
								[352] Response Header [Content-Type][Multipart/Related; boundary="----=_Part_858_1208074783.1714619887478"; type="application/xop+xml"; start-info="text/xml"]
								[352] Response Header [Date][Thu, 02 May 2024 03:18:07 GMT]
								[352] Response Header [Connection][close]
								[352] MTOM: contentType [application/xop+xml] actual content type [text/xml]
							[352] End [HttpClientTransport.accept()]
							[352] Response msg
							[352] Start [com.soa.fw.transform.SOATransformer.transform()]
								[352] OutputTarget is StreamResult
								[352] Starting writing to wirter
								[352] Ended wrting to writer
							[352] End [com.soa.fw.transform.SOATransformer.transform()]
							[352] <SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"><SOAP-ENV:Header/><SOAP-ENV:Body><ns3:response xmlns:ns3="http://ecmaas.its.ny.gov/QRS"><resultCode>0000</resultCode><resultMessage>000_0000 Query executed Successfully</resultMessage><resultDocuments><document id="{D0DE3D8E-0000-C312-8AAA-187C0CBD82F3}"><propertiesList><propertyString displayName="indexDate" propertyDefinitionId="indexDate" queryName="indexDate">20191025115400</propertyString><propertyString displayName="DateCreateD" propertyDefinitionId="DateCreateD" queryName="DateCreateD">20230831154513</propertyString><propertyString displayName="DOCSubCategory" propertyDefinitionId="DOCSubCategory" queryName="DOCSubCategory">Application for renewing license</propertyString><propertyString displayName="SouRce" propertyDefinitionId="SouRce" queryName="SouRce">ECMAAS</propertyString><propertyString displayName="DateLastModified" propertyDefinitionId="DateLastModified" queryName="DateLastModified">20240314124958</propertyString></propertiesList><files><file><xop:Include xmlns:xop="http://www.w3.org/2004/08/xop/include" href="cid:0eea99c5-aa65-40e8-a501-be7b93af7685@ecmapi.ny.gov"/></file></files></document></resultDocuments><hasMoreItems>false</hasMoreItems><numItemsReturned>1</numItemsReturned><numItemsMatching>1</numItemsMatching></ns3:response></SOAP-ENV:Body></SOAP-ENV:Envelope>
							[352] Output message received
							[352] Invoking handler in reverse: com.soa.message.handler.faultname.FaultNameHandler.  The following handlers will be skipped: 
							[352] handleMessage()
							[352] Invoking handler in reverse: com.soa.message.audit.handler.OutboundReportHandler.  The following handlers will be skipped: 
							[352] OutboundReportHandler:handleMessage()
							[352] Invoking handler in reverse: com.soa.policy.handler.audit.ConsumerContentHandler.  The following handlers will be skipped: 
							[352] ConsumerContentHandler:handleMessage()
							[352] Invoking handler in reverse: com.soa.policy.handler.audit.OutboundAuditHandler.  The following handlers will be skipped: 
							[352] Invoking handler in reverse: com.soa.policy.handler.audit.ExchangePostProcessorHandler.  The following handlers will be skipped: 
							[352] Invoking handler in reverse: com.soa.message.handler.endpoint.EndpointHandler.  The following handlers will be skipped: 
							[352] EndpointHandler:handleMessage()
							[352] Endpoint Operation Handler:handleMessage() port [QRSPortSoap11] service [{http://ecmaas.its.ny.gov/QRS}QueryDocument2.0] operation [query]
							[352] Output message after enforcement
							[352] Start [com.soa.fw.transform.SOATransformer.transform()]
								[352] OutputTarget is StreamResult
								[352] Starting writing to wirter
								[352] Ended wrting to writer
							[352] End [com.soa.fw.transform.SOATransformer.transform()]
							[352] <SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"><SOAP-ENV:Header/><SOAP-ENV:Body><ns3:response xmlns:ns3="http://ecmaas.its.ny.gov/QRS"><resultCode>0000</resultCode><resultMessage>000_0000 Query executed Successfully</resultMessage><resultDocuments><document id="{D0DE3D8E-0000-C312-8AAA-187C0CBD82F3}"><propertiesList><propertyString displayName="indexDate" propertyDefinitionId="indexDate" queryName="indexDate">20191025115400</propertyString><propertyString displayName="DateCreateD" propertyDefinitionId="DateCreateD" queryName="DateCreateD">20230831154513</propertyString><propertyString displayName="DOCSubCategory" propertyDefinitionId="DOCSubCategory" queryName="DOCSubCategory">Application for renewing license</propertyString><propertyString displayName="SouRce" propertyDefinitionId="SouRce" queryName="SouRce">ECMAAS</propertyString><propertyString displayName="DateLastModified" propertyDefinitionId="DateLastModified" queryName="DateLastModified">20240314124958</propertyString></propertiesList><files><file><xop:Include xmlns:xop="http://www.w3.org/2004/08/xop/include" href="cid:0eea99c5-aa65-40e8-a501-be7b93af7685@ecmapi.ny.gov"/></file></files></document></resultDocuments><hasMoreItems>false</hasMoreItems><numItemsReturned>1</numItemsReturned><numItemsMatching>1</numItemsMatching></ns3:response></SOAP-ENV:Body></SOAP-ENV:Envelope>
						[352] End [SoapOutBC.handle()]
						[352] Using preset endpoint [QRSPortSoap11][{http://ecmaas.its.ny.gov/QRS}QueryDocument2.0]
						[352] SimpleRouter:send [{http://ecmaas.its.ny.gov/QRS}QueryDocument2.0]
						[352] exchange being delivered to service: {http://ecmaas.its.ny.gov/QRS}QueryDocument2.0, endpoint: QRSPortSoap11
						[352] Router:exchange being delivered to component [com.soa.soap.out.component]
						[352] Start [SoapOutBC.handle()]
							[352] SOAPOutBinding:accept()
						[352] End [SoapOutBC.handle()]
						[352] Invoking handler in reverse: com.soa.policy.quota.timeout.handler.TimeoutHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.message.handler.contract.ServiceContractHandler.  The following handlers will be skipped: 
						[352] ServiceContractHandler:handleMessage()
						[352] Invoking handler in reverse: com.soa.policy.script.handler.ScriptedPolicyHandler.  The following handlers will be skipped: 
						[352] Start [ScriptedPolicyHandler.perform()]
						[352] End [ScriptedPolicyHandler.perform()]
						[352] Invoking handler in reverse: com.soa.message.handler.apicontract.APIContractHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.message.handler.contract.ContractHandler.  The following handlers will be skipped: 
						[352] ContractHandler:handleMessage()
						[352] Invoking handler in reverse: com.soa.policy.handler.audit.ConsumerContentHandler.  The following handlers will be skipped: 
						[352] ConsumerContentHandler:handleMessage()
						[352] Invoking handler in reverse: com.soa.analytics.metrics.handler.MetricHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.message.handler.endpoint.ServiceHandler.  The following handlers will be skipped: 
						[352] ServiceHandler:handleMessage()
						[352] Endpoint Operation Handler:handleMessage() port [] service [{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0] operation [query]
						[352] Invoking handler in reverse: com.soa.policy.wspolicy.handler.ext.PolicyHandlerChain.  The following handlers will be skipped: 
						[352] Policy handler chain:handleMessage(null)
						[352] PolicyHandlerChain:handleMessage(): context.setProperty()
						[352] Invoking handler in reverse: com.soa.policy.pipeline.PipelinePolicyHandler.  The following handlers will be skipped: 
						[352] PipelinePolicyHandler:handleMessage()
						[352] Start [Executing process step response]
						[352] End [Executing process step response]
						[352] Start [Executing process step post-process]
						[352] End [Executing process step post-process]
						[352] Invoking handler in reverse: com.soa.policy.handler.audit.HybridContentHandler.  The following handlers will be skipped: 
						[352] ContentHandler:handleMessage()
						[352] Invoking handler in reverse: com.soa.policy.handler.audit.InternalTransactionHandler.  The following handlers will be skipped: 
						[352] InternalTransactionHandler:handleMessage()
						[352] Invoking handler in reverse: com.soa.policy.quota.concurrency.handler.ConcurrencyCloseHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: gov.nys.otda.soa.coe.virusscan.policy.VirusScanMessageHandlerOut.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.policy.handler.audit.AuditLogMessageHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.policy.handler.metrics.MetricsHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.message.handler.monitoring.pipeline.PipelineMonitoringHandler.  The following handlers will be skipped: 
						[352] Invoking handler in reverse: com.soa.message.audit.handler.ReportHandler.  The following handlers will be skipped: 
						[352] ReportHandler:handleMessage()
					[352] End [ProcessSE.onExchange(MessageExchange)]
					[352] Output message received
				[352] End [SoapInBC.send]
				[352] Output message received
				[352] Invoking handler in reverse: com.soa.message.handler.endpoint.EndpointHandler.  The following handlers will be skipped: 
				[352] EndpointHandler:handleMessage()
				[352] Endpoint Operation Handler:handleMessage() port [TEST2.QueryDocument2.0_potINT] service [{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0] operation [query]
				[352] Invoking handler in reverse: gov.nys.its.soa.coe.email.service.EmailServiceMessageHandler.  The following handlers will be skipped: 
				[352] Invoking handler in reverse: gov.nys.otda.soa.coe.virusscan.policy.VirusScanMessageHandler.  The following handlers will be skipped: 
				[352] Invoking handler in reverse: com.soa.policy.wspolicy.handler.ext.PolicyHandlerChain.  The following handlers will be skipped: 
				[352] Policy handler chain:handleMessage(null)
				[352] PolicyHandlerChain:handleMessage(): context.setProperty()
				[352] Invoking handler in reverse: com.soa.policy.wssp.runtime.impl.SPImplementationHandler.  The following handlers will be skipped: 
				[352] Start [WSSP Implementation Handler]
				[352] End [WSSP Implementation Handler]
				[352] Invoking handler in reverse: com.soa.policy.handler.audit.SoapProviderTransactionHandler.  The following handlers will be skipped: 
				[352] SoapProviderTransactionHandler:handleMessage()
				[352] Invoking handler in reverse: com.soa.policy.handler.audit.HybridContentHandler.  The following handlers will be skipped: 
				[352] ContentHandler:handleMessage()
				[352] Invoking handler in reverse: com.soa.policy.handler.audit.AuditLogMessageHandler.  The following handlers will be skipped: 
				[352] Invoking handler in reverse: com.soa.message.handler.soap.operation.OperationHandler.  The following handlers will be skipped: 
				[352] handleMessage()
				[352] Invoking handler in reverse: com.soa.message.handler.monitoring.pipeline.PipelineMonitoringHandler.  The following handlers will be skipped: 
				[352] Invoking handler in reverse: com.soa.policy.handler.metrics.MetricsHandler.  The following handlers will be skipped: 
				[352] Invoking handler in reverse: com.soa.message.audit.handler.ReportHandler.  The following handlers will be skipped: 
				[352] ReportHandler:handleMessage()
				[352] Output message after policy implementation
				[352] Start [com.soa.fw.transform.SOATransformer.transform()]
					[352] OutputTarget is StreamResult
					[352] Starting writing to wirter
					[352] Ended wrting to writer
				[352] End [com.soa.fw.transform.SOATransformer.transform()]
				[352] <SOAP-ENV:Envelope xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"><SOAP-ENV:Header/><SOAP-ENV:Body><ns3:response xmlns:ns3="http://ecmaas.its.ny.gov/QRS"><resultCode>0000</resultCode><resultMessage>000_0000 Query executed Successfully</resultMessage><resultDocuments><document id="{D0DE3D8E-0000-C312-8AAA-187C0CBD82F3}"><propertiesList><propertyString displayName="indexDate" propertyDefinitionId="indexDate" queryName="indexDate">20191025115400</propertyString><propertyString displayName="DateCreateD" propertyDefinitionId="DateCreateD" queryName="DateCreateD">20230831154513</propertyString><propertyString displayName="DOCSubCategory" propertyDefinitionId="DOCSubCategory" queryName="DOCSubCategory">Application for renewing license</propertyString><propertyString displayName="SouRce" propertyDefinitionId="SouRce" queryName="SouRce">ECMAAS</propertyString><propertyString displayName="DateLastModified" propertyDefinitionId="DateLastModified" queryName="DateLastModified">20240314124958</propertyString></propertiesList><files><file><xop:Include xmlns:xop="http://www.w3.org/2004/08/xop/include" href="cid:0eea99c5-aa65-40e8-a501-be7b93af7685@ecmapi.ny.gov"/></file></files></document></resultDocuments><hasMoreItems>false</hasMoreItems><numItemsReturned>1</numItemsReturned><numItemsMatching>1</numItemsMatching></ns3:response></SOAP-ENV:Body></SOAP-ENV:Envelope>
			[352] End [SoapInBinding.accept()]
		[352] End [SoapMultiEndpointBinding.accept()]
		[352] JettyTransportBinding:reply([200] OK)
		[352] StreamingContentWriter: Content type is [multipart/related;boundary="----=_Part_858_1208074783.1714619887478";start="<115a9f71-e290-4265-90da-82d43c39bc30>";start-info="text/xml";type="application/xop+xml"]
		[352] Response header [Accept][text/xml, text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2]
		[352] Response header [SOAPAction][""]
		[352] Blocking header [Content-Type]
		[352] Blocking header [Date]
		[352] Blocking header [Connection]
		[352] Response header [Content-Encoding][gzip]
		[340126] org.eclipse.jetty.io.EofException
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.blockWritable(SelectChannelEndPoint.java:441)
	at org.eclipse.jetty.http.AbstractGenerator.blockForOutput(AbstractGenerator.java:517)
	at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:147)
	at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
	at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
	at com.soa.transport.stream.DecoratedOutputStream.write(DecoratedOutputStream.java:34)
	at java.util.zip.GZIPOutputStream.finish(GZIPOutputStream.java:168)
	at com.soa.transport.stream.impl.GZIPFinishOutputStream.commit(GZIPFinishOutputStream.java:30)
	at com.soa.transport.stream.impl.CountingStreamDecoratorFactory$CommitEventOutputStream.commit(CountingStreamDecoratorFactory.java:59)
	at com.soa.transport.stream.DecoratedOutputStream.commit(DecoratedOutputStream.java:26)
	at com.soa.transport.jetty.JettyTransportBinding.reply(JettyTransportBinding.java:597)
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handle(JettyTransportBinding.java:947)
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1134)
	at com.soa.platform.jetty.management.HttpContextHandler$HandlerList.handle(HttpContextHandler.java:471)
	at com.soa.platform.jetty.management.HttpContextHandler.doHandle(HttpContextHandler.java:387)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
	at org.eclipse.jetty.server.Server.handle(Server.java:363)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

		[340127] Start [SoapMultiEndpointBinding.accept()]
			[340127] VirtualHostEndpointSelector.select()
			[340127] Start [SoapInBinding.accept()]
				[340127] Start [SoapInBC.send]
					[340127] Using preset endpoint [TEST2.QueryDocument2.0_potINT][{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0]
					[340127] SimpleRouter:send [{http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0]
					[340127] exchange being delivered to service: {http://ecmaas.its.ny.gov/QRS}TEST2.QueryDocument2.0_vs0, endpoint: TEST2.QueryDocument2.0_potINT
					[340127] Router:exchange being delivered to component [bpel.process.engine]
					[340127] Start [ProcessSE.onExchange(MessageExchange)]
					[340127] End [ProcessSE.onExchange(MessageExchange)]
				[340127] End [SoapInBC.send]
			[340127] End [SoapInBinding.accept()]
		[340127] End [SoapMultiEndpointBinding.accept()]
		[340127] com.digev.fw.exception.GException: Internal Server Error {0}
	at com.soa.transport.jetty.JettyTransportBinding.reply(JettyTransportBinding.java:611)
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handle(JettyTransportBinding.java:947)
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1134)
	at com.soa.platform.jetty.management.HttpContextHandler$HandlerList.handle(HttpContextHandler.java:471)
	at com.soa.platform.jetty.management.HttpContextHandler.doHandle(HttpContextHandler.java:387)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
	at org.eclipse.jetty.server.Server.handle(Server.java:363)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.eclipse.jetty.io.EofException
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.blockWritable(SelectChannelEndPoint.java:441)
	at org.eclipse.jetty.http.AbstractGenerator.blockForOutput(AbstractGenerator.java:517)
	at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:147)
	at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
	at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
	at java.io.BufferedOutputStream.write(BufferedOutputStream.java:126)
	at com.soa.transport.stream.DecoratedOutputStream.write(DecoratedOutputStream.java:34)
	at java.util.zip.GZIPOutputStream.finish(GZIPOutputStream.java:168)
	at com.soa.transport.stream.impl.GZIPFinishOutputStream.commit(GZIPFinishOutputStream.java:30)
	at com.soa.transport.stream.impl.CountingStreamDecoratorFactory$CommitEventOutputStream.commit(CountingStreamDecoratorFactory.java:59)
	at com.soa.transport.stream.DecoratedOutputStream.commit(DecoratedOutputStream.java:26)
	at com.soa.transport.jetty.JettyTransportBinding.reply(JettyTransportBinding.java:597)
	... 23 more

		[340128] com.soa.transport.http.HttpException: HTTP Error [500:Internal Server Error] when accessing the URI [Internal Server Error {0}]
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handleError(JettyTransportBinding.java:1008)
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handle(JettyTransportBinding.java:982)
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1134)
	at com.soa.platform.jetty.management.HttpContextHandler$HandlerList.handle(HttpContextHandler.java:471)
	at com.soa.platform.jetty.management.HttpContextHandler.doHandle(HttpContextHandler.java:387)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
	at org.eclipse.jetty.server.Server.handle(Server.java:363)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

	[340128] End [com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle target [/] method [POST]]
	[340128] javax.servlet.ServletException: com.soa.transport.http.HttpException: HTTP Error [500:Internal Server Error] when accessing the URI [Internal Server Error {0}]
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1148)
	at com.soa.platform.jetty.management.HttpContextHandler$HandlerList.handle(HttpContextHandler.java:471)
	at com.soa.platform.jetty.management.HttpContextHandler.doHandle(HttpContextHandler.java:387)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
	at org.eclipse.jetty.server.Server.handle(Server.java:363)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: com.soa.transport.http.HttpException: HTTP Error [500:Internal Server Error] when accessing the URI [Internal Server Error {0}]
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handleError(JettyTransportBinding.java:1008)
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handle(JettyTransportBinding.java:982)
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1134)
	... 21 more

[340128] End [Handling request for [/]]
2024-05-01 23:23:47,261 WARN  [Jetty Transport Thread [10.115.51.155:9905]-3 - /TEST2.QueryDocument2.0] AbstractHttpConnection - /TEST2.QueryDocument2.0
javax.servlet.ServletException: javax.servlet.ServletException: com.soa.transport.http.HttpException: HTTP Error [500:Internal Server Error] when accessing the URI [Internal Server Error {0}]
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:174)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
	at org.eclipse.jetty.server.Server.handle(Server.java:363)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:486)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: javax.servlet.ServletException: com.soa.transport.http.HttpException: HTTP Error [500:Internal Server Error] when accessing the URI [Internal Server Error {0}]
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1148)
	at com.soa.platform.jetty.management.HttpContextHandler$HandlerList.handle(HttpContextHandler.java:471)
	at com.soa.platform.jetty.management.HttpContextHandler.doHandle(HttpContextHandler.java:387)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:372)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:189)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:978)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
	... 13 more
Caused by: com.soa.transport.http.HttpException: HTTP Error [500:Internal Server Error] when accessing the URI [Internal Server Error {0}]
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handleError(JettyTransportBinding.java:1008)
	at com.soa.transport.jetty.JettyTransportBinding$EntityHandler.handle(JettyTransportBinding.java:982)
	at com.soa.transport.jetty.JettyTransportBinding$JettyHandler.handle(JettyTransportBinding.java:1134)
	... 21 more
2024-05-01 23:23:47,262 DEBUG [Jetty Transport Thread [10.115.51.155:9905]-3 - /TEST2.QueryDocument2.0] AbstractGenerator - sendError on committed: 500 null
2024-05-01 23:23:47,262 DEBUG [Jetty Transport Thread [10.115.51.155:9905]-3] ChannelEndPoint - oshut SCEP@128e2a88{l(/10.70.176.45:55386)<->r(/10.115.51.155:9905),d=true,open=true,ishut=false,oshut=true,rb=false,wb=false,w=true,i=4w}-{AuditingAsyncHttpConnection@28aca174,g=AuditingHttpGenerator{s=2,h=8,b=0,c=8192},p=HttpParser{s=0,l=37,c=2830},r=1}
2024-05-01 23:23:47,262 DEBUG [Jetty Transport Thread [10.115.51.155:9905]-3] AsyncHttpConnection - Disabled read interest while writing response SCEP@128e2a88{l(/10.70.176.45:55386)<->r(/10.115.51.155:9905),d=true,open=true,ishut=false,oshut=true,rb=false,wb=false,w=true,i=4w}-{AuditingAsyncHttpConnection@28aca174,g=AuditingHttpGenerator{s=3,h=8,b=0,c=8192},p=HttpParser{s=0,l=37,c=2830},r=1}
2024-05-01 23:23:47,262 DEBUG [Jetty Transport Thread [10.115.51.155:9905]-3] nio - EOF
org.eclipse.jetty.io.EofException
	at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:914)
	at org.eclipse.jetty.http.HttpGenerator.complete(HttpGenerator.java:798)
	at org.eclipse.jetty.server.AbstractHttpConnection.completeResponse(AbstractHttpConnection.java:639)
	at com.soa.platform.jetty.management.audit.AuditingAsyncHttpConnection.completeResponse(AuditingAsyncHttpConnection.java:46)
	at org.eclipse.jetty.server.Response.complete(Response.java:1232)
	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:560)
	at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:937)
	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:998)
	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.nio.channels.ClosedChannelException
	at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:271)
	at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:460)
	at org.eclipse.jetty.io.nio.ChannelEndPoint.flush(ChannelEndPoint.java:293)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.flush(SelectChannelEndPoint.java:362)
	at org.eclipse.jetty.io.nio.ChannelEndPoint.flush(ChannelEndPoint.java:341)
	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.flush(SelectChannelEndPoint.java:336)
	at org.eclipse.jetty.http.HttpGenerator.flushBuffer(HttpGenerator.java:841)
	... 15 more
2024-05-01 23:23:47,262 DEBUG [Jetty Transport Thread [10.115.51.155:9905]-3] ChannelEndPoint - close SCEP@128e2a88{l(/10.70.176.45:55386)<->r(/10.115.51.155:9905),d=true,open=true,ishut=false,oshut=true,rb=false,wb=false,w=true,i=4w}-{AuditingAsyncHttpConnection@28aca174,g=AuditingHttpGenerator{s=3,h=8,b=-1,c=8192},p=HttpParser{s=0,l=37,c=2830},r=1}

Can you please provide your insights on this issue?
@sbordet
Copy link
Contributor

sbordet commented May 3, 2024

The version of Jetty you are using is from more than 11 years ago.

Please contact Webtide for commercial support.

@joakime
Copy link
Contributor

joakime commented May 3, 2024

Note: all versions of Jetty up to Jetty 11 are now either at End of Life or End of Community Support.

@joakime joakime closed this as not planned Won't fix, can't repro, duplicate, stale May 3, 2024
@gjoshi86
Copy link
Author

gjoshi86 commented May 3, 2024

@joakime @sbordet I know its end of life. I just need insights on what is the issue here and did this issue got fixed in later versions of Jetty?

@sbordet
Copy link
Contributor

sbordet commented May 3, 2024

@gjoshi86 try to understand that to help you we need to resuscitate an 11 years old version of Jetty, and troubleshoot your issue, allocating time and resources.

And maybe it's not even an issue, it is normal behavior of a client closing a connection.

Please update to Jetty 12 and report back if you still have the issue.

@joakime
Copy link
Contributor

joakime commented May 3, 2024

There are tens of thousands of commits, and 6 major version releases of Jetty, since Jetty 7.6.x. You are also using a version of Jetty that is even 4 revisions of the HTTP/1 spec behind. So much has changed in the general Internet and browsers that supporting your version of Jetty is very difficult.

Your version of Java (1.8_292) is also MANY versions behind even the current SSL/TLS changes that are considered baseline in today's modern world. (As in bare bones minimum requirements for today's internet)

All we can say is that people using up to date code/versions/java do not report your problems.

If you want more detailed answers, or support for your version of Jetty you need paid support due to the time and effort needed to support your old version of Jetty.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Question
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@joakime @sbordet @gjoshi86