Errors running patrol tests on different iOS version simulators

[chrisfrey-gp]

Hello all, wondering if anyone else has experienced this issue...I am trying to run my patrol tests on iOS simulators with older versions of OS and I get a failure to run on any simulator running an os that is older than the latest OS runtime on my system.

For example, I have the following os runtimes installed:

• iOS 16.0 (16.0 - 20A360) - com.apple.CoreSimulator.SimRuntime.iOS-16-0
• iOS 16.2 (16.2 - 20C52) - com.apple.CoreSimulator.SimRuntime.iOS-16-2
• iOS 16.4 (16.4 - 20E247) - com.apple.CoreSimulator.SimRuntime.iOS-16-4

If I create a simulator with 16.4, Patrol builds and runs the tests successfully on the device. However if I create a simulator with os 16.2 or 16.0, Patrol builds but fails to run the tests with the following error, even though the simulator running is listed in the list below (platform:iOS Simulator, id:5390059D-9D4A-4339-971D-2FF8BF3D2B41, OS:16.2, name:goDriveTestDevice):

	--- xcodebuild: WARNING: Using the first of multiple matching destinations:
	{ platform:macOS, arch:x86_64h, id:509C4268-2F98-56FD-91BB-D14B5FA12F93 }
	{ platform:macOS, arch:x86_64, id:509C4268-2F98-56FD-91BB-D14B5FA12F93 }
	{ platform:macOS, arch:x86_64h, variant:Mac Catalyst, id:509C4268-2F98-56FD-91BB-D14B5FA12F93 }
	{ platform:macOS, arch:x86_64, variant:Mac Catalyst, id:509C4268-2F98-56FD-91BB-D14B5FA12F93 }
	{ platform:macOS, arch:x86_64h, variant:DriverKit, id:509C4268-2F98-56FD-91BB-D14B5FA12F93 }
	{ platform:macOS, arch:x86_64, variant:DriverKit, id:509C4268-2F98-56FD-91BB-D14B5FA12F93 }
	{ platform:iOS, id:dvtdevice-DVTiPhonePlaceholder-iphoneos:placeholder, name:Any iOS Device }
	{ platform:iOS Simulator, id:dvtdevice-DVTiOSDeviceSimulatorPlaceholder-iphonesimulator:placeholder, name:Any iOS Simulator Device }
	{ platform:macOS, name:Any Mac }
	{ platform:macOS, variant:Mac Catalyst, name:Any Mac }
	{ platform:tvOS, id:dvtdevice-DVTiOSDevicePlaceholder-appletvos:placeholder, name:Any tvOS Device }
	{ platform:tvOS Simulator, id:dvtdevice-DVTiOSDeviceSimulatorPlaceholder-appletvsimulator:placeholder, name:Any tvOS Simulator Device }
	{ platform:watchOS, id:dvtdevice-DVTiOSDevicePlaceholder-watchos:placeholder, name:Any watchOS Device }
	{ platform:watchOS Simulator, id:dvtdevice-DVTiOSDeviceSimulatorPlaceholder-watchsimulator:placeholder, name:Any watchOS Simulator Device }
	{ platform:iOS Simulator, id:5390059D-9D4A-4339-971D-2FF8BF3D2B41, OS:16.2, name:goDriveTestDevice }
	{ platform:iOS Simulator, id:AC7E4C1F-18BF-469E-8333-C07F050C41BF, OS:16.2, name:goDriveTestDevice16.2 }
	{ platform:iOS Simulator, id:63AF47C6-EE8E-4EDE-8253-4DD7F4AAD796, OS:16.4, name:iPad (10th generation) }
	{ platform:iOS Simulator, id:28E5FD30-24AB-4701-B32A-E83C50F95DF8, OS:16.4, name:iPad Air (5th generation) }
	{ platform:iOS Simulator, id:07F7908F-0F87-4AEB-A9C5-0F7C31C010A6, OS:16.4, name:iPad Pro (11-inch) (4th generation) }
	{ platform:iOS Simulator, id:79ABD4A5-5F99-437F-A0E6-52D61AF6F33E, OS:16.4, name:iPad Pro (12.9-inch) (6th generation) }
	{ platform:iOS Simulator, id:EEBDE5BA-3845-4C82-973E-C1A87B63EB7C, OS:16.4, name:iPad mini (6th generation) }
	{ platform:iOS Simulator, id:2194E24A-EC10-4B23-B638-008DFE6D0E4E, OS:16.4, name:iPhone 14 }
	{ platform:iOS Simulator, id:6A71B197-2265-4C9B-960B-91E2D27FCA6A, OS:16.4, name:iPhone 14 Plus }
	{ platform:iOS Simulator, id:D22B6B35-29B9-4994-925F-01157702048D, OS:16.4, name:iPhone 14 Pro }
	{ platform:iOS Simulator, id:3098B682-3650-4B33-A773-9C73F26AED00, OS:16.4, name:iPhone 14 Pro Max }
	{ platform:iOS Simulator, id:45282948-F260-46B3-8588-45DC79D32E08, OS:16.4, name:iPhone SE (3rd generation) }
	2023-08-24 10:04:33.900 xcodebuild[42113:5187067] [MT] IDETestOperationsObserverDebug: 15.248 elapsed -- Testing started completed.
	2023-08-24 10:04:33.900 xcodebuild[42113:5187067] [MT] IDETestOperationsObserverDebug: 0.000 sec, +0.000 sec -- start
	2023-08-24 10:04:33.900 xcodebuild[42113:5187067] [MT] IDETestOperationsObserverDebug: 15.248 sec, +15.248 sec -- end
	Testing failed:
		Could not launch “RunnerUITests”
		RunnerUITests-Runner encountered an error (Failed to install or launch the test runner. If you believe this error represents a bug, please attach the result bundle at /Users/christopher.frey/development/learning/flutter_app_playground/build/ios_results_1692885824338.xcresult. (Underlying Error: Could not launch “RunnerUITests”. The LaunchServices launcher has returned an error. Please check the system logs for the underlying cause of the error. (Underlying Error: The operation couldn’t be completed. (OSStatus error -10661.))))
	
	** TEST EXECUTE FAILED **

I've tried passing the --device tag with my simulator name to the Patrol test command, but still the same build error.

Has anyone seen this before? Please help!

My current setup is:

• macOS Ventura 13.3
• Xcode 14.3.1
• Patrol 2.1.0

[Noxiver]

Hello you resolved this problem?
If yes, how you resolved it?

[chrisfrey-gp]

I have not. I punted on it for now to focus on finishing the rest of my implementaion. But I will need to go back to the issue soon. If I resolve it I will let you know.

[Noxiver]

it's sad, cuz patrol team doesn't fix this yet

[AnthonyDadeWT]

I am also facing this issue with iOS 17.0 ... I cannot run on any iOS below that version.

[fylyppo]

Related to #1441

[Noxiver]

i got this error on last IOS version...