Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

macOS consistently failing on the CI for a number of tests #9538

Open
russellwheatley opened this issue Sep 15, 2022 · 1 comment
Open

macOS consistently failing on the CI for a number of tests #9538

russellwheatley opened this issue Sep 15, 2022 · 1 comment
Assignees
Labels
platform: macos Issues / PRs which are specifically for MacOS.

Comments

@russellwheatley
Copy link
Member

russellwheatley commented Sep 15, 2022

First macOS CI test failure: https://github.com/firebase/flutterfire/actions/runs/3045676242/jobs/4907530924

The last successful macOS test run: https://github.com/firebase/flutterfire/actions/runs/3044555313/jobs/4905079521

Note: The test environment is the exact same.
Both running on the same image: https://github.com/actions/runner-images/releases/tag/macOS-11%2F20220906.1

You can see the environment here: https://github.com/actions/runner-images/blob/macOS-11%2F20220906.1/images/macos/macos-11-Readme.md

No changes to FlutterFire nor the firebase-ios-sdk on this date that would make the following tests fail:

Screenshot 2022-09-26 at 14 27 32

Screenshot 2022-09-26 at 14 27 40

A few things worth noting:

4 tests have the error code SecItemAdd (-34018) which is a keychain sharing entitlement error code. Testing locally shows the other 2 tests are failing because of SecItemDelete error which is associated with keychain access.

2 of the plugins with failing API affected rely on App Installations whilst the other plugin with failing API is App Installations.

See this table

I suspect the issue lies with this product.

We will keep this issue open until there is a change in the environment that sees this error disappear.

Ran the failing API locally and received the same error. Once keychain sharing capability was included on the test app, the tests passed. See console logs:
Screenshot 2022-09-26 at 15 05 28

In another Keychain access issue, users are expected to include keychain sharing capability in their target.

@russellwheatley russellwheatley self-assigned this Sep 15, 2022
@darshankawar darshankawar added triage Issue is currently being triaged. and removed triage Issue is currently being triaged. labels Sep 15, 2022
@russellwheatley
Copy link
Member Author

Key chain sharing capability is also needed for firebase_auth on macOS.

I've create an issue on the Flutter repo which may solve the problem: flutter/flutter#121702

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
platform: macos Issues / PRs which are specifically for MacOS.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants