Skip to content

chore(ci): remove the firestore flake probe workflow - #795

Open
tyler-reitz wants to merge 1 commit into
FirebaseExtended:mainfrom
tyler-reitz:chore/remove-flake-probe
Open

chore(ci): remove the firestore flake probe workflow#795
tyler-reitz wants to merge 1 commit into
FirebaseExtended:mainfrom
tyler-reitz:chore/remove-flake-probe

Conversation

@tyler-reitz

Copy link
Copy Markdown
Contributor

Why

.github/workflows/flake-probe.yaml was added in #780 to measure the firestore flake in #776. #776 is now closed, so the probe has done its job.

Verified while the file still exists, since afterwards neither claim can be checked without going back to this branch: it is workflow_dispatch only, and nothing outside the file references it. Removing it therefore changes no scheduled or PR-triggered behaviour, and it cannot orphan a required status check (main requires cla/google, Build, Test Node.js 22 (Ubuntu) and Test Node.js 24 (Ubuntu)).

On #783's removal conditions

They were written when the @grpc/grpc-js override was still the candidate fix, so the checklist asks for the probe to be re-run "if the override lands". It never landed: the override was measured at 5/60 against a 4/60 baseline, Fisher p = 1.0.

The conditions are met by a different route. The fix was #791's timeout ceilings, and the probe is what verified it: 0/60 flakes against an 11/60 baseline (p = 0.0006), with the desync rate statistically unchanged at 13/60 against 19/60. Five iterations show the rescue directly, passing at ~9.8s where the old 1000ms waitFor budget gave up. Full result on #776.

Closes #783

The probe was added in FirebaseExtended#780 as a temporary measurement tool for FirebaseExtended#776, which
is now closed. It has no callers: nothing outside the file referenced it, and
it was workflow_dispatch only, so removing it changes no scheduled or
PR-triggered behaviour.

FirebaseExtended#783's removal conditions were written when the @grpc/grpc-js override was
still the candidate fix. That override was measured and did not work (5/60 vs
4/60, Fisher p = 1.0), so it never landed. The fix was FirebaseExtended#791's timeout
ceilings instead, and the probe verified it: 0/60 flakes against an 11/60
baseline, with the desync rate statistically unchanged.

Closes FirebaseExtended#783
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove the firestore flake probe workflow once #776 is resolved

1 participant