mirror of
https://github.com/certbot/certbot.git
synced 2026-07-27 00:00:44 +02:00
test-split-launchpad-yes-python
2
Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
|
|
cb02885928 |
Migrate release pipeline from azure to github actions (#10643)
Related to https://github.com/certbot/certbot/issues/10581 Following up on https://github.com/certbot/certbot/pull/10631, https://github.com/certbot/certbot/pull/10622, and https://github.com/certbot/certbot/pull/10634, this PR converts the release [pipeline](https://dev.azure.com/certbot/certbot/_build?definitionId=3) from Azure to Github Actions. While this is the last migration PR, I don't think we should close the issue, as we're still using launchpad for armhf builds. I plan to continue investigating that and at minimum write up my findings. To test [notifications](https://opensource.eff.org/eff-open-source/pl/nfgh6obi8tfqikn4ydp7dshakr) and creating a [github release](https://github.com/ohemorange/Things-that-are-gr9/releases/tag/v1.0.19), I ran workflows that no-oped most the other jobs [in a test repo](https://github.com/ohemorange/Things-that-are-gr9/actions/runs/25938082721) (I've made minor changes to names and comments since then, but no code changes). Everything else is basically the same as nightly, with different tags. For the docker deployment, `${{ github.ref_name }}` is the tag name, so `v1.2.3`. Why not parametrize the tests a bit more, by putting an `env` at the top with `dockerTag: ${{ github.ref_name }}` and `snapReleaseChannel: beta`? Because the `env` context is [not available](https://docs.github.com/en/actions/reference/workflows-and-actions/contexts#context-availability) to `with`; only `github, needs, strategy, matrix, inputs, vars`. We could use `vars`, by creating `docker_tag_release` or whatever in the [variable section](https://github.com/certbot/certbot/settings/variables/actions) of the repo settings by using the web interface, but that seems worse to me than having it in the file but twice. You will note that the contents of `release.yml` are very similar to `nightly.yml`. While it would be nice to factor that out and reuse the code, github actions would then flatten everything in the grouped code together, making the results much harder to check. You can see what that flattening would look like [here](https://github.com/ohemorange/Things-that-are-gr9/actions/runs/25941524972) (if we put them all in one workflow). Currently, it will look something like [this](https://github.com/certbot/certbot/actions/runs/25688414262), which is much more readable. We could split it into "stages" like we had in azure pipelines (probably 1. standard and extended tests (and changelog?), 2. snap package and deploy (depend on tests), 3. docker package and deploy (depend on tests), 4. github release (depend on snap package and deploy), 5-6. notify (depend on github release)), but in addition to a minor slowdown (currently github release only depends on snap and docker package, not deploy, just so we're trying to do all the deployments simultaneously and not partially in case of build failures), it would still be only like three fewer jobs, since we'd still want all the info passing and dependency relationships. While it would be nice from a UX perspective to group the two notification jobs together, you can't do that cleanly using the built-in `if` key, and I don't think it's worth switching to a messier github api-based version just to group them. For mattermost notifications, we currently get the person to tag by running `AUTHOR_NAME="$(git log -1 --pretty=format:'%an')"` and mapping that to mattermost username. We could instead use `github.actor` to get the github handle, and map that instead. I didn't bother since we already have working, tested code, but can if a reviewer thinks it's worth it. --------- Co-authored-by: Will Greenberg <willg@eff.org> Co-authored-by: Brad Warren <bmw@users.noreply.github.com> |
||
|
|
1efd73e064 |
Migrate nightly test pipeline from azure pipelines to github actions (#10634)
Related to https://github.com/certbot/certbot/issues/10581 Following up on #10631 and https://github.com/certbot/certbot/pull/10622, this PR converts the `nightly` [pipeline](https://dev.azure.com/certbot/certbot/_build?definitionId=5) from Azure to Github Actions. `schedule` and `workflow_dispatch` triggers only work on merged branches, not PRs. To see these tests running, I temporarily added a `push` trigger in commit [a2e9c43](https://github.com/certbot/certbot/pull/10634/commits/a2e9c4303e4a9549562aaa460f15787020f25d0d). You can see the results of those tests [here](https://github.com/certbot/certbot/actions/runs/25688414262). I did not split each file into its own commit this time because I feel like the general idea is clear. The relevant files in azure pipelines to reference are: - the deleted `.azure-pipelines/nightly.yml` --> `.github/workflows/nightly.yml` - `.azure-pipelines/templates/jobs/common-deploy-jobs.yml` --> `.github/workflows/deploy_docker_images.yml` and `.github/workflows/deploy_snaps.yml` - `.azure-pipelines/templates/stages/changelog-stage.yml` --> `.github/workflows/create_changelog.yml` I chose to split `common-deploy-jobs` into `deploy_docker_images` and `deploy_snaps`. This is because the docker arm32v6 build takes a long time, but uploading to docker is quick, while the armhf snaps build varies but is often quicker, but uploading the snaps can take some time. By splitting them, we can specify the dependencies more precisely, and hopefully shave some time off the total. Without the split, tests took [53 minutes total](https://github.com/certbot/certbot/actions/runs/25684264622). After the split, tests took [33 minutes total](https://github.com/certbot/certbot/actions/runs/25688414262)! As before, the "nightly deploy stage" from azure has been omitted for clarity. `rerun.yml` did not exist before. There's not a great built-in way to rerun individual jobs in github actions, which I wanted for the snap builds specifically, since other timeouts can still happen. I could have made an action or additional workflow and wrapped that in a script to retry it, but I figured actually it's nicer to have the ability to rerun anything. This is equivalent to clicking "rerun all failed jobs," which I feel is usually what we want. Unfortunately, I am pretty sure that to test it, the rerun script will need to be merged first, since it relies on `workflow_dispatch`. You can see that packages were successfully uploaded to [dockerhub](https://hub.docker.com/r/certbot/certbot/tags) and the [snap store](https://dashboard.snapcraft.io/stores/snaps/); looking at the timestamps is probably the easiest way to confirm (about 11:45am Monday). |