Skip to content

ci(release): notify duty engineers of prerelease failures - #4134

Open
purp wants to merge 4 commits into
NVIDIA:mainfrom
purp:ci/4132-prerelease-slack-notify/purp
Open

purp wants to merge 4 commits into
NVIDIA:mainfrom
purp:ci/4132-prerelease-slack-notify/purp

Conversation

@purp

@purp purp commented Oct 2, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Send a Slack notification when a Release Tag prerelease attempt fails, with a configurable mention and a link to that attempt. Notifications are best effort and skip cleanly while the webhook is unset.

Notifications are sent to the triage channel via a webhook specified in SLACK_OPENSHELL_TRIAGE_WEBHOOK_URL and will at-mention the triage engineer so that they can respond. The webhook and mention are stored in repository secrets; the mention uses SLACK_OPENSHELL_TRIAGE_MENTION.

Related Issue

Closes #4132

Changes

  • Add a failure notification job covering all prerelease build, qualification, and publication dependencies; successful attempts and stable releases do not notify.
  • Include the prerelease tag, attempt number, failed run link, and mention from the SLACK_OPENSHELL_TRIAGE_MENTION secret. An unset mention secret still sends the notification.
  • Use the reusable SLACK_OPENSHELL_TRIAGE_WEBHOOK_URL secret, a clean missing-secret skip, bounded delivery timeouts, and continue-on-error.
  • Document setup and behavior in CI.md.

Testing

  • Scoped checks pass: actionlint, ShellCheck for the notification script, and git diff --check.
  • Repository pre-commit hook passes, including Markdown lint, formatting, license checks, and Rust lint.
  • Local HTTP checks verify missing-secret skip, JSON payload, configured group and replacement user mentions, unset mention, attempt link, and HTTP failure handling. No message was sent to Slack.
  • Dependency inspection covers all 21 prerelease jobs and confirms no release job waits for the notifier; focused code review passed.
  • Offline Zizmor comparison has no new high-severity findings; the same three existing ci:latest image warnings appear on the base.
  • Unit/E2E suites are not applicable to this workflow-only change. Live Slack delivery was not tested.

Checklist

  • Follows Conventional Commits
  • Commits are signed off (DCO)
  • Architecture documentation is not applicable; CI setup documentation is updated.

Signed-off-by: Jim Meyer <jimeyer@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Oct 2, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

purp added 3 commits October 2, 2026 09:07
Signed-off-by: Jim Meyer <jimeyer@nvidia.com>
Signed-off-by: Jim Meyer <jimeyer@nvidia.com>
Signed-off-by: Jim Meyer <jimeyer@nvidia.com>
@purp
purp marked this pull request as ready for review October 2, 2026 17:13
@purp
purp requested review from a team, derekwaynecarr, mrunalp and sjenning as code owners October 2, 2026 17:13
@purp
purp added this pull request to the merge queue Oct 2, 2026
@github-merge-queue
github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Oct 2, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ci: notify duty engineers when an OpenShell prerelease fails

2 participants