Description

Users currently receive two types of notifications related to prebuilds:

• Manual Build Failed (per prebuild instance): Sent when a workspace build initiated by prebuilds fails. If an issue affects a template, all associated prebuilt instances fail, resulting in multiple notifications (one per instance).
• Prebuilt Hard Limit Reached (per template and preset): Sent when the number of failed prebuild attempts reaches the hard limit for a specific (template, preset) pair.

Problem

Due to multiple prebuild instances, users can receive an excessive number of notifications during widespread failures, leading to notification fatigue.

Proposed solution

• Investigate current notification behavior, especially if and how notifications can be grouped for both failure types.
• Assess whether grouping notifications by (template, preset) is the optimal approach.
• Explore possible improvements to reduce noise, such as batching multiple failures into a single notification including all affected instances and introducing a wait window for aggregation.