AI Insight Packs
Purpose
AI Insight Packs are reusable monitoring definitions that collect selected operational evidence, apply a materiality gate, and produce a compact digest. Run a pack on demand while investigating a workload, or schedule it to watch for meaningful changes without sending a notification for every uneventful run.
Application route: /insights (section routes may appear as /insights/:section).
Common use cases
- Summarize recent workload changes and highlight security-sensitive operations.
- Watch retirement, cost, identity, policy, backup, RBAC, or assessment signals.
- Produce a recurring operations or leadership digest.
- Test a monitoring idea against a real workload before scheduling it.
- Group related packs into collections and pin important packs.
Prerequisites, permissions, and data
| Requirement | Detail |
|---|---|
| Read access | insights.read to view packs, templates, digests, health, and schedules. |
| Authoring | insights.write to create, edit, clone, enable, snooze, pin, organize, and update read state. |
| Execution | insights.run to start on-demand runs. |
| Scope | A workload or supported scope with accessible evidence. |
| AI | A configured AI provider is needed for interviews, generation, refinement, and narrative synthesis. |
| Sources | Packs can use adapters backed by Change Explorer, Retirement Radar, cost, RBAC, assessments, backup, identity, and policy data. Availability depends on configured connections and prior scans. |
| Scheduling | The automation scheduler must be running for recurring execution; notification connectors are required for external delivery. |
Library and detailed actions
The library presents saved packs and starter templates. From a pack, you can:
- open or edit its definition;
- clone it before making a variant;
- enable or disable it;
- snooze it temporarily;
- pin it and add it to collections;
- open Run / Schedule;
- review recent runs, unread material digests, health, and upcoming executions.
AI generator wizard
The guided flow is Goal → AI interview → Generate → Preview & save.
- Describe what the pack should watch and who needs the result.
- Answer the AI interview questions about source, scope, lookback, materiality, and output.
- Generate a draft and inspect every field.
- Choose a workload for a live preview. Preview runs are read-only and do not notify.
- Refine, regenerate, or save the pack.
The editor provides Preview, Sample, and Review tabs. AI examples are explicitly illustrative; a real test run uses current accessible evidence. Validation issues must be resolved before save.
Run and schedule
In Run / Schedule, choose the intended scope, lookback, notification behavior, cadence, time, and time zone. An on-demand run continues server-side if the dialog is closed; its durable result appears in recent run history. For a scheduled pack, verify the displayed next-run time and time zone before enabling it.
Workflow
- Start from a template or select Generate with AI.
- Define a narrow operational question and evidence sources.
- Preview against a non-sensitive workload.
- Check that normal evidence produces Nothing notable and meaningful evidence produces Notable or Urgent.
- Save, select the production scope, and configure the schedule.
- Run once on demand before enabling notifications.
- Review digest history and tune noisy criteria or weak source coverage.
Interpret a digest
A digest shows the pack and scope, evidence lookback, headline, bullets, structured rows, counts, notification state, and materiality-gate reason.
- Nothing notable means the collected evidence did not cross the pack’s materiality threshold. It does not prove that no issue exists.
- Notable indicates review-worthy evidence.
- Urgent indicates the highest pack verdict and should follow the organization’s triage process.
- AI degraded means narrative generation failed and a deterministic summary was used. Inspect source rows rather than relying on prose.
- Notified confirms that the run crossed notification rules and delivery was requested; use connector delivery logs to confirm external receipt.
Exports, history, and integrations
- Open a saved run from recent history; material runs can be marked read, and all can be marked read in bulk.
- Download a run as a PDF when a portable digest is required.
- Scheduled packs integrate with the automation scheduler and configured notification channels such as Teams, Slack, email, or in-app notifications.
- Source data is drawn from other product modules; refresh those modules when a digest reports stale or missing coverage.
Safety and limitations
- Pack runs are observational, but their conclusions are only as complete as the selected sources and current caches.
- AI can omit context, overstate causality, or produce an unsuitable threshold. A human must approve pack definitions and urgent escalation logic.
- An illustrative sample is synthetic and must not be treated as evidence.
- Closing a run dialog does not cancel the background job.
- Disabling a pack and removing its schedule are different concerns; verify both when retiring a watcher.
- Do not place secrets, credentials, or sensitive personal information in goals, prompts, pack instructions, or notification text.
Troubleshooting
| Symptom | Checks |
|---|---|
| No evidence in a run | Confirm scope, source adapters, connection access, prior source scans, and lookback duration. |
| Pack is too noisy | Raise or narrow the materiality criteria, reduce sources, test again, or snooze while tuning. |
| Scheduled run did not occur | Check that the pack and schedule are enabled, verify time zone/next-run time, and inspect scheduler run history. |
| No external notification | Confirm the verdict crossed the gate, notifications were enabled, and the connector is configured and healthy. |
| AI generation fails | Confirm the AI provider is available; retry, author manually, or use the deterministic run output. |
| Run appears stuck | Close and reopen recent runs; background execution continues, and final state is persisted. |