Agent Native

signals-scout-inbox-validation

This skill validates that merged fixes for resolved reports actually resolved the underlying problems.

by PostHogOfficial publisherNot reviewed

Identity proven by GitHub's verified organisation badge (PostHog)

Agents
Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode
License
No license stated
Pin
e0fbf5epinned Oct 9, 2026
Context cost
about 7,900 tokenswhen the skill loads
GitHub stars
88on posthog/ai-plugin
Scripts
None found

What it does

“Follow-up Signals scout for the inbox itself. Attaches a check to each newly resolved report, spot-checks a couple of settled fixes with fresh probes, answers the checks it is dispatched for, and reports when a fix didn't hold, plus a gated escalation check on dismissed reports.”
The author's description, from SKILL.md

Generated summary from the skill's own text

This skill validates that merged fixes for resolved reports actually resolved the underlying problems. It attaches validation checks to newly resolved reports, re-measures whether the issue fires at pre-fix rates after a soak window, and authors new reports when fixes failed to hold or problems recurred under different conditions.

When to use it

  • Verifying that shipped code fixes stopped recurring errors or issues in production
  • Detecting failed fixes that need follow-up despite merged pull requests
  • Validating dismissed or suppressed reports whose problems are escalating again
  • Confirming fixes held across error tracking, logs, experiments, and performance metrics

When not to

  • Detecting new problems not already linked to resolved reports
  • Verifying client-side or mobile fixes faster than typical deployment windows
  • Validating fixes without access to pre-merge baseline measurements or post-merge telemetry

Install

No license stated: install from the publisher's repository, and ask the author before you reuse or share it.

These commands install from the publisher's repository and need no account.

skills CLI

npx skills add posthog/ai-plugin --skill signals-scout-inbox-validation

Installs from the repository's default branch, which may have changed since the commit we checked.

GitHub CLI 2.90 or later

gh skill install posthog/ai-plugin signals-scout-inbox-validation@e0fbf5e742fb4242c4ea509b395b2e343642f0b7

Installs the commit we checked (e0fbf5e).

Copy by hand

Download the folder at e0fbf5e and put it in .claude/skills/signals-scout-inbox-validation for Claude Code and in .agents/skills/signals-scout-inbox-validation for Codex, Cursor, Gemini CLI, GitHub Copilot and OpenCode.

Skill folder on GitHub at e0fbf5e

Claude Code plugin

/plugin install posthog@claude-plugins-official

The publisher's plugin in Claude's official marketplace. It may hold more than this skill, and we have not pinned it.

Copy for your agent

A prompt for any coding agent. It installs this skill from GitHub at the pinned commit, copies the files as they are, and runs nothing unless you ask.

Prompt

Install the agent skill "signals-scout-inbox-validation" by PostHog.

Source, pinned to commit e0fbf5e742fb4242c4ea509b395b2e343642f0b7:
https://github.com/posthog/ai-plugin/tree/e0fbf5e742fb4242c4ea509b395b2e343642f0b7/skills/signals-scout-inbox-validation

1. Download that folder at exactly this commit. Do not use the default branch.
2. Copy every file unchanged, keeping the folder structure, into .claude/skills/signals-scout-inbox-validation/ for Claude Code and .agents/skills/signals-scout-inbox-validation/ for Codex, Cursor, Gemini CLI, GitHub Copilot and OpenCode. Create the folders if they do not exist.
3. Do not edit the files, and do not run any script in the folder unless I ask you to.
4. When you are done, list the files you copied and where you put them.

Its license is restricted or not stated. Show me the license terms from the repository before you copy anything.

Listing and checks: https://www.agentnative.dev/skills/posthog/signals-scout-inbox-validation

SKILL.md at the pin

The license of this skill does not let us show its files here.

View SKILL.md on GitHub at e0fbf5e

Files

1 file, 33 KB in total. Each file has a sha256 in the pin's manifest; the first 12 characters are shown.

Skill folder on GitHub at e0fbf5e
All 50 skills from PostHog

More from PostHog

  • analyzing-experiment-session-replays

    This skill enables agents to analyze session recordings from experiment variants to identify behavioral differences between control and test groups.

    Claude Code, Codex, Cursor +4 · about 2.3K tokens · pinned 6 days ago

  • analyzing-offline-evaluations

    This skill inspects and compares offline AI evaluation experiments stored in PostHog, diagnoses case-level regressions, and tracks scorer changes across…

    Claude Code, Codex, Cursor +4 · about 1.5K tokens · pinned 6 days ago

  • auditing-warehouse-view-health

    Audits materialized views in a PostHog data warehouse to identify failed views and flag unused ones that waste compute resources.

    Claude Code, Codex, Cursor +4 · about 1.4K tokens · pinned 6 days ago

  • authoring-data-quality-checks

    This skill adds data quality checks (like dbt tests) on warehouse tables, views, and HogQL metrics, supporting assertions such as not-null, uniqueness…

    Claude Code, Codex, Cursor +4 · about 2.5K tokens · pinned 6 days ago

  • authoring-scouts

    This skill helps engineers write, edit, and adapt PostHog Signals scouts, scheduled agents that scan projects and report findings to an inbox.

    Claude Code, Codex, Cursor +4 · about 10.6K tokens · pinned 6 days ago

  • building-a-dashboard

    This skill constructs or modifies PostHog dashboards by selecting and arranging insight tiles.

    Claude Code, Codex, Cursor +4 · about 2.1K tokens · pinned 6 days ago

All Observability skills

Related in Observability

  • signals-scout-feature-flags

    This skill monitors PostHog feature flags for evaluation anomalies and cleanup opportunities.

    by PostHogOfficial publisher

    Claude Code, Codex, Cursor +3 · about 13.4K tokens · pinned 6 days ago

  • signals-scout-inbox-validation

    This skill validates that merged fixes actually resolve the reported problems by re-measuring the underlying metrics after a soak period, attaches…

    by PostHogOfficial publisher

    Claude Code, Codex, Cursor +3 · about 8.4K tokens · pinned 6 days ago

  • signals-scout-replay-vision

    This skill monitors PostHog Replay Vision scanners to detect when observation throughput drops unexpectedly and to surface aggregate patterns across sessions…

    by PostHogOfficial publisher

    Claude Code, Codex, Cursor +3 · about 7.9K tokens · pinned 6 days ago

  • azure-diagnostics

    The skill diagnoses Azure production issues across App Service, Functions, Container Apps, AKS, VMs, and Messaging services using AppLens, Azure Monitor…

    by MicrosoftOfficial publisher

    Contains scripts

    Claude Code, Codex, Cursor +3 · about 1.6K tokens · pinned 6 days ago

  • debugging-mwaa-workflow

    Diagnoses root causes of Amazon MWAA workflow failures in both Provisioned (Python DAG) and Serverless (YAML) environments using AWS CLI commands and…

    by Amazon (AWS)Official publisher

    Claude Code, Codex, Cursor +4 · about 2.1K tokens · pinned 6 days ago

  • sentry-fix-issues

    This skill helps agents find and fix production issues reported in Sentry by analyzing stack traces, breadcrumbs, traces, and event context through Sentry's…

    by SentryOfficial publisher

    Claude Code · about 1.8K tokens · pinned 6 days ago

The skills listed here are third-party software, collected from public GitHub repositories as a catalog of recent skills and provided as is. Agent Native does not write or control them and is not responsible for any harm, loss or damage caused by installing or using them. Labels and checks describe what we saw at one commit and are not a guarantee. Read a skill's files before you run it. Terms of use