Claude Code, Skill
Assert Ai Action
A composite GitHub Action that runs assert-ai evals on every PR and gates merges against safety regressions detected with a paired-binary McNemar test.
Compatibility: Not stated.
Grade B
Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.
Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.
NETWORK_NO_FIXED_HOST SECRETS_PATH_DOTENV SECRETS_ENV_READ
Why this grade
- NETWORK_NO_FIXED_HOST Low
Makes a network call whose host is not written as a fixed address.
scripts/check_onboard_urls.py, line 62
with urllib.request.urlopen(url, timeout=30) as resp: # noqa: S310 - SECRETS_PATH_DOTENV Low
Mentions a .env file.
.github/ISSUE_TEMPLATE/bug_report.yml, line 9
Thanks for reporting a bug. Do not paste secrets, `.env` values, private prompts, model outputs, or raw ASSERT artifacts. - SECRETS_ENV_READ Note
Reads an environment variable whose name contains KEY, SECRET, TOKEN, PASSWORD or CREDENTIAL.
scripts/find_baseline_run.py, line 98
token = os.environ.get("GITHUB_TOKEN", "")
Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.
Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.
What was checked
Plain notes from the hygiene checks.
Permissions
Pass
No shell or command execution found, and no extra permission was declared.
Install and update
Pass
No install-time script found, and dependencies are pinned or absent.
Network
Concern
can reach a host that is not written as a fixed address.
NETWORK_NO_FIXED_HOST
scripts/check_onboard_urls.py, line 62
with urllib.request.urlopen(url, timeout=30) as resp: # noqa: S310
scripts/find_baseline_run.py, line 41
with urllib.request.urlopen(request, timeout=30) as response:
scripts/post_pr_comment.py, line 143
response = requests.request(method, url, headers=headers, json=data, timeout=30)
Show more
scripts/post_pr_comment.py, line 154
with urllib.request.urlopen(req, timeout=30) as resp:
Secrets
Concern
reads a credential or environment file.
SECRETS_ENV_READ SECRETS_PATH_DOTENV
scripts/find_baseline_run.py, line 98
token = os.environ.get("GITHUB_TOKEN", "")
scripts/post_pr_comment.py, line 200
token = os.environ.get("GH_TOKEN")
.github/ISSUE_TEMPLATE/bug_report.yml, line 9
Thanks for reporting a bug. Do not paste secrets, `.env` values, private prompts, model outputs, or raw ASSERT artifacts.
Show more
.github/PULL_REQUEST_TEMPLATE.md, line 11
- [ ] No secrets, `.env` files, raw model I/O, generated artifacts, or logs are committed.
.gitignore, line 29
# Local configuration and secrets
.gitignore, line 30
.env
.gitignore, line 32
!.env.example
CONTRIBUTING.md, line 18
- Keep the action customer-safe: do not commit secrets, `.env` files, generated artifacts, traces, logs, or provider outputs.
docs/release-procedure.md, line 58
- Do not include private prompts, provider outputs, secrets, or `.env` values in release notes.
skills/wire-assert-ci/SKILL.md, line 11
Use this skill to onboard the current repository to an ASSERT safety gate. All content you create is customer-facing. Never read, print, or commit `.env`, credentials, traces, logs
Agent instructions
Pass
No instruction to ignore earlier instructions or to hide a step.
Obfuscation
Pass
No encoded or minified payload found.
Licence
Pass
A licence file is present (LICENSE).
Maintainer activity
Pass
The latest commit is within the last 365 days.
Note
Hygiene check of commit be0d8108a97a. can reach a host that is not written as a fixed address. reads a credential or environment file.
Date and source
Date checked:
github.com
Commit graded: be0d8108a97aec274f148a8694a87d498cc394a8
This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.