Claude Code, Skill
Pixie Qa
Pixie-QA is an agent skill that let your coding agent to systematically improve the quality of your AI application with Evaluation Driven Development (EDD) approach.
Compatibility: Not stated.
Grade B
Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.
Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.
Rescanned at commit 66697b08a3df, unchanged since the check below.
PERMISSION_DELETE_FILES NETWORK_NO_FIXED_HOST SECRETS_PATH_DOTENV OBFUSCATION_FILE_OVER_READ_CAP
Why this grade
- PERMISSION_DELETE_FILES Low
Contains a call that can delete files.
pixie/web/server.py, line 465
proc = subprocess.Popen( - NETWORK_NO_FIXED_HOST Low
Makes a network call whose host is not written as a fixed address.
frontend/src/main.tsx, line 8
const res = await fetch("/mock-data.json"); - SECRETS_PATH_DOTENV Low
Mentions a .env file.
pixie/config.py, line 1
"""Centralized configuration with env var and ``.env`` overrides. - OBFUSCATION_FILE_OVER_READ_CAP Note
A file was over the read cap and was not fully read.
pixie/assets/webui.html, line 1
<!doctype html>
Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.
Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.
What was checked
Plain notes from the hygiene checks.
Permissions
Concern
can delete files.
PERMISSION_DELETE_FILES
pixie/web/server.py, line 465
proc = subprocess.Popen(
pixie-ts/src/cli/stopCommand.ts, line 33
fs.unlinkSync(lockPath);
Install and update
Pass
No install-time script found, and dependencies are pinned or absent.
Network
Concern
can reach a host that is not written as a fixed address.
NETWORK_NO_FIXED_HOST
frontend/src/main.tsx, line 8
const res = await fetch("/mock-data.json");
frontend/src/components/FeedbackModal.tsx, line 50
fetch(feedbackUrl, { method: "POST", body: data })
frontend/src/webui/components/DatasetsPanel.tsx, line 46
fetch(`/api/file?path=${encodeURIComponent(selected)}`)
Show more
frontend/src/webui/components/JsonPanel.tsx, line 25
fetch(`/api/file?path=${encodeURIComponent(path)}`)
frontend/src/webui/components/JsonlPanel.tsx, line 48
fetch(`/api/file?path=${encodeURIComponent(path)}`)
frontend/src/webui/components/MarkdownPanel.tsx, line 18
fetch(`/api/file?path=${encodeURIComponent(path)}`)
frontend/src/webui/components/ProjectContextPanel.tsx, line 67
fetch(`/api/file?path=${encodeURIComponent(path)}`)
frontend/src/webui/components/ResultsPanel.tsx, line 56
fetch(`/api/result?id=${encodeURIComponent(testId)}`)
Secrets
Concern
reads a credential or environment file.
SECRETS_PATH_DOTENV
pixie/config.py, line 1
"""Centralized configuration with env var and ``.env`` overrides.
pixie/config.py, line 4
the nearest ``.env`` from the current working directory at call time, while
pixie-ts/src/config.ts, line 2
* pixie.config - Centralised configuration with env var and .env overrides.
Show more
pixie-ts/src/config.ts, line 5
* the nearest .env from the current working directory at call time.
changelogs/config-driven-rate-limit-settings.md, line 6
- `get_config()` now loads the nearest `.env` from the current working directory at call time, while preserving already-exported environment variables.
changelogs/config-driven-rate-limit-settings.md, line 8
- `pixie test` now applies the central config before evaluator execution, so `.env`-backed rate limits are honored automatically.
changelogs/config-driven-rate-limit-settings.md, line 28
- To manage evaluator throttling through project config instead, set `PIXIE_RATE_LIMIT_ENABLED=true` and any optional `PIXIE_RATE_LIMIT_*` overrides in your shell or `.env` file.
docs/pixie/config.md, line 3
Centralized configuration with env var and ``.env`` overrides.
Agent instructions
Pass
No instruction to ignore earlier instructions or to hide a step.
Obfuscation
Note
a file was over the read cap and was not fully read.
OBFUSCATION_FILE_OVER_READ_CAP
pixie/assets/webui.html, line 1
<!doctype html>
Licence
Pass
A licence file is present (LICENSE).
Maintainer activity
Pass
The latest commit is within the last 365 days.
Note
Hygiene check of commit 66697b08a3df. can delete files. can reach a host that is not written as a fixed address. reads a credential or environment file. a file was over the read cap and was not fully read.
Date and source
Date checked:
github.com
Commit graded: 66697b08a3df0b7d6ba319e877df632d5bcfde16
This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.