Grades are a hygiene check, not a security guarantee.

Claude Code, Plugin

Pev Harness

Claude Opus 4.7 native Plan-Execute-Verify coding harness — a Claude Code plugin that enforces a 3-phase pipeline with hook-driven verification

Compatibility: Not stated.

Grade B

Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

Rescanned at commit f830297bd067, unchanged since the check below.

NETWORK_NO_FIXED_HOST SECRETS_PATH_UNCONFIRMED OBFUSCATION_ENCODED_BLOB PERMISSION_SHELL_DECLARED

Why this grade

  • NETWORK_NO_FIXED_HOST Low

    Makes a network call whose host is not written as a fixed address.

    experiments/harness-effect-v1/reports/verify-scenarios-v2.js, line 16 const ws = new WebSocket(`ws://localhost:${port}`);

  • SECRETS_PATH_UNCONFIRMED Low

    The Secrets check reports a credential or environment file, but no quoted line shows a recognisable path.

    CONTRIBUTING.md, line 104 - secrets/credentials を含める (`.gitignore` で `*.env` 追加検討)

  • OBFUSCATION_ENCODED_BLOB Low

    Contains a long base64 shaped string in a file that should be readable.

    experiments/harness-effect-v8/logs/t2.stream.jsonl, line 1 {"type":"system","subtype":"hook_started","hook_id":"91190243-2260-4f56-aca3-04f7b1a8eca0","hook_name":"SessionStart:startup","hook_event":"SessionStart","uuid":"39ace3e1-fc3d-46a7

  • PERMISSION_SHELL_DECLARED Note

    Runs shell commands, and the manifest or description says so.

    skills/skill-creator/eval-viewer/generate_review.py, line 291 result = subprocess.run(

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Note

    requests shell access. The manifest names this permission.

    PERMISSION_SHELL_DECLARED

    skills/skill-creator/eval-viewer/generate_review.py, line 291

    result = subprocess.run(

    skills/skill-creator/scripts/improve_description.py, line 35

    result = subprocess.run(

    skills/skill-creator/scripts/run_eval.py, line 85

    process = subprocess.Popen(

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    experiments/harness-effect-v1/reports/verify-scenarios-v2.js, line 16

    const ws = new WebSocket(`ws://localhost:${port}`);

    experiments/harness-effect-v1/reports/verify-scenarios.js, line 36

    const ws = new WebSocket(`ws://localhost:${target.port}`);

    experiments/harness-effect-v1/scratch/with-harness/artifacts/ws-test.mjs, line 21

    const ws = new WebSocket(BASE_URL);

    Show more

    experiments/harness-effect-v1/SPEC.md, line 27

    - C4: WebSocket (`ws://` または同等のリアルタイム双方向 transport) を使う (long polling や SSE は不可)

    experiments/harness-effect-v1/scratch/no-harness/public/index.html, line 234

    ws = new WebSocket(wsUrl());

    experiments/harness-effect-v1/scratch/with-harness/public/index.html, line 125

    ws = new WebSocket(`${proto}//${location.host}`);

    skills/skill-creator/eval-viewer/viewer.html, line 666

    const resp = await fetch("/api/feedback");

    skills/skill-creator/eval-viewer/viewer.html, line 1012

    fetch("/api/feedback", {

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_PATH_UNCONFIRMED

    CONTRIBUTING.md, line 104

    - secrets/credentials を含める (`.gitignore` で `*.env` 追加検討)

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Concern

    contains an encoded blob in a file that should be readable.

    OBFUSCATION_ENCODED_BLOB

    experiments/harness-effect-v8/logs/t2.stream.jsonl, line 1

    {"type":"system","subtype":"hook_started","hook_id":"91190243-2260-4f56-aca3-04f7b1a8eca0","hook_name":"SessionStart:startup","hook_event":"SessionStart","uuid":"39ace3e1-fc3d-46a7

    experiments/harness-effect-v8/logs/t3.stream.jsonl, line 1

    {"type":"system","subtype":"hook_started","hook_id":"7ccecf18-5a76-4d13-9794-2f7634b96dc9","hook_name":"SessionStart:startup","hook_event":"SessionStart","uuid":"90ea4a29-66e7-4999

    experiments/harness-effect-v8/logs/t4.stream.jsonl, line 1

    {"type":"system","subtype":"hook_started","hook_id":"ca81d7aa-7b24-4500-8be5-84e87e8848f3","hook_name":"SessionStart:startup","hook_event":"SessionStart","uuid":"d7fce8f6-8d63-4a37

    Show more

    experiments/harness-effect-v8/logs/t5.stream.jsonl, line 1

    {"type":"system","subtype":"hook_started","hook_id":"460d669b-757c-45f6-8200-225052558ae6","hook_name":"SessionStart:startup","hook_event":"SessionStart","uuid":"f9422356-fcdf-4889

    experiments/harness-effect-v8/logs/t6.stream.jsonl, line 1

    {"type":"system","subtype":"hook_started","hook_id":"13e3f508-615c-4d79-b31d-657ff3be5962","hook_name":"SessionStart:startup","hook_event":"SessionStart","uuid":"aaaa11b3-1c95-4123

    experiments/harness-effect-v18/logs/dispatch.log, line 11

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01H6E29CanUUQYvNAzcHptw9","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/dispatch.log, line 22

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01SjKLtrdqzgAkdHAe6THkfQ","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/dispatch.log, line 32

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_018Xio9WMjpxCQj1qqtgdvsY","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/dispatch.log, line 45

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01UqYZZxC2AxB8ZJjrfh9G7D","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/dispatch.log, line 51

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01QmxbUVrArVKy3GYZKxuxaQ","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/dispatch.log, line 88

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01BGV8PnugbSD6h8ZFZZL9Xn","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/goalcheck.log, line 17

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01LzsdYW9gu8YXWLYyCWVUxg","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

    experiments/harness-effect-v18/logs/goalcheck.log, line 35

    {"type":"assistant","message":{"model":"claude-opus-4-8","id":"msg_01NM8TNvyuSsEEuTqxmEzWD4","type":"message","role":"assistant","content":[{"type":"thinking","thinking":"","signat

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit f830297bd067. requests shell access. The manifest names this permission. can reach a host that is not written as a fixed address. reads a credential or environment file. contains an encoded blob in a file that should be readable.

Date and source

Date checked:

View source

github.com

Commit graded: f830297bd067818ef26f4cf3881a6a6cf44ec453

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen