Grades are a hygiene check, not a security guarantee.

Claude Code, Plugin

Claude Synod Debate

Evidence-oriented multi-agent deliberation for Claude Code | Design changes, verification & explicit limits

Compatibility: Not stated.

Grade B

Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

Rescanned at commit 61e28e54e7f3, unchanged since the check below.

INSTALL_UNPINNED SECRETS_PATH_DOTENV PERMISSION_SHELL_DECLARED SECRETS_ENV_READ OBFUSCATION_FILE_OVER_READ_CAP

Why this grade

  • INSTALL_UNPINNED Low

    Dependencies use a range or git URL with no lockfile.

    requirements.txt, line 1 google-genai>=1.0.0

  • SECRETS_PATH_DOTENV Low

    Mentions a .env file.

    tools/base_provider.py, line 28 # Shared API key resolution: env var → ~/.synod/.env → macOS Keychain

  • PERMISSION_SHELL_DECLARED Note

    Runs shell commands, and the manifest or description says so.

    benchmark/judgment_eval.py, line 360 out = subprocess.run(

  • SECRETS_ENV_READ Note

    Reads an environment variable whose name contains KEY, SECRET, TOKEN, PASSWORD or CREDENTIAL.

    benchmark/baselines.py, line 55 genai.configure(api_key=os.environ.get("GEMINI_API_KEY"))

  • OBFUSCATION_FILE_OVER_READ_CAP Note

    A file was over the read cap and was not fully read.

    uv.lock, line 1 version = 1

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Note

    requests shell access. The manifest names this permission.

    PERMISSION_SHELL_DECLARED

    benchmark/judgment_eval.py, line 360

    out = subprocess.run(

    benchmark/run_gsm8k.py, line 192

    gemini_proc = subprocess.Popen(

    benchmark/run_gsm8k.py, line 198

    openai_proc = subprocess.Popen(

    Show more

    benchmark/strategy_compare.py, line 459

    result = subprocess.run(

    benchmark/test_classification.py, line 77

    result = subprocess.run(

    tools/base_provider.py, line 56

    result = subprocess.run(

    tools/exec_arbiter.py, line 65

    result = subprocess.run(

    tools/ground_truth_probe.py, line 140

    result = subprocess.run(

  • Install and update

    Concern

    dependencies are not pinned.

    INSTALL_UNPINNED

    requirements.txt, line 1

    google-genai>=1.0.0

  • Network

    Pass

    No network call found.

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_ENV_READ SECRETS_PATH_DOTENV

    benchmark/baselines.py, line 55

    genai.configure(api_key=os.environ.get("GEMINI_API_KEY"))

    benchmark/run_gsm8k.py, line 375

    if not os.environ.get("GEMINI_API_KEY"):

    tools/base_provider.py, line 28

    # Shared API key resolution: env var → ~/.synod/.env → macOS Keychain

    Show more

    benchmark/run_gsm8k.py, line 378

    if not os.environ.get("OPENAI_API_KEY"):

    benchmark/run_gsm8k.py, line 381

    if not os.environ.get("ANTHROPIC_API_KEY"):

    benchmark/strategy_compare.py, line 446

    if not self.gemini_cli or not os.environ.get("GEMINI_API_KEY"):

    benchmark/strategy_compare.py, line 448

    if not self.openai_cli or not os.environ.get("OPENAI_API_KEY"):

    benchmark/strategy_compare.py, line 450

    if not os.environ.get("ANTHROPIC_API_KEY"):

    tools/base_provider.py, line 31

    SYNOD_ENV_FILE = Path("~/.synod/.env").expanduser()

    tools/base_provider.py, line 78

    """Resolve API key from env var → ~/.synod/.env → macOS Keychain."""

    tools/base_provider.py, line 79

    # 1. Environment variable (already loaded or from .env)

    tools/base_provider.py, line 94

    """Append or update a key in ~/.synod/.env."""

    tools/base_provider.py, line 315

    Resolution order: env var → ~/.synod/.env → macOS Keychain.

    tools/base_provider.py, line 328

    f" Or save: echo '{self.API_KEY_ENV}=\"your-key\"' >> ~/.synod/.env",

    tools/gemini-3.py, line 98

    if not os.environ.get("GEMINI_API_KEY") and os.environ.get("GOOGLE_API_KEY"):

    tools/synod-setup.py, line 229

    """Auth check: local session, env var → ~/.synod/.env → macOS Keychain."""

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Note

    a file was over the read cap and was not fully read.

    OBFUSCATION_FILE_OVER_READ_CAP

    uv.lock, line 1

    version = 1

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit 61e28e54e7f3. requests shell access. The manifest names this permission. dependencies are not pinned. reads a credential or environment file. a file was over the read cap and was not fully read.

Date and source

Date checked:

View source

github.com

Commit graded: 61e28e54e7f3f9bea47341bd9d7cbc736c99cb51

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen