Grades are a hygiene check, not a security guarantee.

Cursor, Plugin

proctor

Catch AI agents gaming their test suites

Compatibility: Not stated.

Grade C

One Medium finding. Read the findings before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

Rescanned at commit d2ae15756c9f.

INSTALL_LIFECYCLE_HOOK

Why this grade

  • INSTALL_LIFECYCLE_HOOK Medium

    A package install hook (preinstall, install, postinstall or prepare) runs a script.

    package.json, line 20 postinstall

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Note

    requests shell access. The manifest names this permission.

    PERMISSION_SHELL_DECLARED

    demo/render_demo_gif.py, line 134

    result = subprocess.run(

    demo/render_demo_gif.py, line 142

    subprocess.run(["git", "init", "-q"], cwd=tmp, check=True)

    demo/render_demo_gif.py, line 143

    subprocess.run(["git", "config", "user.email", "[email protected]"], cwd=tmp, check=True)

    Show more

    demo/render_demo_gif.py, line 144

    subprocess.run(["git", "config", "user.name", "proctor-demo"], cwd=tmp, check=True)

    demo/render_demo_gif.py, line 147

    subprocess.run(["git", "add", "-A"], cwd=tmp, check=True)

    demo/render_demo_gif.py, line 148

    subprocess.run(["git", "commit", "-q", "-m", "add calculator with tests"], cwd=tmp, check=True)

    demo/render_demo_gif.py, line 150

    subprocess.run(["git", "add", "-A"], cwd=tmp, check=True)

    docs/research/seed/run.py, line 111

    result = subprocess.run(["git", "-c", "core.hooksPath=" + os.devnull, *args], cwd=repo,

  • Install and update

    Concern

    runs a script at install time.

    INSTALL_LIFECYCLE_HOOK

    package.json, line 20

    postinstall

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    bench/heldout/fixtures/ruby.json, line 65

    "fetch.rb": "def fetch(client)\n client.get\nend\n"

    bench/heldout/fixtures/ruby.json, line 68

    "fetch.rb": "def fetch(client)\n client.get\nrescue IOError => error\n warn error.message\n raise IOError, \"fetch failed: #{error.message}\"\nend\n"

    bench/heldout/fixtures/ruby.json, line 78

    "cache.rb": "def theme(cache)\n cache.fetch(:theme)\nend\n",

    Show more

    bench/heldout/fixtures/ruby.json, line 82

    "cache.rb": "def theme(cache)\n cache.fetch(:theme)\nrescue KeyError\n 'system'\nend\n",

    fixtures/WI105/before/catalog.ts, line 2

    const res = await fetch(`/api/items?page=${page}`);

    fixtures/WI105/negative/after/catalog.ts, line 2

    const res = await fetch(buildItemsUrl(page));

    fixtures/WI105/negative/before/catalog.ts, line 2

    const res = await fetch(`/api/items?page=${page}`);

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_ENV_READ SECRETS_PATH_DOTENV

    src/verifiers/wi103.ts, line 89

    /\b(?:process\.env|os\.environ|ENV|getenv|System\.getenv)\b[^\n]*\b(?:SKIP|DISABLE|BYPASS|NO_|IGNORE|UNSAFE|FORCE)\w*/i;

    fixtures/FIXTURES.md, line 460

    and `.env`. Build output, coverage, minified bundles and env files are what an ignore file is for,

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Note

    the file cap was reached before every file was read.

    OBFUSCATION_FILE_CAP_REACHED

    fixtures/RH007/after/build.gradle.kts, line 1

    plugins {

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Get the full report on this tool, £49

Note

Hygiene check of commit d2ae15756c9f. requests shell access. The manifest names this permission. runs a script at install time. can reach a host that is not written as a fixed address. reads a credential or environment file. the file cap was reached before every file was read.

Date and source

Date checked:

View source

github.com

Commit graded: d2ae15756c9fe474772859ece4a80d22a9d82be1

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen