Grades are a hygiene check, not a security guarantee.

Claude Code, Skill

NiceTryGPT

Reduce cheap LLM shortcuts in authorized CTF challenges while preserving the intended vulnerability, learning objective, and human difficulty band.

Compatibility: Not stated.

Grade B

Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

PERMISSION_DELETE_FILES NETWORK_NO_FIXED_HOST SECRETS_PATH_DOTENV

Why this grade

  • PERMISSION_DELETE_FILES Low

    Contains a call that can delete files.

    evals/resume_claude_interstellar.py, line 88 rc = subprocess.run(cmd).returncode

  • NETWORK_NO_FIXED_HOST Low

    Makes a network call whose host is not written as a fixed address.

    evals/run_claude_interstellar.py, line 112 with urllib.request.urlopen(url + "/login", timeout=2) as response:

  • SECRETS_PATH_DOTENV Low

    Mentions a .env file.

    evals/run_claude_interstellar.py, line 84 if "interstellar" not in str(path).lower() or not (path / ".env").is_file():

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Concern

    can delete files.

    PERMISSION_DELETE_FILES

    evals/resume_claude_interstellar.py, line 88

    rc = subprocess.run(cmd).returncode

    evals/resume_diceminer_benchmark.py, line 52

    return subprocess.run(cmd).returncode

    evals/run_claude_interstellar.py, line 32

    return subprocess.run(cmd, text=True, **kwargs)

    Show more

    evals/run_codex_diceminer.py, line 41

    return subprocess.run(cmd, text=True, **kwargs)

    evals/run_codex_interstellar.py, line 43

    return subprocess.run(cmd, text=True, **kwargs)

    examples/mini-sqli/after/server.py, line 107

    shutil.rmtree(RUNTIME_ROOT, ignore_errors=True)

    examples/mini-sqli/before/server.py, line 93

    shutil.rmtree(RUNTIME_ROOT, ignore_errors=True)

    examples/mini-traversal/after/server.py, line 72

    shutil.rmtree(RUNTIME_ROOT, ignore_errors=True)

    examples/mini-traversal/before/server.py, line 64

    shutil.rmtree(RUNTIME_ROOT, ignore_errors=True)

    scripts/sync_plugin_skill.py, line 14

    shutil.rmtree(DESTINATION)

    scripts/verify_research_artifact.py, line 38

    subprocess.run(command, cwd=ROOT, check=True)

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    evals/run_claude_interstellar.py, line 112

    with urllib.request.urlopen(url + "/login", timeout=2) as response:

    evals/run_codex_diceminer.py, line 108

    with urllib.request.urlopen(url + "/", timeout=2) as response:

    evals/run_codex_interstellar.py, line 126

    with urllib.request.urlopen(url + "/login", timeout=2) as response:

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_PATH_DOTENV

    evals/run_claude_interstellar.py, line 84

    if "interstellar" not in str(path).lower() or not (path / ".env").is_file():

    evals/run_claude_interstellar.py, line 95

    if not (path / "Dockerfile").is_file() or not (path / ".env").is_file():

    evals/run_claude_interstellar.py, line 96

    raise RuntimeError(f"{variant} source needs Dockerfile and .env: {path}")

    Show more

    evals/run_claude_interstellar.py, line 243

    original_env = replace_flag(source / ".env", flag)

    evals/run_claude_interstellar.py, line 249

    (source / ".env").write_text(original_env, encoding="utf-8")

    evals/run_codex_interstellar.py, line 98

    if "interstellar" not in str(path).lower() or not (path / ".env").is_file():

    evals/run_codex_interstellar.py, line 109

    if not (path / "Dockerfile").is_file() or not (path / ".env").is_file():

    evals/run_codex_interstellar.py, line 110

    raise RuntimeError(f"{variant} source needs Dockerfile and .env: {path}")

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Pass

    No encoded or minified payload found.

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit aca784f7d400. can delete files. can reach a host that is not written as a fixed address. reads a credential or environment file.

Date and source

Date checked:

View source

github.com

Commit graded: aca784f7d40006b1abe7a0c99d9aad2d14b90906

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen