Grades are a hygiene check, not a security guarantee.

Claude Code, Skill

trap

trapstreet.run Find the AI solution that actually works. Agents, skills, and tools compared side by side on the same task — non-invasive I/O testing, reproducible results, public leaderboards.

Compatibility: Not stated.

Grade C

One Medium finding. Read the report before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

PERMISSION_SHELL_UNDECLARED

Why this grade

  • PERMISSION_SHELL_UNDECLARED Medium

    Runs shell commands that the manifest or description does not mention.

    examples/llm-qa/solution-multi/solution.py, line 23 result = subprocess.run(["claude", "-p", question], capture_output=True, text=True, check=True)

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Concern

    requests shell access. No manifest field names shell or command execution. can delete files.

    PERMISSION_SHELL_UNDECLARED PERMISSION_DELETE_FILES

    examples/llm-qa/solution-multi/solution.py, line 23

    result = subprocess.run(["claude", "-p", question], capture_output=True, text=True, check=True)

    src/trap/loader/trap_yaml.py, line 98

    subprocess.run(loader.config.setup_cmd, shell=True, cwd=loader.trap_dir, check=True)

    src/trap/loader/traptask_yaml.py, line 86

    subprocess.run(loader.traptask.setup_cmd, shell=True, cwd=loader.traptask_dir, check=True)

    Show more

    src/trap/runner/proc.py, line 30

    solution, a judge, or a grader. On top of ``subprocess.run`` it owns the shared

    src/trap/runner/proc.py, line 84

    proc = subprocess.run(

    src/trap/shapes/_case.py, line 278

    shutil.rmtree(root, onexc=lambda func, failed, exc: errors.append((failed, exc)))

    src/trap/shapes/_case.py, line 480

    def kill_group(proc: subprocess.Popen, grace: float = 2.0) -> None:

    src/trap/shapes/_case.py, line 538

    proc = subprocess.Popen(

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    src/trap/cost/pricing.py, line 190

    resp = httpx.get(f"{cls._server_url()}/api/pricing", timeout=cls.FETCH_TIMEOUT_SECONDS)

    src/trap/git_ops/rev.py, line 84

    repo.remotes.origin.fetch()

    src/trap/shapes/direct.py, line 227

    resp = httpx.post(url, headers=headers, json=body, timeout=max(deadline.remaining(), 1.0))

    Show more

    docs/guides/cost-tracking.md, line 99

    2. a best-effort server fetch (3s timeout; any failure is silent);

    docs/guides/cost-tracking.md, line 109

    server - no CLI release. `TRAPSTREET_URL` redirects the fetch (e.g. at UAT),

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_PATH_DOTENV

    src/trap/cost/providers.py, line 210

    # DEEPSEEK_BASE_URL -- from the inherited environment only, never a .env file -- and

    .gitignore, line 1

    LOCAL*

    docs/guides/cost-tracking.md, line 51

    inherits, not a `.env` file) and works out of the box. Its `web_search` tool is a second

    Show more

    examples/llm-qa/solution-anthropic/trap.yaml, line 1

    cmd: sh -c 'set -a && . .env && set +a && uv run solution.py'

    examples/llm-qa/solution-multi/trap.yaml, line 1

    cmd: sh -c 'set -a && . .env && set +a && uv run solution.py'

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Pass

    No encoded or minified payload found.

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit 946392757042. requests shell access. No manifest field names shell or command execution. can delete files. can reach a host that is not written as a fixed address. reads a credential or environment file.

Date and source

Date checked:

View source

github.com

Commit graded: 946392757042e48ba4a73bd67d2d31c3c709b5e7

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen