Claude Code, Skill
trap
trapstreet.run Find the AI solution that actually works. Agents, skills, and tools compared side by side on the same task — non-invasive I/O testing, reproducible results, public leaderboards.
Compatibility: Not stated.
Grade C
One Medium finding. Read the report before installing.
Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.
PERMISSION_SHELL_UNDECLARED
Why this grade
- PERMISSION_SHELL_UNDECLARED Medium
Runs shell commands that the manifest or description does not mention.
examples/llm-qa/solution-multi/solution.py, line 23
result = subprocess.run(["claude", "-p", question], capture_output=True, text=True, check=True)
Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.
Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.
What was checked
Plain notes from the hygiene checks.
Permissions
Concern
requests shell access. No manifest field names shell or command execution. can delete files.
PERMISSION_SHELL_UNDECLARED PERMISSION_DELETE_FILES
examples/llm-qa/solution-multi/solution.py, line 23
result = subprocess.run(["claude", "-p", question], capture_output=True, text=True, check=True)
src/trap/loader/trap_yaml.py, line 98
subprocess.run(loader.config.setup_cmd, shell=True, cwd=loader.trap_dir, check=True)
src/trap/loader/traptask_yaml.py, line 86
subprocess.run(loader.traptask.setup_cmd, shell=True, cwd=loader.traptask_dir, check=True)
Show more
src/trap/runner/proc.py, line 30
solution, a judge, or a grader. On top of ``subprocess.run`` it owns the shared
src/trap/runner/proc.py, line 84
proc = subprocess.run(
src/trap/shapes/_case.py, line 278
shutil.rmtree(root, onexc=lambda func, failed, exc: errors.append((failed, exc)))
src/trap/shapes/_case.py, line 480
def kill_group(proc: subprocess.Popen, grace: float = 2.0) -> None:
src/trap/shapes/_case.py, line 538
proc = subprocess.Popen(
Install and update
Pass
No install-time script found, and dependencies are pinned or absent.
Network
Concern
can reach a host that is not written as a fixed address.
NETWORK_NO_FIXED_HOST
src/trap/cost/pricing.py, line 190
resp = httpx.get(f"{cls._server_url()}/api/pricing", timeout=cls.FETCH_TIMEOUT_SECONDS)
src/trap/git_ops/rev.py, line 84
repo.remotes.origin.fetch()
src/trap/shapes/direct.py, line 227
resp = httpx.post(url, headers=headers, json=body, timeout=max(deadline.remaining(), 1.0))
Show more
docs/guides/cost-tracking.md, line 99
2. a best-effort server fetch (3s timeout; any failure is silent);
docs/guides/cost-tracking.md, line 109
server - no CLI release. `TRAPSTREET_URL` redirects the fetch (e.g. at UAT),
Secrets
Concern
reads a credential or environment file.
SECRETS_PATH_DOTENV
src/trap/cost/providers.py, line 210
# DEEPSEEK_BASE_URL -- from the inherited environment only, never a .env file -- and
.gitignore, line 1
LOCAL*
docs/guides/cost-tracking.md, line 51
inherits, not a `.env` file) and works out of the box. Its `web_search` tool is a second
Show more
examples/llm-qa/solution-anthropic/trap.yaml, line 1
cmd: sh -c 'set -a && . .env && set +a && uv run solution.py'
examples/llm-qa/solution-multi/trap.yaml, line 1
cmd: sh -c 'set -a && . .env && set +a && uv run solution.py'
Agent instructions
Pass
No instruction to ignore earlier instructions or to hide a step.
Obfuscation
Pass
No encoded or minified payload found.
Licence
Pass
A licence file is present (LICENSE).
Maintainer activity
Pass
The latest commit is within the last 365 days.
Note
Hygiene check of commit 946392757042. requests shell access. No manifest field names shell or command execution. can delete files. can reach a host that is not written as a fixed address. reads a credential or environment file.
Date and source
Date checked:
github.com
Commit graded: 946392757042e48ba4a73bd67d2d31c3c709b5e7
This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.