MCP, MCP server
io.github.ahmedEid1/forgejudge
io.github.ahmedEid1/forgejudge, an MCP server listed in the PlugVet directory.
Compatibility: Not stated.
Grade C
One Medium finding. Read the findings before installing.
Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.
PERMISSION_SHELL_UNDECLARED
Why this grade
- PERMISSION_SHELL_UNDECLARED Medium
Runs shell commands that the manifest or description does not mention.
forgejudge/agent/solver.py, line 254
shutil.rmtree(work, ignore_errors=True)
Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.
Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.
What was checked
Plain notes from the hygiene checks.
Permissions
Concern
can delete files. requests shell access. No manifest field names shell or command execution.
PERMISSION_SHELL_UNDECLARED PERMISSION_DELETE_FILES
forgejudge/agent/solver.py, line 254
shutil.rmtree(work, ignore_errors=True)
forgejudge/golden/build_dataset.py, line 135
shutil.rmtree(tmp, ignore_errors=True)
forgejudge/golden/build_dataset.py, line 175
shutil.rmtree(buggy, ignore_errors=True)
Show more
forgejudge/golden/build_dataset.py, line 176
shutil.rmtree(gold, ignore_errors=True)
forgejudge/golden/harden.py, line 259
shutil.rmtree(tmp, ignore_errors=True)
forgejudge/golden/materialize.py, line 54
return subprocess.run(
forgejudge/golden/materialize.py, line 186
proc = subprocess.Popen(
forgejudge/golden/materialize.py, line 208
def _killpg(proc: "subprocess.Popen") -> None:
Install and update
Note
README documents an installer that pipes a download into a shell.
INSTALL_DOCUMENTED_INSTALLER
README.md, line 90
Prereq: [`uv`](https://docs.astral.sh/uv/) (Python 3.12 is provisioned for you) - `curl -LsSf https://astral.sh/uv/install.sh | sh`.
Network
Concern
can reach a host that is not written as a fixed address.
NETWORK_NO_FIXED_HOST
dashboard/public/app.js, line 5
const res = await fetch(path, { cache: "no-store" });
forgejudge/obs/tracing.py, line 129
with urllib.request.urlopen(req, timeout=10) as resp: # noqa: S310
dashboard/public/_headers, line 18
# (matches the app.js fetch(..., { cache: "no-store" })). Archived: the snapshot is
Show more
dashboard/public/calibration.html, line 94
const res = await fetch(path, { cache: "no-store" });
dashboard/public/playground.html, line 88
try { runs = (await (await fetch("data/runs.json", { cache: "no-store" })).json()).runs || []; }
Secrets
Concern
reads a credential or environment file.
SECRETS_ENV_READ SECRETS_PATH_DOTENV
forgejudge/obs/tracing.py, line 47
pub = os.getenv("LANGFUSE_PUBLIC_KEY")
forgejudge/obs/tracing.py, line 48
sec = os.getenv("LANGFUSE_SECRET_KEY")
forgejudge/obs/tracing.py, line 115
pub = os.getenv("LANGFUSE_PUBLIC_KEY")
Show more
forgejudge/obs/tracing.py, line 116
sec = os.getenv("LANGFUSE_SECRET_KEY")
forgejudge/obs/tracing.py, line 138
pub = os.getenv("LANGFUSE_PUBLIC_KEY")
forgejudge/obs/tracing.py, line 139
sec = os.getenv("LANGFUSE_SECRET_KEY")
forgejudge/obs/tracing.py, line 166
if not (os.getenv("LANGFUSE_PUBLIC_KEY") and os.getenv("LANGFUSE_SECRET_KEY")):
playground_api/app.py, line 35
DAILY_TOKEN_BUDGET = int(os.getenv("DAILY_TOKEN_BUDGET", "200000"))
.env.example, line 1
# ForgeJudge environment - copy to `.env` and fill in. The real `.env` is gitignored.
.env.example, line 3
# cp .env.example .env
.gitignore, line 1
# --- Secrets ---
.gitignore, line 2
.env
.gitignore, line 4
!.env.example
CHANGELOG.md, line 25
a database and its output matches publish's `runs-*.jsonl` glob; `.env.example` lists
CONTRIBUTING.md, line 19
cp .env.example .env # only needed for solve/sweep/trace/db work
README.md, line 100
# Needs a (free) Groq key. Either export it, or put it in .env and pass --env-file:
Agent instructions
Pass
No instruction to ignore earlier instructions or to hide a step.
Obfuscation
Note
a file was over the read cap and was not fully read.
OBFUSCATION_FILE_OVER_READ_CAP
uv.lock, line 1
version = 1
dashboard/public/data/runs.json, line 1
{
Licence
Pass
A licence file is present (LICENSE).
Maintainer activity
Pass
The latest commit is within the last 365 days.
Note
Hygiene check of commit 6222e97293ef. can delete files. requests shell access. No manifest field names shell or command execution. README documents an installer that pipes a download into a shell. can reach a host that is not written as a fixed address. reads a credential or environment file. a file was over the read cap and was not fully read.
Date and source
Date checked:
github.com
Commit graded: 6222e97293efa8c4da17cf0b16356c7fcda51b26
This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.