Grades are a hygiene check, not a security guarantee.

MCP, MCP server

metis

Metis is an open-source, Ossie-first, engine-neutral semantic layer runtime engine.

Compatibility: Not stated.

Grade B

Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

NETWORK_NO_FIXED_HOST PERMISSION_SHELL_DECLARED SECRETS_ENV_READ OBFUSCATION_FILE_CAP_REACHED

Why this grade

  • NETWORK_NO_FIXED_HOST Low

    Makes a network call whose host is not written as a fixed address.

    cmd/a2sbench/bench/agent/pi/metis.ts, line 44 const response = await fetch(config.url, { method: "POST", headers, body: JSON.stringify(request) });

  • PERMISSION_SHELL_DECLARED Note

    Runs shell commands, and the manifest or description says so.

    cmd/a2sbench/bench/lifecycle/lifecycle.go, line 481 command := exec.Command(executable, args...)

  • SECRETS_ENV_READ Note

    Reads an environment variable whose name contains KEY, SECRET, TOKEN, PASSWORD or CREDENTIAL.

    cmd/a2sbench/command/drivers_test.go, line 324 if got := os.Getenv("A2SBENCH_MCP_SECRET"); got != "" {

  • OBFUSCATION_FILE_CAP_REACHED Note

    The 400 file cap was reached before every file was read.

    docs/decisions/interfaces/0016-http-and-stdio-share-one-mcp-server.md, line 1 # ADR-0016: HTTP and Stdio Share One MCP Server

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Note

    requests shell access. The manifest names this permission.

    PERMISSION_SHELL_DECLARED

    cmd/a2sbench/bench/lifecycle/lifecycle.go, line 481

    command := exec.Command(executable, args...)

    cmd/a2sbench/bench/lifecycle/process_unix.go, line 51

    output, err := exec.Command("ps", "-o", "lstart=", "-p", strconv.Itoa(pid)).Output()

    cmd/a2sbench/bench/lifecycle/process_unix.go, line 69

    output, err := exec.Command("ps", "-o", "comm=", "-p", strconv.Itoa(pid)).Output()

    Show more

    cmd/a2sbench/command/claude_driver.go, line 98

    cmd := exec.CommandContext(ctx, d.binary, args...)

    cmd/a2sbench/command/codex_session.go, line 65

    cmd := exec.CommandContext(ctx, d.binary, args...)

    cmd/a2sbench/command/driver_common.go, line 253

    cmd := exec.CommandContext(ctx, binary, args...)

    cmd/a2sbench/command/generic_driver.go, line 105

    cmd := exec.CommandContext(context.WithoutCancel(ctx), d.binary, d.args...)

    cmd/a2sbench/command/okfgen.go, line 116

    if _, err := exec.Command(options.PiBin, "--version").Output(); err != nil {

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    cmd/a2sbench/bench/agent/pi/metis.ts, line 44

    const response = await fetch(config.url, { method: "POST", headers, body: JSON.stringify(request) });

  • Secrets

    Note

    reads an environment variable.

    SECRETS_ENV_READ

    cmd/a2sbench/command/drivers_test.go, line 324

    if got := os.Getenv("A2SBENCH_MCP_SECRET"); got != "" {

    cmd/metis/main.go, line 181

    verifier, err := auth.NewStaticAPIKeyVerifier(os.Getenv("METIS_API_KEY"))

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Note

    the file cap was reached before every file was read.

    OBFUSCATION_FILE_CAP_REACHED

    docs/decisions/interfaces/0016-http-and-stdio-share-one-mcp-server.md, line 1

    # ADR-0016: HTTP and Stdio Share One MCP Server

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Get the full report on this tool, £49

Note

Hygiene check of commit 44e5b7dcf81e. requests shell access. The manifest names this permission. can reach a host that is not written as a fixed address. reads an environment variable. the file cap was reached before every file was read.

Date and source

Date checked:

View source

github.com

Commit graded: 44e5b7dcf81e44964c5fe6ec89a055f965e032ec

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen