Grades are a hygiene check, not a security guarantee.

Claude Code, Skill

Keycloak Skills

Keycloak Skills, a skill listed in the PlugVet directory.

Compatibility: Not stated.

Grade D

Two or more Medium findings, or a High. Only try it in a sandbox.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

PERMISSION_SHELL_UNDECLARED SECRETS_PATH_CREDENTIAL

Why this grade

  • PERMISSION_SHELL_UNDECLARED Medium

    Runs shell commands that the manifest or description does not mention.

    benchmarks/keycloak-app-add-login/oracle/solve.py, line 223 result = subprocess.run(

  • SECRETS_PATH_CREDENTIAL Medium

    Mentions a credential store path (~/.ssh, id_rsa, .npmrc, .aws/credentials, credentials.json, .netrc).

    benchmarks/keycloak-corporate-sso-login/verifier/test_outputs.py, line 299 types = [c.get("type") for c in credentials.json()]

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

If you think this grade is wrong, email [email protected] with the entry link and your evidence. We aim to acknowledge within two working days and decide within seven. If we confirm an error, we aim to correct it within 24 hours of confirming it. These are aims, not guarantees.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Concern

    requests shell access. No manifest field names shell or command execution.

    PERMISSION_SHELL_UNDECLARED

    benchmarks/keycloak-app-add-login/oracle/solve.py, line 223

    result = subprocess.run(

    benchmarks/keycloak-app-add-login/verifier/test_outputs.py, line 187

    result = subprocess.run(

    benchmarks/keycloak-app-protect-api/oracle/solve.py, line 136

    build = subprocess.run(

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    benchmarks/keycloak-app-add-login/environment/deployment_token_proxy.py, line 58

    with urllib.request.urlopen(req, timeout=15) as resp:

    benchmarks/keycloak-app-add-login/environment/entrypoint.sh, line 27

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

    benchmarks/keycloak-app-add-login/environment/wait_for_services.sh, line 28

    curl -sf "$ACME" >/dev/null 2>&1 && keycloak_up=1

    Show more

    benchmarks/keycloak-app-add-login/environment/wait_for_services.sh, line 29

    curl -sf "$PROXY_HEALTH" >/dev/null 2>&1 && proxy_up=1

    benchmarks/keycloak-app-add-login/environment/wait_for_services.sh, line 33

    mcp_status=$(curl -s -o /dev/null -w '%{http_code}' "$MCP" 2>/dev/null || echo 000)

    benchmarks/keycloak-app-add-login/environment/skills/securingAppsReactRest/SKILL.md, line 88

    ADMIN_TOKEN=$(curl -s -X POST "$BASE/realms/master/protocol/openid-connect/token" \

    benchmarks/keycloak-app-add-login/environment/skills/securingAppsReactRest/SKILL.md, line 102

    ID=$(curl -s "$BASE/admin/realms/$REALM/clients?clientId=<client-id>" -H "$H" | jq -r '.[0].id')

    benchmarks/keycloak-app-add-login/environment/skills/securingAppsReactRest/SKILL.md, line 118

    curl -s "$BASE/admin/realms/$REALM/clients/$ID" -H "$H" > /tmp/client.json

    benchmarks/keycloak-app-add-login/environment/skills/securingAppsReactRest/SKILL.md, line 132

    curl -s -o /dev/null -w '%{http_code}\n' -X PUT "$BASE/admin/realms/$REALM/clients/$ID" \

    benchmarks/keycloak-app-protect-api/verifier/test.sh, line 54

    code=$(curl -s -o /dev/null -w '%{http_code}' http://localhost:8085/healthz 2>/dev/null)

    benchmarks/keycloak-corporate-sso-login/environment/entrypoint.sh, line 24

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

    benchmarks/keycloak-credential-enrollment/environment/entrypoint.sh, line 29

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

    benchmarks/keycloak-email-otp-login/environment/entrypoint.sh, line 35

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

    benchmarks/keycloak-idp-federation-login/environment/entrypoint.sh, line 27

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

    benchmarks/keycloak-idp-initiated-sso/environment/entrypoint.sh, line 27

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

    benchmarks/keycloak-idp-org-restrict-login/environment/entrypoint.sh, line 31

    curl -sf http://localhost:8080/auth/realms/acme/.well-known/openid-configuration \

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_PATH_CREDENTIAL SECRETS_PATH_DOTENV

    benchmarks/keycloak-corporate-sso-login/verifier/test_outputs.py, line 299

    types = [c.get("type") for c in credentials.json()]

    .gitignore, line 26

    # Local API keys for bench agent runs - never commit

    docs/adding-a-skill.md, line 216

    a `.env` file, **never paste a key into chat with an AI assistant**; it ends up in transcripts.

    Show more

    docs/skill-building-lessons.md, line 234

    - **Never put secrets in chat.** Route API keys through a gitignored `.env`; confirm presence with

    docs/skill-building-lessons.md, line 235

    a `grep -q`, never by printing. Check `git status` before committing - a `.env` was once staged.

    plugins/phasetwo/skills/securing-apps/SKILL.md, line 179

    app's own config too (`.env`, `keycloak.json`, `application.properties`): a `clientId` already there

    plugins/phasetwo/skills/securing-apps/references/client-registration-mcp.md, line 62

    **never secrets**. Cross-check against the app's own config (`.env`, `keycloak.json`,

    plugins/phasetwo/skills/securing-apps/references/client-registration.md, line 105

    Cross-check against the app's own config (`.env`, `keycloak.json`, `application.properties`,

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Concern

    contains an encoded blob in a file that should be readable. contains a minified payload.

    OBFUSCATION_ENCODED_BLOB OBFUSCATION_MINIFIED_PAYLOAD

    benchmarks/keycloak-app-add-login/oracle/solve_mcp.py, line 35

    GRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZWFsbXMvYWNtZSIsInN1YiI6Ijc3NGMzMWVjLTE2MDEtNTNlOS05ZjFkLWZiMTBkNjFlN2NhNyIsInR5cCI6IkJlYXJl

    benchmarks/keycloak-app-add-login/oracle/solve_mcp.py, line 35

    TOKEN = "

    plugins/phasetwo/skills/keycloak/assets/org-browser-flow-by-org-name.partial-import.json, line 1

    {

    Show more

    benchmarks/keycloak-app-add-login/task.md, line 69

    Authorization: "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Imx2N1o4T1VPN1V0SlE3bU1XY01pM3lKVkFfbXJGRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZW

    benchmarks/keycloak-corporate-sso-login/task.md, line 64

    Authorization: "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Imx2N1o4T1VPN1V0SlE3bU1XY01pM3lKVkFfbXJGRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZW

    benchmarks/keycloak-credential-enrollment/task.md, line 65

    Authorization: "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Imx2N1o4T1VPN1V0SlE3bU1XY01pM3lKVkFfbXJGRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZW

    benchmarks/keycloak-email-otp-login/task.md, line 63

    Authorization: "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Imx2N1o4T1VPN1V0SlE3bU1XY01pM3lKVkFfbXJGRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZW

    benchmarks/keycloak-idp-federation-login/task.md, line 64

    Authorization: "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Imx2N1o4T1VPN1V0SlE3bU1XY01pM3lKVkFfbXJGRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZW

    benchmarks/keycloak-idp-initiated-sso/task.md, line 77

    Authorization: "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6Imx2N1o4T1VPN1V0SlE3bU1XY01pM3lKVkFfbXJGRmFNQm84WU8zRE9BeWsiLCJ0eXAiOiJKV1QifQ.eyJpc3MiOiJodHRwOi8vbG9jYWxob3N0OjgwODAvYXV0aC9yZW

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit ae88e496de2a. requests shell access. No manifest field names shell or command execution. can reach a host that is not written as a fixed address. reads a credential or environment file. contains an encoded blob in a file that should be readable. contains a minified payload.

Date and source

Date checked:

View source

github.com

Commit graded: ae88e496de2af84fe59e52933d67666ab870ac94

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen