Grades are a hygiene check, not a security guarantee.

Claude Code, Plugin

Shopify Ai Toolkit

Shopify's AI Toolkit provides 18 development skills for building on the Shopify platform, covering documentation search, API schema access, GraphQL and Liquid code validation, Hydrogen storefronts, Polaris UI extensions, store management via CLI, and onboarding guidance for both

Compatibility: Not stated.

Grade D

Two or more Medium findings, or a High finding. Only try it in a sandbox.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

Rescanned at commit a788f6a87cad.

PERMISSION_SHELL_UNDECLARED OBFUSCATION_MINIFIED_PAYLOAD

Why this grade

  • PERMISSION_SHELL_UNDECLARED Medium

    Runs shell commands that the manifest or description does not mention.

    .hermes-plugin/__init__.py, line 81 completed = subprocess.run([binary, *forwarded], check=False)

  • OBFUSCATION_MINIFIED_PAYLOAD Medium

    Contains a very long line with almost no spaces in a script or style file.

    skills/shopify/assets/admin_2026-01.json.br, line 1 �ȉ��`

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Concern

    requests shell access. No manifest field names shell or command execution.

    PERMISSION_SHELL_UNDECLARED

    .hermes-plugin/__init__.py, line 81

    completed = subprocess.run([binary, *forwarded], check=False)

  • Install and update

    Note

    The docs document an installer that pipes a download into a shell.

    INSTALL_DOCUMENTED_INSTALLER

    CHANGELOG.md, line 224

    curl -fsSL https://raw.githubusercontent.com/Shopify/Shopify-AI-Toolkit/main/.hermes-plugin/install.sh | bash

    .hermes-plugin/README.md, line 10

    curl -fsSL https://raw.githubusercontent.com/Shopify/Shopify-AI-Toolkit/main/.hermes-plugin/install.sh | bash

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    hooks/scripts/track-telemetry.sh, line 555

    if ! command -v curl >/dev/null 2>&1; then

    hooks/scripts/track-telemetry.sh, line 556

    # Without curl we can't send the event. Skip silently — never break

    hooks/scripts/track-telemetry.sh, line 623

    # Test hook — set SKILL_TELEMETRY_TEST_MODE=1 to skip the curl call and

    Show more

    hooks/scripts/track-telemetry.sh, line 652

    (curl "${curl_args[@]}" >/dev/null 2>&1 || true) &

    skills/shopify/scripts/_validate_components.mjs, line 45

    .searchParams.append(s,a)});let r=await fetch(n.toString(),{method:t?.method||"GET",..

    skills/shopify/scripts/_validate_theme.mjs, line 19

    .searchParams.append(n,i)});let s=await fetch(r.toString(),{method:e?.method||"GET",..

    skills/shopify/scripts/log_feedback.mjs, line 4

    .searchParams.append(o,a)});let s=await fetch(r.toString(),{method:e?.method||"GET",..

    skills/shopify/scripts/log_skill_use.mjs, line 4

    .searchParams.append(r,a)});let s=await fetch(n.toString(),{method:e?.method||"GET",..

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_ENV_READ SECRETS_PATH_DOTENV

    skills/shopify/scripts/_validate_components.mjs, line 44

    `)}o(at,"formatCliHelp");function ct(){let e=[process.env.CLAUDE_SESSION_ID,process.env.CLAUDE_CODE_SESSION_ID,process.env.CURSOR_SESSION_ID,process.env.COPILOT_SESSION_ID];for(let

    skills/shopify/scripts/_validate_functions.mjs, line 200

    `)}r(Jf,"formatCliHelp");function zf(){let e=[process.env.CLAUDE_SESSION_ID,process.env.CLAUDE_CODE_SESSION_ID,process.env.CURSOR_SESSION_ID,process.env.COPILOT_SESSION_ID];for(let

    skills/shopify/scripts/_validate_graphql.mjs, line 201

    `)}n(Jf,"formatCliHelp");function zf(){let e=[process.env.CLAUDE_SESSION_ID,process.env.CLAUDE_CODE_SESSION_ID,process.env.CURSOR_SESSION_ID,process.env.COPILOT_SESSION_ID];for(let

    Show more

    skills/shopify/scripts/_validate_theme.mjs, line 18

    `)}o(q,"formatCliHelp");function W(){let t=[process.env.CLAUDE_SESSION_ID,process.env.CLAUDE_CODE_SESSION_ID,process.env.CURSOR_SESSION_ID,process.env.COPILOT_SESSION_ID];for(let e

    skills/shopify/references/hydrogen.md, line 58

    - **mock.shop:** Without a store or a Storefront API access token, build against mock.shop, a public Storefront API with mock catalogs. In `.env`, set `PUBLIC_STORE_DOMAIN` to a mo

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Concern

    contains a minified payload.

    OBFUSCATION_MINIFIED_PAYLOAD

    skills/shopify/assets/admin_2026-01.json.br, line 1

    �ȉ��`

    skills/shopify/assets/admin_2026-04.json.br, line 1

    �$��pC�@��

    skills/shopify/assets/admin_2026-07.json.br, line 1

    ��b�5x"t�sC�+l_�y�

    Show more

    skills/shopify/assets/admin_2026-10.json.br, line 1

    �:��p����R�>�M:�M#��5�;��

    skills/shopify/assets/admin_2027-01.json.br, line 1

    �

    skills/shopify/assets/admin_unstable.json.br, line 1

    �`���@6�W�:��ӏ�m�/fAVȶ���k�(�����7�!T���Ͽ��j����D��<�4pP�Hh?�~H�6+�*_w[

    skills/shopify/assets/types.archive.br, line 1

    ���D*c���u�9�|��y�(T�{��u>ɉ!�'Y��C�ń�n<�f�Rh���B&J����l�mg

    skills/shopify/scripts/_validate_components.mjs, line 7

    `}o(ke,"formatCode");import*as D from"path";import b from"typescript";import{fileURLToPath as _t}from"url";var Fe=o((e,t,n=b.ModuleResolutionKind.NodeJs)=>({target:b.ScriptTarget.E

    skills/shopify/scripts/_validate_components.mjs, line 11

    `);return!(t.match(C.PREACT_REACT_COMPAT)||t.match(C.NEVER_TYPE_CASCADE)||t.match(C.PRIMITIVE_PROPERTY_ACCESS)||t.match(C.CSS_PROPERTIES_COMPAT)||t.match(C.OBJECT_IS_UNKNOWN))}o(en

    skills/shopify/scripts/_validate_components.mjs, line 47

    Version validated against is ${$}.`:"",a=pe(r,"Components")+s,c=i.result==="success";console.log(u.json?JSON.stringify({success:c,responses:r,resolvedVersion:$}):a),await Oe("valid

    skills/shopify/scripts/_validate_functions.mjs, line 1

    #!/usr/bin/env node

    skills/shopify/scripts/import_mock_shop_catalog.mjs, line 28

    fragment MenuItemFields on MenuItem { title url type }`;function re(e){let t=e?.shop?.brand??{},n=c(s=>s?{title:s.title??"",items:(s.items??[]).map(o)}:null,"menu"),o=c(s=>({title:

    skills/shopify/scripts/import_mock_shop_catalog.mjs, line 30

    `);return JSON.parse(n)}c(U,"parseThemeJson");function Ue(e){let t=/\{%-?\s*schema\s*-?%\}([\s\S]*?)\{%-?\s*endschema\s*-?%\}/.exec(e);return t?JSON.parse(t[1]):null}c(Ue,"sectionS

    skills/shopify/scripts/import_mock_shop_catalog.mjs, line 107

    }`;function gt(e,t){let n={handle:e.handle,title:e.title,descriptionHtml:e.descriptionHtml,vendor:e.vendor,productType:e.productType,tags:e.tags,status:"ACTIVE",productOptions:e.op

    skills/shopify/scripts/import_mock_shop_catalog.mjs, line 108

    `).filter(s=>s.trim().startsWith("{")).forEach((s,i)=>{let l;try{l=JSON.parse(s)}catch{n.failed.push({line:i,errors:["unparseable result line"]});return}let r=typeof l.__lineNumber

    skills/shopify/scripts/search_docs.mjs, line 3

    export MINERVA_TOKEN=$(devx minerva-auth --client-id 0oa1bphetnkOusboI0x8 --audience ${d})`)}return{url:B(o),headers:{Cookie:`MINERVA_TOKEN=${a}`}}}let i=e.SHOPIFY_DEV_INSTRUMENTAT

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Get the full report on this tool, £49

Note

Hygiene check of commit a788f6a87cad. requests shell access. No manifest field names shell or command execution. can reach a host that is not written as a fixed address. reads a credential or environment file. contains a minified payload.

Date and source

Date checked:

View source

github.com

Commit graded: a788f6a87cad4be5dfac814605a7288dc9e8f3db

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen