Claude Code, Skill
Arize Skills
Add Arize AX observability to LLM applications — auto-instrumentation, trace export, dataset management, experiment workflows, prompt optimization, deep linking, and migrations from Langfuse, LangSmith, and Braintrust via the ax CLI.
Compatibility: Not stated.
Grade B
Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.
Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.
Rescanned at commit 0df4b5a4715e.
NETWORK_NO_FIXED_HOST NETWORK_UNNAMED_HOST SECRETS_PATH_DOTENV SECRETS_ENV_READ
Why this grade
- NETWORK_NO_FIXED_HOST Low
Makes a network call whose host is not written as a fixed address.
scripts/migrate_vendor_traces.py, line 276
with urllib.request.urlopen(req, timeout=120) as resp: - NETWORK_UNNAMED_HOST Low
Calls a fixed host that the description does not name.
scripts/migrate_vendor_traces.py, line 276
with urllib.request.urlopen(req, timeout=120) as resp: - SECRETS_PATH_DOTENV Low
Mentions a .env file.
skills/arize-phoenix-migration/SKILL.md, line 81
The command accepts the keys without displaying them and saves them in a local owner-only file. You can instead reply with the path to an existing local `.env`. - SECRETS_ENV_READ Note
Reads an environment variable whose name contains KEY, SECRET, TOKEN, PASSWORD or CREDENTIAL.
skills/arize-experiment/references/inference-template.py, line 33
=os.environ["CUSTOM_BASE_URL"], api_key=os.environ.get("CUSTOM_API_KEY", "none")).chat.completions.create(mode
Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.
Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.
What was checked
Plain notes from the hygiene checks.
Permissions
Pass
No shell or command execution found, and no extra permission was declared.
Install and update
Pass
No install-time script found, and dependencies are pinned or absent.
Network
Concern
can reach a host that is not written as a fixed address. can reach api.smith.langchain.com. The description does not name that host.
NETWORK_NO_FIXED_HOST NETWORK_UNNAMED_HOST
scripts/migrate_vendor_traces.py, line 276
with urllib.request.urlopen(req, timeout=120) as resp:
scripts/migrate_vendor_traces.py, line 493
with urllib.request.urlopen(req, timeout=60) as resp:
scripts/migrate_vendor_traces.py, line 512
with urllib.request.urlopen(req, timeout=120) as resp:
Show more
scripts/migrate_vendor_traces.py, line 664
with urllib.request.urlopen(req, timeout=60) as resp:
skills/arize-migrate-braintrust/references/braintrust-export.md, line 12
curl -sS "$BRAINTRUST_API_URL/v1/project" \
skills/arize-migrate-braintrust/references/braintrust-export.md, line 28
curl -sS -X POST "$BRAINTRUST_API_URL/btql" \
skills/arize-migrate-braintrust/references/braintrust-export.md, line 49
curl -sS -X POST "$BRAINTRUST_API_URL/btql" \
skills/arize-migrate-braintrust/scripts/migrate_vendor_traces.py, line 276
with urllib.request.urlopen(req, timeout=120) as resp:
Secrets
Concern
reads a credential or environment file.
SECRETS_ENV_READ SECRETS_PATH_DOTENV
skills/arize-experiment/references/inference-template.py, line 33
=os.environ["CUSTOM_BASE_URL"], api_key=os.environ.get("CUSTOM_API_KEY", "none")).chat.completions.create(mode
skills/arize-instrumentation/references/go.md, line 35
option.WithAPIKey(os.Getenv("OPENAI_API_KEY")),
skills/arize-phoenix-migration/SKILL.md, line 81
The command accepts the keys without displaying them and saves them in a local owner-only file. You can instead reply with the path to an existing local `.env`.
Show more
skills/arize-phoenix-migration/references/migration.md, line 18
.venv-phoenix-migration/bin/python "$SKILL_ROOT/scripts/migrate.py" preflight --env-file .env --project my-fresh-project
skills/arize-phoenix-migration/references/migration.md, line 19
.venv-phoenix-migration/bin/python "$SKILL_ROOT/scripts/migrate.py" export --env-file .env --manifest migration-local/snapshot.json
skills/arize-phoenix-migration/references/migration.md, line 20
.venv-phoenix-migration/bin/python "$SKILL_ROOT/scripts/migrate.py" import --env-file .env --manifest migration-local/snapshot.json --project my-fresh-project
skills/arize-phoenix-migration/references/migration.md, line 21
.venv-phoenix-migration/bin/python "$SKILL_ROOT/scripts/migrate.py" verify --env-file .env --manifest migration-local/snapshot.json
skills/arize-phoenix-migration/references/migration.md, line 86
python scripts/migrate_data.py export --env-file /private/path/.env --manifest /private/path/data.json
skills/arize-phoenix-migration/references/migration.md, line 87
python scripts/migrate_data.py import --env-file /private/path/.env --manifest /private/path/data.json --prefix migrated-
skills/arize-phoenix-migration/references/migration.md, line 88
python scripts/migrate_data.py verify --env-file /private/path/.env --manifest /private/path/data.json
Agent instructions
Pass
No instruction to ignore earlier instructions or to hide a step.
Obfuscation
Pass
No encoded or minified payload found.
Licence
Pass
A licence file is present (LICENSE).
Maintainer activity
Pass
The latest commit is within the last 365 days.
Note
Hygiene check of commit 0df4b5a4715e. can reach a host that is not written as a fixed address. can reach api.smith.langchain.com. The description does not name that host. reads a credential or environment file.
Date and source
Date checked:
github.com
Commit graded: 0df4b5a4715e30eee46b4e6d89e25966dbc48fab
This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.