Grades are a hygiene check, not a security guarantee.

Claude Code, Skill

Astra Jev Harness

日本語 · Version 0.7.3 · Tagged releases · Changelog

Compatibility: Not stated.

Grade C

One Medium finding. Read the report before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

SECRETS_PATH_CREDENTIAL

Why this grade

  • SECRETS_PATH_CREDENTIAL Medium

    Mentions a credential store path (~/.ssh, id_rsa, .npmrc, .aws/credentials, credentials.json, .netrc).

    shared/repo_context.py, line 50 if p.name.startswith('.env') or p.suffix.lower() in {'.pem', '.key', '.p12', '.sqlite', '.db'} or p.name in {'auth.json', 'credentials.json', 'secrets.json'}:

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Note

    requests shell access. The manifest names this permission.

    PERMISSION_SHELL_DECLARED

    output.py, line 25

    child = subprocess.Popen(command, stdin=subprocess.DEVNULL, stdout=subprocess.PIPE,

    Codex cli/benchmark.py, line 103

    proc = subprocess.run([sys.executable, "-I", str(ROOT / "evaluator.py")], input=request,

    Codex cli/benchmark.py, line 169

    proc = subprocess.Popen(args, stdin=subprocess.PIPE, stdout=subprocess.PIPE, stderr=subprocess.PIPE,

    Show more

    Codex cli/benchmark.py, line 227

    auth = subprocess.run(["codex", "login", "status"], capture_output=True, text=True)

    Codex cli/coding.py, line 31

    proc = subprocess.Popen(argv, cwd=str(cwd), env=env, stdin=subprocess.PIPE,

    Codex cli/make_demo.py, line 40

    subprocess.run(['git', 'init', '-q', str(root)], check=True)

    Codex cli/make_demo.py, line 41

    subprocess.run(['git', '-C', str(root), 'add', '.'], check=True)

    Codex cli/make_demo.py, line 42

    subprocess.run(['git', '-C', str(root), '-c', 'user.name=Harness Fixture', '-c', '[email protected]',

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Pass

    No network call found.

  • Secrets

    Concern

    reads a credential or environment file.

    SECRETS_ENV_READ SECRETS_PATH_CREDENTIAL SECRETS_PATH_DOTENV

    Codex cli/benchmark.py, line 229

    "typesafe_key_present": bool(os.environ.get("TYPESAFE_API_KEY")),

    Codex cli/benchmark.py, line 232

    if args.command == "compare" and not os.environ.get("TYPESAFE_API_KEY"):

    shared/repo_context.py, line 50

    if p.name.startswith('.env') or p.suffix.lower() in {'.pem', '.key', '.p12', '.sqlite', '.db'} or p.name in {'auth.json', 'credentials.json', 'secrets.json'}:

    Show more

    internal/harness/provider.go, line 30

    if key := os.Getenv("TYPESAFE_API_KEY"); key != "" {

    internal/harness/runtime_test.go, line 106

    if eligibility(".env.example") == "" || !secret.MatchString("password='"+strings.Repeat("x", 30)+"'") {

    internal/harness/snapshot.go, line 62

    if strings.HasPrefix(base, ".env") || contains([]string{".pem", ".key",

    shared/evidence.py, line 198

    previous = os.environ.get('TYPESAFE_API_KEY')

    shared/evidence.py, line 204

    if not os.environ.get('TYPESAFE_API_KEY'):

    shared/evidence.py, line 208

    if not os.environ.get('TYPESAFE_API_KEY'):

    shared/host_context.py, line 145

    previous = os.environ.get('TYPESAFE_API_KEY')

    shared/jev.py, line 137

    key = os.environ.get("TYPESAFE_API_KEY")

    .gitignore, line 1

    # Local credentials and environments

    .gitignore, line 2

    .env

    .gitignore, line 4

    !.env.example

    .gitignore, line 29

    credentials.json

    Claude Code/skills/claude-jev-coding/SKILL.md, line 19

    An existing `TYPESAFE_API_KEY` takes precedence. On macOS the helper can read login Keychain service `astra-jev-harness`, account `TYPESAFE_API_KEY`, into its own process only. Nev

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Pass

    No encoded or minified payload found.

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit 32724fc387f5. requests shell access. The manifest names this permission. reads a credential or environment file.

Date and source

Date checked:

View source

github.com

Commit graded: 32724fc387f5bdfc97f5475d013d9a86ea28c6c5

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen