Grades are a hygiene check, not a security guarantee.

Codex, Plugin

AutoSciRub

Learning to Evaluate Before Improving: Automatic Rubric Induction for Automatic Research Agents

Compatibility: Portable across standard formats.

Grade B

Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

Rescanned at commit 2c6c58392ee6.

PERMISSION_DELETE_FILES NETWORK_NO_FIXED_HOST

Why this grade

  • PERMISSION_DELETE_FILES Low

    Contains a call that can delete files.

    scripts/install.py, line 108 shutil.rmtree(backup)

  • NETWORK_NO_FIXED_HOST Low

    Makes a network call whose host is not written as a fixed address.

    benchmarks/researchclawbench/skills/rcbench-grounding-research/scripts/retrieve_literature.py, line 177 with urllib.request.urlopen(request, timeout=timeout) as response:

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Concern

    can delete files.

    PERMISSION_DELETE_FILES

    scripts/install.py, line 108

    shutil.rmtree(backup)

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Concern

    can reach a host that is not written as a fixed address.

    NETWORK_NO_FIXED_HOST

    benchmarks/researchclawbench/skills/rcbench-grounding-research/scripts/retrieve_literature.py, line 177

    with urllib.request.urlopen(request, timeout=timeout) as response:

    benchmarks/researchclawbench/skills/rcbench-grounding-research/scripts/retrieve_literature.py, line 253

    with urllib.request.urlopen(request, timeout=timeout) as response:

    benchmarks/researchclawbench/skills/rcbench-mineru-pdf-to-markdown/scripts/mineru_pdf_to_markdown.py, line 112

    with urllib.request.urlopen(req, timeout=timeout) as resp:

    Show more

    benchmarks/researchclawbench/skills/rcbench-mineru-pdf-to-markdown/scripts/mineru_pdf_to_markdown.py, line 137

    with urllib.request.urlopen(req, timeout=timeout) as resp:

    benchmarks/researchclawbench/skills/rcbench-mineru-pdf-to-markdown/scripts/mineru_pdf_to_markdown.py, line 148

    with urllib.request.urlopen(url, timeout=timeout) as resp:

    plugins/autoscirub/skills/mineru-pdf-to-markdown/scripts/mineru_pdf_to_markdown.py, line 79

    with urllib.request.urlopen(req, timeout=timeout) as resp:

    plugins/autoscirub/skills/mineru-pdf-to-markdown/scripts/mineru_pdf_to_markdown.py, line 104

    with urllib.request.urlopen(req, timeout=timeout) as resp:

    plugins/autoscirub/skills/mineru-pdf-to-markdown/scripts/mineru_pdf_to_markdown.py, line 115

    with urllib.request.urlopen(url, timeout=timeout) as resp:

  • Secrets

    Pass

    No read of a credential file or secret environment variable found.

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Pass

    No encoded or minified payload found.

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Note

Hygiene check of commit 2c6c58392ee6. can delete files. can reach a host that is not written as a fixed address.

Date and source

Date checked:

View source

github.com

Commit graded: 2c6c58392ee6399e08f2526e35176f0e2c716e16

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen