MCP, MCP server
CompletionKit
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
Compatibility: Not stated.
Grade C
One Medium finding. Read the findings before installing.
Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.
Rescanned at commit d4c4b7661ecd, unchanged since the check below.
OBFUSCATION_ENCODED_BLOB
Why this grade
- OBFUSCATION_ENCODED_BLOB Medium
Contains a long base64 shaped string in a file that should be readable.
CHANGELOG.md, line 1
# Changelog
Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.
Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.
What was checked
Plain notes from the hygiene checks.
Permissions
Pass
No shell or command call was found in the code. This check does not read permissions an entry declares. A permission line to run shell commands was found in this repository, and it may apply to this entry.
Install and update
Pass
No install-time script found, and dependencies are pinned or absent.
Network
Concern
can reach a host that is not written as a fixed address.
NETWORK_NO_FIXED_HOST
app/assets/javascripts/completion_kit/application.js, line 132
fetch(url, {
app/assets/javascripts/completion_kit/application.js, line 154
fetch(url, { headers: { "Accept": "text/vnd.turbo-stream.html" } })
app/assets/javascripts/completion_kit/application.js, line 598
fetch(refresher.getAttribute("data-ck-provider-refresh"), {
Show more
app/assets/javascripts/completion_kit/application.js, line 857
fetch(url, { headers: { Accept: "text/vnd.turbo-stream.html" }, credentials: "
app/jobs/completion_kit/check_review_job.rb, line 54
Checks::Registry.fetch(kind).call(target_value, config)
app/jobs/completion_kit/generate_row_job.rb, line 7
limits_concurrency to: ENV.fetch("COMPLETION_KIT_PER_RUN_CONCURRENCY", 5).to_i,
app/jobs/completion_kit/judge_review_job.rb, line 7
limits_concurrency to: ENV.fetch("COMPLETION_KIT_PER_RUN_CONCURRENCY", 5).to_i,
app/models/completion_kit/metric.rb, line 187
required = CompletionKit::Checks::Registry.required_keys.fetch(kind)
Secrets
Concern
reads a credential or environment file.
SECRETS_PATH_DOTENV
lib/generators/completion_kit/templates/initializer.rb, line 16
# 2. Dotenv (.env file):
.dockerignore, line 17
**/.env
.dockerignore, line 18
**/.env.*
Show more
.gitignore, line 20
standalone/db/*.sqlite3-*
.gitignore, line 23
standalone/.env
CONTRIBUTING.md, line 53
Copy `standalone/.env.example` to `standalone/.env` and populate it with
docs/superpowers/plans/2026-04-14-launch.md, line 1689
- A real `OPENAI_API_KEY` in `standalone/.env` with at least 50 cents of credit
docs/superpowers/specs/2026-04-14-launch-design.md, line 349
2. Set `OPENAI_API_KEY` in `.env` to a real key with a small budget cap.
Agent instructions
Pass
No instruction to ignore earlier instructions or to hide a step.
Obfuscation
Concern
contains an encoded blob in a file that should be readable.
OBFUSCATION_ENCODED_BLOB
CHANGELOG.md, line 1
# Changelog
spec/dummy/tmp/cache/assets/sprockets/v4.0.0/X8/X8Au0j3DHvZ0uHg4nJGpOOCzS-ePruBH1Saf5QZFAws.cache, line 1
x��M�#Gu�
standalone/config/credentials.yml.enc, line 1
/fuqX43q9mmL3Ui1ZJ0gZ962yQhiSwhJRaKIvGm7FMo2V8siKa245sI29YKH0EgzuHRGlQFgomYqzfhI9cqJUTcmQLSdmBE3nbRC2Cgo0vZ5+H9L1kF8cROUw4iswe/B30axjyzwd3mlarKIZpmYTPXNISrOYQxFD+wOUvsCBkzp2KcCSGN1
Licence
Pass
A licence file is present (LICENSE).
Maintainer activity
Pass
The latest commit is within the last 365 days.
Note
Hygiene check of commit d4c4b7661ecd. can reach a host that is not written as a fixed address. reads a credential or environment file. contains an encoded blob in a file that should be readable.
Date and source
Date checked:
github.com
Commit graded: d4c4b7661ecdee3ddaf136f1150eb203a0a571af
This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.