Grades are a hygiene check, not a security guarantee.

MCP, MCP server

saybench

Benchmark the voice-AI pipeline on your audio, not a vendor's lab.

Compatibility: Not stated.

Grade B

Minor issues only, no Medium or High. Worth a quick look at the findings below before installing.

Graded by PlugVetRubric v2

Not a guarantee. A hygiene check of the source at the commit shown, not a security audit.

SECRETS_ENV_READ OBFUSCATION_FILE_OVER_READ_CAP

Why this grade

  • SECRETS_ENV_READ Note

    Reads an environment variable whose name contains KEY, SECRET, TOKEN, PASSWORD or CREDENTIAL.

    internal/provider/llm.go, line 91 key = os.Getenv("SAYBENCH_LLM_API_KEY") // optional for local servers

  • OBFUSCATION_FILE_OVER_READ_CAP Note

    A file was over the read cap and was not fully read.

    golden/audio/email-spellout.wav, line 1 RIFF�WAVEfmt �>}FLLR�

Any High, or two or more Medium findings, give D. One Medium gives C. Low findings or a security Note give B. Each code names a finding behind the letter.

Grades are a hygiene check of the source at the commit shown, on the date checked, not a security audit or a guarantee. The free directory grades are automated. Before release, a PlugVet engineer reviews every paid report and any grade we hold back, including all F grades, against the source code and the evidence we quote.

What was checked

Plain notes from the hygiene checks.

  • Permissions

    Pass

    No shell or command execution found, and no extra permission was declared.

  • Install and update

    Pass

    No install-time script found, and dependencies are pinned or absent.

  • Network

    Pass

    No network call found.

  • Secrets

    Note

    reads an environment variable.

    SECRETS_ENV_READ

    internal/provider/llm.go, line 91

    key = os.Getenv("SAYBENCH_LLM_API_KEY") // optional for local servers

    internal/provider/s2s.go, line 105

    key := os.Getenv("GEMINI_API_KEY")

    internal/provider/s2s.go, line 107

    key = os.Getenv("GOOGLE_API_KEY")

    Show more

    internal/provider/s2s.go, line 137

    p := newRealtimeS2S("custom:"+model, base, os.Getenv("SAYBENCH_S2S_API_KEY"), model)

    internal/provider/tts.go, line 78

    out = append(out, newOpenAITTS("custom:"+model, base, os.Getenv("SAYBENCH_TTS_API_KEY"), model, voice))

  • Agent instructions

    Pass

    No instruction to ignore earlier instructions or to hide a step.

  • Obfuscation

    Note

    a file was over the read cap and was not fully read.

    OBFUSCATION_FILE_OVER_READ_CAP

    golden/audio/email-spellout.wav, line 1

    RIFF�WAVEfmt �>}FLLR�

    golden/audio/tech-support.wav, line 1

    RIFFziWAVEfmt �>}FLLR�

  • Licence

    Pass

    A licence file is present (LICENSE).

  • Maintainer activity

    Pass

    The latest commit is within the last 365 days.

Get the full report on this tool, £49

Note

Hygiene check of commit 0d61233b2150. reads an environment variable. a file was over the read cap and was not fully read.

Date and source

Date checked:

View source

github.com

Commit graded: 0d61233b21503c4024424f45d125ad29a09497cf

This link goes to the original host. PlugVet does not host or check what you download from there, and installing it is your own decision and risk.

Read how this letter is chosen