io.github.lonniev/roastify-mcp v0.22.6
This server scored F. Run it behind runtime policy enforcement so one bad tool call can't become an incident.
- highTool descriptions free of injection markers — 4 marker(s) across 4 tool(s)
- mediumNo over-broad / destructive tools — 1 over-broad tool(s)
Security controls
Deterministic, evidence-backed. Score earned from passing controls; a failed guard caps it.
Security controls
Deterministic, evidence-backed. Score earned from passing controls; a failed guard caps it.
Model–MCP Runtime Guardrails
- FailIndirect Prompt Injection (IPI) Defensesguard4 marker(s) across 4 tool(s)
Tool/prompt/resource text is free of hidden instructions that could hijack the agent. How many servers fail this?
roastify_request_credential_channel — exfiltration directiveroastify_receive_credentials — exfiltration directiveroastify_request_patron_credentials — exfiltration directiveroastify_receive_patron_credentials — exfiltration directiveFix: Remove hidden directives, HTML/comment instructions, and override phrasing from descriptions.
- FailUser-in-the-Loop / Approval Scopeguard1 over-broad tool(s)
No over-broad or destructive tools (arbitrary shell, bulk-delete) that warrant human approval. How many servers fail this?
roastify_delete_operator_credentialFix: Scope tools narrowly; avoid arbitrary command execution and destructive defaults.
- WarnStrict JSON Schema Enforcementschemas not strict
Tool inputs are constrained (additionalProperties:false), so unexpected arguments can't be smuggled in.
Fix: Set additionalProperties:false and require explicit parameters on every tool.
- N/ATool Definition Integrityguardno prior version to diff
Every consecutive version pair is diffed for new injection markers or destructive scope — a risky diff anywhere in history is a rug-pull (fail, durable); benign description drift warns.
Application Security Checks
- WarnNo path traversalguard6 occurrences
Naive path checks let tools read/write outside intended directories (EscapeRoute-class).
frontend/src/components/NpubGate.tsx:55frontend/src/components/NpubGate.tsx:56frontend/src/courier/mcp-lite.ts:52frontend/src/courier/mcp-lite.ts:56Fix: Resolve to a canonical path and verify containment; reject ../ and symlinks.
- WarnNo SSRF sinksguard11 occurrences
Fetching tool-supplied URLs can pivot into internal networks and metadata services.
frontend/public/tools/roastify-push.js:27frontend/public/tools/roastify-push.js:30frontend/public/tools/roastify-push.js:55frontend/public/tools/roastify-push.js:73Fix: Allow-list destinations; reject arbitrary/loopback/link-local URLs.
- WarnHas a security policyno security policy
A SECURITY.md gives a private path to report vulnerabilities.
Fix: Add SECURITY.md with a disclosure contact and process.
- WarnAdoption & popularitylimited adoption
A small, capped nudge from stars/downloads — widely-used servers get more eyes on bugs. It can never offset a real security failure.
Fix: Adoption grows naturally with real-world use; this never gates the score.
- PassDependencies pinned (lockfile)lockfile present
A lockfile makes installs reproducible and resistant to silent dependency swaps.
- PassNo command-injection sinksguardno sinks found
Untrusted tool input reaching a shell yields remote code execution.
- PassNo dynamic code executionguardno sinks found
eval()/exec()/Function() on tool-derived strings allows arbitrary code execution.
- PassNo unsafe deserializationguardno sinks found
pickle/yaml.load/etc. on untrusted data can execute code.
- PassNo committed secretsguardno secrets found
Hardcoded keys/tokens in published source are live credentials an attacker can use.
- PassCredentials sourced from environmentreads credentials from environment
Reading secrets from env/secret stores avoids hardcoding them.
- PassNo known-vulnerable dependencies128 runtime deps, no known CVEs
Runtime dependencies (parsed from the lockfile) are scanned against OSV.dev for published CVEs. Advisory: flagged dependencies lower the score but don't hard-cap it, since transitive reachability is unproven.
- PassActively maintainedrecent commits
Unmaintained servers don't receive security fixes.
- PassRepository not archivedguardactive
Archived repositories will never be patched.
- PassDeclares a licenseApache-2.0
A clear license is required for legal enterprise use.
- Not checkedSigned releasesnot evaluated
Signed releases let consumers verify artifacts weren't tampered with.
- N/ANo install/post-install scriptsguardno published package
install hooks run arbitrary code on every consumer at install time.
- N/APackage name not typosquattingguardno published package
Names mimicking popular packages are a common malware delivery vector.
- N/APublished with provenanceno published package
Build provenance attests the artifact was built from the claimed source by CI.
- N/AEstablished maintainerno published package
Brand-new / single anonymous maintainers raise takeover and malware risk.
Transport & Trust Model
- WarnExecution Sandboxingruns natively (no container image)
A container/sandbox image limits blast radius; a server that runs natively has full host access.
Fix: Ship a Dockerfile/Containerfile (or document a sandboxed run) so the server runs isolated.
- PassTransport Encryption (TLS)guardall remotes use HTTPS
Plaintext HTTP exposes traffic and bearer tokens to interception.
- PassIAM / Authentication ScopingOAuth / PRM handling detected
OAuth 2.1 / Protected Resource Metadata gates who can invoke tools.
- PassNetwork Exposureno bind-all detected
Binding 0.0.0.0 or exposing debug inspectors widens the attack surface.
- N/ALive Endpoint Reachablenot dynamically scanned
A dynamic scan connected to the declared remote endpoint and it responded — verified live, not a dead URL.
- N/AAuthentication Enforced (live)not dynamically scanned
If the server declares auth is required, it must actually reject anonymous clients. Serving tools to unauthenticated callers is a real exposure.