Synthesis, deterministic evals for care in AI.
Rule-based pattern matching that catches relational failure modes in AI responses. No LLM judge, no probabilistic scoring — just auditable evidence for agency, presence, and trust.
Install
npm install @mcptoolshop/synthesis
Eval
npm run build && npm run eval
CI
node dist/index.js --fail-on 0
Design Principles
No LLM judge. No probabilities. Just rules.
Deterministic
Same input always produces the same output. No randomness, no model calls, no flaky results.
Explainable
Every result includes the exact patterns that matched and why. Full evidence for audit.
Agency-First
Catches coercion, directive phrasing, and takeover language. Respects user autonomy.
Presence Over Reassurance
Detects mind-reading claims, unverifiable guarantees, and false comfort that papers over emotion.
Pivot Detection
Catches acknowledge-then-pivot patterns where the assistant abandons emotional vulnerability.
CI-Ready
Exit codes, JSON reports, and --fail-on thresholds. Drop into any pipeline.
Quick Start
Install & run
npm install @mcptoolshop/synthesis
# Build and run evals
npm run build
npm run eval
# Or in development mode
npm run devCI integration
name: Empathy Eval
on:
push:
paths: ['data/**', 'src/**', 'schemas/**']
jobs:
eval:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with: { node-version: '18' }
- run: npm ci && npm run build
- run: npm run evalBuilt-in Checkers
Three checkers ship out of the box.
Report Metrics
Structured JSON output for every run.