ThrottleAI

dormant prototype

ThrottleAI

A token-based lease governor for AI calls — small enough to embed anywhere, strict enough to prevent stampedes.

Lightweight, token-based AI governance for TypeScript

Version

1.1.2

License

MIT

Kind

library

Languages

TypeScript, JavaScript

Lines of code

9,519

Last commit

2026-04-20 (0d ago)

Health signals

Tests: yes README: yes LICENSE: yes Buildable: unknown

Patterns proven here

concurrency signal-processing

ThrottleAI enforces concurrency limits on in-flight calls with weighted slots and an interactive priority reserve.

Why it matters

ThrottleAI provides a way to enforce concurrency, rate limits, and fairness when making AI model calls, helping prevent resource exhaustion and ensuring fair access to the underlying models.

ThrottleAI

Health signals

Patterns proven here

Why it matters

Tags