ThrottleAI

dormantprototype

ThrottleAI

A token-based lease governor for AI calls — small enough to embed anywhere, strict enough to prevent stampedes.

Lightweight, token-based AI governance for TypeScript

Version

1.1.2

License

MIT

Kind

library

Languages

TypeScript, JavaScript

Lines of code

9,519

Last commit

2026-05-26 (26d ago)

Health signals

Tests: yesREADME: yesLICENSE: yesBuildable: unknown

Patterns proven here

concurrencysignal-processing

ThrottleAI enforces concurrency limits on in-flight calls with weighted slots and an interactive priority reserve.

Why it matters

ThrottleAI provides a way to enforce concurrency, rate limits, and fairness when making AI model calls, helping prevent resource exhaustion and ensuring fair access to the underlying models.

ThrottleAI

Health signals

Patterns proven here

Why it matters

Tags