Packages & Components

Central service orchestrating tracers, redactors, and span lifecycle across workloads.

Tracer adapter bridging to OpenTelemetry for production-grade distributed tracing.

Zero-dependency tracer for test assertions. Captures spans in-process.

Attribute redaction for PII, credentials, and sensitive data in spans.

Function-level @observe and @observe_tool decorators for automatic span instrumentation.

Core MCP service with transport abstraction, tool registration, and capability discovery.

Typed tool registration with schema validation and execution dispatch.

Authentication and authorization hooks for MCP transport connections.

Route workloads across models and providers based on capability, budget, and latency constraints.

Configurable fallback chains with priority ordering and condition-based failover.

Match workload requirements against provider capabilities for optimal routing.

Run evaluation suites against datasets with pluggable scorers and CI-friendly reporting.

Precision, recall, and relevance scoring for retrieval pipeline evaluation.

Compare current results against saved baselines for regression detection.

Load evaluation datasets from JSONL and structured fixtures.

Core policy evaluation engine with typed decisions, violations, and audit trails.

Request and resolve approvals with evidence requirements and TTL enforcement.

Versioned, composable rule collections for reusable policy configurations.

In-memory and pluggable storage for policy rules and resource type filtering.

Load, validate, resolve, and register portable skill packages with typed manifests.

Resolve skill instructions and templates against execution context.

Validate skill manifests and directory structures with diagnostic reporting.

Session management and event orchestration for streaming agent interactions.

Typed event pipeline with cancellation, interruption, and lifecycle hooks.

Structured session state management with domain events and error handling.

Type-safe configuration loading with env, file, and override support.

Structured environment variable resolution with validation.

Runtime type guards, coercions, and assertion helpers.

Structured error classes, result types, and error boundary helpers.

HTTP client foundation with retries, headers, and auth hooks.

Trip-and-recover circuit breaker for external service calls.

Bounded concurrency task executor with backpressure and cancellation.

Token-bucket and sliding-window rate limiters for API calls.

Configurable retry logic with jitter, backoff, and predicate filtering.

Deadline propagation and timeout enforcement across async boundaries.

Unified interface for LLM providers with policy hooks and telemetry.

Adapters for OpenAI, Anthropic, Ollama, and generic HTTP-JSON endpoints.

Force structured JSON output from any LLM with schema validation.

Automatic provider fallback with configurable priority and conditions.

Efficient batch completion with concurrency control and result aggregation.

Semantic and exact-match caching for LLM responses.

Record and replay LLM interactions for deterministic testing.

Pre/post request policy hooks with block, warn, and transform actions.

Detect and redact PII, credentials, and sensitive patterns in prompts.

Heuristic JSON repair for malformed LLM output.

Hash and track prompt templates for lineage and deduplication.

Schema-based input validation with structured error reporting.

Run evaluation suites against RAG pipelines with configurable scorers.

Assertion helpers for LLM output quality checks.

Precision/recall scoring for retrieval relevance.

LLM-as-judge evaluation for answer correctness and coherence.

Structured telemetry events for LLM requests, latency, and outcomes.

Token-level cost tracking across providers and models.

Structured request/response logging with redaction and sampling.

Export traces to OpenTelemetry-compatible backends.

Typed argument parsing, subcommands, and help generation.

Generate new ElectriPy project skeletons with config and structure.

Inspect and validate project configuration from the terminal.

Local dev helpers: run, watch, reset, and fixture loading.