Tech Architecture

Complete technical infrastructure for running 209 AI agents with zero ops team

Monthly Cost

$13,223

Infrastructure + LLM costs

Cost per Task

$0.044

97% cheaper than humans

Throughput

10K+

Agent tasks per day

Agent Infrastructure

Execute individual agents with proper isolation, context management, and model routing

Agent Runtime

Node.js + TypeScript

Execute agents with Anthropic Claude API (Haiku/Sonnet/Opus routing)

DockerAWS ECSBullMQ

Context Management

Redis + PostgreSQL

Short-term (Redis) and long-term (PostgreSQL + S3) context storage

ValkeyPineconeVector Search

Orchestration Platform

Temporal.io

Coordinate multi-agent workflows and handle agent handoffs

KafkaEvent BusApproval Queue

Model Routing

Smart Cost Optimization

70% Haiku, 25% Sonnet, 5% Opus = 6x cost savings

Haiku: $0.25/1MSonnet: $3/1MOpus: $15/1M

Human Oversight Dashboards

Monitor agent activity, approve sensitive operations, and override decisions

Back Office Dashboard

Real-time agent activity feed, approval queue, player 360 view, manual overrides

React + shadcn/uiWebSocketstRPC

Approval Workflows

4-tier system: auto-approve → specialist → manager → super admin

Tier 1: <$100Tier 2: $100-$1KTier 3: $1K-$10KTier 4: >$10K

Audit & Compliance Dashboard

Immutable logs, blockchain-backed critical actions, anomaly detection

PostgreSQLEthereum7-year retention

Agent Performance Dashboard

Track approval rate, override rate, error rate, cost metrics, and quality KPIs

Approval: >95%Override: <5%Error: <1%

Data & Integration Layer

Unified interface for agents to call external services and manage data

Agent API Gateway

Unified interface for Back Office API, PaymentIQ, SEON, and 1,795+ endpoints

KongRate LimitingOAuth 2.0

Tool Registry

Catalog of all tools agents can use with usage examples and rate limits

PostgreSQLJSON SchemaAdmin Panel

Event Bus

Pub/sub messaging for agent-to-agent communication and real-time events

Apache KafkaSchema RegistryEvent Replay

Data Warehouse

Store all agent decisions for analysis, ML training, and compliance reporting

SnowflakeAirbyte ETLMetabase BI

Developer Tools

Test, debug, and optimize agents before deployment

Agent Testing Framework

Unit, integration, regression, and load tests for all agents

JestGitHub ActionsMock APIs

Agent Playground

Interactive testing with real or mock data, cost calculator, output viewer

Monaco EditorReal-time TestingToken Tracking

Workflow Builder

Drag-and-drop visual tool to design multi-agent workflows

React FlowTemporal.ioOne-click Deploy

Agent Versioning

Canary deployments, A/B testing, one-click rollback for all agents

GitLaunchDarklyDatadog

Tech Stack Summary

Complete list of technologies powering the agent operation

Core Infrastructure

• Node.js (TypeScript)

• Temporal.io

• Apache Kafka

• PostgreSQL

• Redis/Valkey

• Kong API Gateway

AI & ML

• Anthropic Claude

• Pinecone (Vector DB)

• PyTorch (Fine-tuning)

Frontend

• React + TypeScript

• shadcn/ui

• tRPC

• WebSockets

DevOps

• AWS (ECS, RDS, S3)

• GitHub Actions

• Datadog

• PagerDuty

Data & Analytics

• Snowflake

• Airbyte (ETL)

• Metabase (BI)

Security

• Manus OAuth

• AWS Secrets Manager

• Ethereum (Audit Logs)