Reading tracker active
0 / 7 read
0%
← Home
Architecture Notes

Technical Writing

Notes on distributed systems, AI infrastructure, databases, and observability. Written for engineers who want depth, not surface-level takes.

AI AGENT OBSERVABILITY · SIX AGENTS, ONE NORMALIZED EVENTAGENTClaudeBORROWAGENTCursorTRUSTAGENTCopilotINVENTAGENTCodexINVENTAGENTGeminiINVENTAGENTLangChainINVENTPER-TENANT BUFFERAggregatorflush · 5s or 100 eventsMESSAGE QUEUEKafkapartitioned by tenantASYNC WRITERSConsumersSEARCH INDEXElasticsearchone document per spanRESULT6 agents → 3 identity strategies → 1 shapearyan.devai-infrastructure · observability
NEW
ai-infrastructureobservability

Building an Observability Dashboard for AI Agents at Scale

How we turned six AI coding agents' disconnected request logs into searchable, navigable conversations — identity resolution across Claude, Cursor, Copilot, Codex, Gemini and LangChain, Kafka-backed ingestion at scale, and session reconstruction at query time in Elasticsearch.

Jul 12, 2026·5 min read
SYSTEM IMPROVEMENT STUDY · KAFKA CONSUMER RE-ARCHITECTURELOAD GENERATORk6 · JMeterKAFKA PARTITIONP0KAFKA PARTITIONP1KAFKA PARTITIONP2CONSUMERC0CONSUMERC1CONSUMERC2RESULT1 hour → 36 seconds · 100× throughputaryan.devdistributed-systems · observability
distributed-systemsobservability

Kafka, Parallel Consumers, and the 6-Hour Testing Bottleneck

How I redesigned a Kafka consumer architecture to achieve 100x throughput improvement — eliminating offset safety bugs, rebalance storms, and crash recovery failures in a production API security testing pipeline.

May 25, 2026·6 min read