Real-Time Distributed Search Platform

TypeScriptPostgreSQLDebeziumKafkaElasticsearchDocker
Real-Time Distributed Search Platform

A real-time distributed search platform built using Change Data Capture (CDC). Database changes in PostgreSQL are captured via Debezium and streamed into Apache Kafka. A TypeScript-based consumer service processes events and indexes documents into Elasticsearch, enabling scalable, near real-time search capabilities.

Key Features

  • Real-time database change streaming
  • Event-driven indexing architecture
  • Scalable Kafka consumer groups
  • Near real-time Elasticsearch indexing
  • Loose coupling between database and search layer
  • Production-style distributed pipeline design