This Claude skill facilitates robust Apache Kafka integration, enabling resilient event-driven architectures with built-in circuit breakers and failure recovery. It streamlines the process of publishing domain events, managing topics, and integrating with Smartico CRM, ensuring zero data loss through database-backed retries and dead letter queue (DLQ) handling.

When should I use kafka?

kafka is useful in the following scenarios: • Implementing resilient event publishing in Spring Boot applications to ensure business flows remain uninterrupted even during Kafka outages. • Designing fault-tolerant domain event systems using circuit breakers and exponential backoff for automatic message retries. • Integrating backend systems with Smartico CRM for real-time event tracking and player engagement in gaming or casino platforms. • Setting up Dead Letter Queues (DLQ) and database-backed failure storage to guarantee data consistency and auditability.

name	kafka
description	\|
Use when	publishing domain events, consuming messages, handling event failures, or integrating with Smartico.
allowed-tools	Read, Edit, Write, Glob, Grep, Bash

Kafka Skill

This project uses Apache Kafka (Confluent Cloud) for event-driven architecture with zero data loss guarantees. The implementation features a resilient async publisher with circuit breaker protection, automatic retry with exponential backoff, and dead letter queue handling.

Key Architecture Decision: Events never break the main business flow. All publishing is fire-and-forget with database-backed failure storage for automatic retry.

Quick Start

Fire-and-Forget Publishing (Recommended)

@Service
class PlayerService(
    private val playerEventService: PlayerEventService
) {
    fun registerPlayer(player: Player) {
        // Business logic completes regardless of Kafka state
        playerEventService.publishPlayerRegistered(player)
    }
}

Publishing with Confirmation

eventPublisher.publishAsync(topic, key, event)
    .thenAccept { result ->
        logger.info("Published: partition={}, offset={}", 
            result.recordMetadata.partition(),
            result.recordMetadata.offset())
    }

Key Concepts

Concept	Usage	Example
Topics	Versioned domain events	`casino.player.registered.v1`
Keys	Partition routing (userId)	`player.id.toString()`
Circuit Breaker	Fail-fast when Kafka down	50% failure threshold
Failed Events	Database-backed retry	`failed_kafka_events` table
DLQ	Final failure destination	`{topic}.dlq` suffix

Common Patterns

Creating a New Event Service

When: Adding event publishing for a new domain

@Service
class PaymentEventService(
    private val eventPublisher: EventPublisher,
    private val metadataBuilder: EventMetadataBuilder
) {
    fun publishDepositCompleted(deposit: Deposit) {
        try {
            val event = DepositEvent(
                eventId = EventBuilder.generateEventId(),
                eventTimestamp = EventBuilder.getCurrentTimestamp(),
                brandId = brandId,
                userId = deposit.playerId.toString(),
                metadata = metadataBuilder.build(),
                payload = DepositPayload(...)
            )
            eventPublisher.publish(
                topic = KafkaTopics.PAYMENT_DEPOSIT_COMPLETED,
                key = deposit.playerId.toString(),
                event = event
            )
        } catch (e: Exception) {
            logger.error("Failed to publish deposit event", e)
            // NEVER throw - event publishing must not break main flow
        }
    }
}

Adding a New Topic

When: Introducing a new event type

// In KafkaTopics.kt
object KafkaTopics {
    // New topic (follow naming: casino.{domain}.{action}.v{version})
    const val LOYALTY_TIER_UPGRADED = "casino.loyalty.tier-upgraded.v1"
}

kafka

When & Why to Use This Skill

Use Cases

Kafka Skill

Quick Start

Fire-and-Forget Publishing (Recommended)

Publishing with Confirmation

Key Concepts

Common Patterns

Creating a New Event Service

Adding a New Topic

See Also

When & Why to Use This Skill

Use Cases

Kafka Skill

Quick Start

Fire-and-Forget Publishing (Recommended)

Publishing with Confirmation

Key Concepts

Common Patterns

Creating a New Event Service

Adding a New Topic

See Also

Related Skills