What's Included In The Integration?

• Ingest your topics into tables
  Directly map your Kafka topics to destination tables for seamless querying.
• Security SSL/TLS encryption and SASL
  Authenticate and encrypt your Kafka connections using industry-standard security protocols.
• Automatic offset management
  Keep track of consumed messages without worrying about manual checkpointing.
• Automatic retries
  Handle temporary errors gracefully with built-in retry logic.
• Monitoring and observability over the connections
  Get visibility into your Kafka connection status, health, and throughput metrics.
• Schema management and registry support
  Use schema registries (e.g., Confluent Schema Registry) for evolving data formats and compatibility handling.

How to Set It Up

1. Log in to your Airfold account.
2. Press "Create Source".
3. Find and select the Kafka integration.
4. Fill in your Kafka connection details:
   • Bootstrap servers (e.g., broker1:9092,broker2:9092)
   • Security settings (SSL, SASL, certificates if required)
   • Topics you want to ingest
5. Choose or create the destination tables to map your topics.
6. Configure optional settings like consumption starting point (earliest, latest, or specific offset).
7. Press "Save and Start". Your ingestion will begin immediately!