Pulsar

Connect your Pulsar topics to Airfold to ingest your streaming data.
Get Started Now

3 Reasons to Connect Your Pulsar

  1. Ingest your topic in real-time
    Stream your Pulsar topics instantly into fast, queryable tables without waiting for batch jobs or manual exports. Capture every event as it happens.
  2. Connect to topics you're already using
    Tap into the topics your applications already produce — no need for custom pipelines or new data flows. Simply select your existing topics and start ingesting.
  3. Connect to topics other teams published
    Leverage data across your organization by subscribing to topics other teams maintain. Break down silos and turn shared Pulsar topics into accessible datasets for your team.

What's Included In The Integration?

  • Ingest your Pulsar topics into tables
    Directly map your Pulsar topics to destination tables for seamless querying.
  • Security: TLS encryption and authentication support
    Secure your connections with TLS encryption and choose from multiple authentication methods, including token-based authentication and Athenian.
  • Automatic message acknowledgment and cursor management
    Automatically manage message consumption and track progress without manual intervention.
  • Automatic retries
    Handle temporary errors gracefully with built-in retry logic.
  • Monitoring and observability over the connections
    Monitor the status, health, and performance of your Pulsar connections with detailed metrics.
  • Schema management and registry support
    Utilize Pulsar's schema registry to manage data formats and ensure compatibility as your schemas evolve.

How to Set It Up

  1. Log in to your account.
  2. Press "Create Source".
  3. Find and select the Pulsar integration.
  4. Enter your Pulsar service URL and configure authentication (e.g., token, Athenian).
  5. Select the Pulsar topics to ingest and map them to your destination tables.
  6. Configure optional settings, such as the starting point for consumption (earliest, latest, or specific message ID).
  7. Press "Save and Start". Your ingestion will begin immediately!

Heading 1

Heading 2

Heading 3

Heading 4

Heading 5
Heading 6

Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur.

Block quote

Ordered list

  1. Item 1
  2. Item 2
  3. Item 3

Unordered list

  • Item A
  • Item B
  • Item C

Text link

Bold text

Emphasis

Superscript

Subscript

Want to talk to an Airfold expert?

30 minute advisory call with no strings attached.