This repo houses a number of examples for the Pulsar Java client. You can see example code in src/main/java/tutorial. Each of these files is a runnable example.

You can access full Javadoc for the pulsar-client library here.

First, you'll need to clone this repo locally:

$ git clone https://github.com/streamlio/pulsar-java-tutorial && \
  cd pulsar-java-tutorial

The repo contains the following:

In order to run these examples, you'll need to install Pulsar and run it in standalone mode on your machine. Instructions for macOS and Linux are directly below.

Standalone mode for Pulsar means that all necessary components---BookKeeper bookies, a Pulsar broker, and a ZooKeeper quorum---run in a single JVM process.

You can install and run Pulsar using Homebrew:

# Register tap
$ brew tap streamlio/homebrew-formulae

# Install
$ brew install streamlio/homebrew-formulae/pulsar

# Start the Pulsar standalone as a background service
$ brew services start pulsar

For instructions on setting up Pulsar and running a standalone cluster on Linux, see the official Pulsar documentation.

You can also run Pulsar using Docker.

The table below lists the examples contained in this repo as well as the command that you'll need to run to start up that example (once you have Pulsar running):

To start up a basic Pulsar Java consumer listening on the topic tutorial-topic:

$ ./gradlew consumerTutorial

If Pulsar is running, you should see something like this in logs when the consumer has successfully subscribed to the topic:

09:55:40.711 [main] INFO  tutorial.ConsumerTutorial - Created consumer for the topic tutorial-topic

Now you can start up a basic Java producer on tutorial-topic in another terminal window:

$ ./gradlew producerTutorial

This producer will send 10 messages on the topic (hello-pulsar-1, hello-pulsar-2, etc.). In the terminal window for the Java consumer, you should see INFO-level logs like this for each message received:

09:57:01.447 [main] INFO  tutorial.ConsumerTutorial - Received message 'hello-pulsar-1' with ID 29:24:-1:0

Pulsar offers a Kafka client wrapper for Java that enables you to use your existing Kafka applications with Pulsar. To start up the Kafka consumer:

$ ./gradlew kafkaConsumerTutorial

You should see this in the logs when the consumer successfully subscribes to the topic tutorial-topic:

10:46:51.648 [main] INFO  tutorial.kafka.KafkaAdaptorConsumer - Consumer successfully subscribed to topics [topic]

The consumer will then poll for (and process) 100 messages at a time. Whenever it finishes processing 100 messages it will re-subscribe to tutorial-topic and begin processing messages again. To start up a producer in a different terminal window:

$ ./gradlew kafkaProducerTutorial

The producer will log successful message sends like so:

10:43:26.408 [main] INFO  tutorial.kafka.KafkaAdaptorProducer - Message with key 979 sent successfully

Meanwhile, the consumer will log each successfully received message:

11:01:19.998 [main] INFO  tutorial.kafka.KafkaAdaptorConsumer - Received record with a key of 6 and a value of hello-6