What is the difference between a Producer/Consumer vs Publisher/Subscriber architecture?
Avatar Idan Asulin
Apr 16, 2023
13 14 15
What is the difference between RabbitMQ vs IBM MQ vs Memphis?
Avatar Yaniv Ben Hemo
Apr 16, 2023
4 5 6
When should I use Redis Pub/Sub vs RabbitMQ vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
8 9 10
What is the difference between SQS vs RabbitMQ vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
5 6 7
What is the difference between RabbitMQ vs ZeroMQ vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
9 10 11
What is the difference between Kafka vs ZeroMQ vs Memphis?
Avatar Yaniv Ben Hemo
Apr 16, 2023
2 3 4
What is the difference between Azure Event Hub vs Kafka vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
5 6 7
How does ActiveMQ vs RabbitMQ vs Kafka vs Memphis work?
Avatar Idan Asulin
Apr 16, 2023
7 8 9
What is ActiveMQ vs IBM MQ vs Memphis?
Avatar Yaniv Ben Hemo
Apr 16, 2023
3 4 5
Apache Pulsar message delivery semantics
4 5 6
Memphis Approach

Pulsar+Flink, Pulsar+Spark, or Pulsar Functions no longer support effectively-once (or exactly-once) semantics. Yes, Pulsar supports de-duplication of data and an idempotent producer, but it isn’t enough for exactly-once semantics. The current functionality supported is only suitable for producing one message to just one partition, and you can implement such semantics manually with a DIY setup in only a few edge cases. For instance, you can’t produce numerous partitions to a partition atomically, which also means that interaction with the state isn’t exactly-once. 

However, Pulsar supports at-most-once semantics where you might lose data and at-least-once semantics, where you won’t lose data, but you might see duplicates. 

Memphis Approach

Memphis supports two delivery semantics: at least once and exactly once. The former is possible because of a combination of published messages that persist on a station and the acknowledgement of each message that the clients receive and process.