What is the difference between SQS vs RabbitMQ vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
14 15 16
What is the difference between RabbitMQ vs ZeroMQ vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
10 11 12
What is the difference between Kafka vs ZeroMQ vs Memphis?
Avatar Yaniv Ben Hemo
Apr 16, 2023
2 3 4
What is the difference between Azure Event Hub vs Kafka vs Memphis?
Avatar Idan Asulin
Apr 16, 2023
5 6 7
How does ActiveMQ vs RabbitMQ vs Kafka vs Memphis work?
Avatar Idan Asulin
Apr 16, 2023
7 8 9
What is ActiveMQ vs IBM MQ vs Memphis?
Avatar Yaniv Ben Hemo
Apr 16, 2023
3 4 5
What is IBM MQ?
Avatar Yaniv Ben Hemo
Apr 16, 2023
4 5 6
What is an mq server?
Avatar Idan Asulin
Apr 16, 2023
3 4 5
How does mq messaging take place?
Avatar Idan Asulin
Apr 16, 2023
2 3 4
What happens when the Kafka broker goes down?
6 7 8
Memphis Approach

A Kafka broker receives messages from producers and stores them on a disc with a unique offset.
A Kafka broker enables consumers to retrieve messages by topic, partition, and offset. 

If a Kafka broker goes offline for an extended time, it will likely return online but be far behind in logs.
Therefore, it will need to catch up on logs from the remaining brokers before being reintroduced into the In-Sync Replica (ISR).
During normal operation, replicas communicate with one another.
However, if one broker is significantly behind, we adjust settings to enable Kafka to spend more resources on keeping replicas up to date.
Because all partition replicas on the broker become unavailable during a broker outage, the availability of the affected partitions is determined by the existence and status of their other replicas.
If a partition has no additional replicas, it becomes inaccessible.
The settings on which they depend are:

  • Min.isync.replicas
  • Default.replication.factor
  • Unclean.leader.election.enable

When the broker goes down, however, Kafka does not create a new replica.
You will have to wait for the broker to become available, but if you need a replica, you can use the reassignment tool kafka-reassign-partitions.sh to move partitions to available brokers.
In addition, when you restart the broker, it will attempt to reconnect.
Once completed, whether it remains a follower or becomes the leader is determined by whether it is the appropriate replica.

Reference: https://jaceklaskowski.gitbooks.io/apache-kafka/content/kafka-brokers.html

Memphis Approach

A Memphis message broker is a software that uses an architectural pattern to transport, transform, and route messages.
It mediates application communication by reducing the mutual awareness that applications must have of each other to exchange messages, effectively implementing decoupling.

The message broker’s primary function is to decouple services by handling communication between them.
Memphis tries to handle this situation better because of its asynchronized task management.
In addition, since there are multiple recipients for a single message, systems can receive the message from any recipient if one of the clients’ message brokers goes down.

Reference: https://docs.memphis.dev/memphis/memphis/concepts/message-broker