In-App
Data Streaming Platform
An open-source, real-time data processing platform for in-app data streaming use cases.
Install Memphis by pasting one of the commands below in your terminal,
and start doing data streaming on a massive scale, focusing on logic, not configuration.
curl -s https://memphisdev.github.io/memphis-docker/docker-compose.yml -o docker-compose.yml && docker compose -f docker-compose.yml -p memphis up
helm repo add memphis https://k8s.memphis.dev/charts/ --force-update && helm install memphis memphis/memphis --create-namespace --namespace memphis
Memphis is great for
Task management
Use memphis to create an async task queue
Real-time pipelines
Move chunks of data between pipeline stages
Data ingestion
Ingest high throughput data streams
Queuing
Memphis is great for queuing purposes
Offline webapps
Use memphis to store user actions while offline
Microservices communication
Persist your data as it flows between microservices
Why Memphis?
1-Command Deployment
Runs natively on any Kubernetes and Docker environments, and fully optimized from the get-go.
Resilient
Resiliency is one of Memphis's core building blocks.
Out-of-the-box dead-letter-queue, resource optimizations, and events restoration without code changes.
Connectors
A hub of ready-to-use connectors written by the community and popular applications like S3, Snowflake, Firebolt, BigQuery, and more
Zero-Ops
A message broker with an amazing DevEx and UI for both data engineers and developers with real-time troubleshooting and tracing of ingested data.
Schema Management
Unique, robust, and easy-to-use schema management. It includs live schema evolution, transformation, validation, and enforcement for data contracts.
Stream processing
Enrich and analyze streamed data upon arival using serverless functions
1-Command Deployment
Runs natively on any Kubernetes and Docker environments, and fully optimized from the get-go.
Zero-Ops
A message broker with an amazing DevEx and UI for both data engineers and developers with real-time troubleshooting and tracing of ingested data.
Resilient
Resiliency is one of Memphis's core building blocks.
Out-of-the-box dead-letter-queue, resource optimizations, and events restoration without code changes.
Schema Management
Unique, robust, and easy-to-use schema management. It includs live schema evolution, transformation, validation, and enforcement for data contracts.
Connectors
A hub of ready-to-use connectors written by the community and popular applications like S3, Snowflake, Firebolt, BigQuery, and more
Stream processing
Enrich and analyze streamed data upon arival using serverless functions
Messaging Queue in 3 steps
Reduce your dev time with building event-driven apps by 90% compared to other MQs like Kafka, and RabbitMQ.
A real-time data platform, crafted to eliminate the heavy-lifting from Data Engineers and Developers.
Step 1
Connect
Go to http://localhost:9000/login
kubectl port-forward service/memphis-ui 9000:80 --namespace memphis & ; kubectl port-forward service/memphis-cluster 7766:7766 --namespace memphis & ; kubectl port-forward service/control-plane 6666:6666 6667:80 --namespace memphis &
Step 2
Login
root
memphis
Step 3
Create
Contributors
Coming Up
4 Key Design Principles and Guarantees of Streaming Databases
A deep analysis of the critical considerations to think about when building a streaming database
v0.3.6 is out!
Main Features:
- UI improvements
- Better Performance
- AWS & GCP Terraforms
- System logs screen is now available
