Introduction: Before I even start talking about Apache Kafka here, is it possible to use list of keys in Kafka? Yes, It’s all possible. In this post, we’ll see how to use multiple keys/value pairs with multiple filters. First create a simple Kafka producer and a Kafka consumer in a Spring Boot application using a […]
Posts Tagged ‘Kafka’
Spring Cloud Functions and Kafka
Introduction: Spring Cloud Stream is a framework for building message-driven microservice applications. Spring Cloud Stream builds upon Spring Boot and uses Spring Integration to provide connectivity to message brokers. It provides configuration of middleware, introducing the concepts of publish-subscribe, consumer groups, and partitions. Example: To use SCF (Spring Cloud Function) with in SCS(Spring Cloud […]
Keep Your Fish Warm: Event-Driven Architecture on OpenShift
Typically, the idea of container orchestration is associated with DevOps, and while IT departments have quickly adopted the tech for OPS, the development part has been misunderstood and underrated. With the array of OpenShift tools at a developers’ disposal, it’s time to deliver on the premise of DevOps and bring power back to the developers. […]
Real-time Machine Learning in Azure
In the war of cloud computing, AWS is currently the undisputed leader but Microsoft Azure seems to be chipping away at AWS’ lead with every passing quarter. While Google Cloud offers impressive tools as well, it is struggling to keep pace with Azure. This could be traced to Microsoft’s longer tenure in the enterprise market. […]
How to Integrate Custom Zookeeper with Kafka Cluster
The zookeeper is a popular configuration management and coordination centralized service supported by Apache. It manages the metadata based on a tree-like, hierarchical structure which make it respond quickly and integrally even in a huge distributed system like Kafka. It is required for Kafka by default, but most enterprises will have their own Zookeeper system. […]
How to Produce and Customize a Kafka Message
The Kafka became more and more popular as a famous real-time message delivering and communication system for a period of years. It was born in LinkedIn and contributed to Apache in 2011. Then it grew to be one of the top Apache projects. For now, it has been accepted by thousands of enterprises as the […]
How to Install a Kafka Cluster in Docker Containers
The Kafka is a stable and real-time communication and message delivery distribution system. Usually the enterprise Kafka application and system will ask for several machine servers supports. But for proof-of-concept or for special circumstances, we want to show you a simpler way to use the Kafka application. Below, I will show you how to install a Kafka […]
Big Data and You: DataOps
Welcome to “Big Data and You (the enterprise IT leader),” the Enterprise Content Intelligence group’s demystification of the “Big Data” . The often missing piece of the Infrastructure as code movement emerging from the DevOps space is what we think of as DataOps. Big Data technologies are uniquely poised to fill this gap because they […]