Posts Tagged ‘Kafka’

Download

Multiple Keys/Value pair with Custom Filters in Apache Kafka

Introduction: Before I even start talking about Apache Kafka here, is it possible to use list of keys in Kafka? Yes, It’s all possible. In this post, we’ll see how to use multiple keys/value pairs with multiple filters. First create a simple Kafka producer and a Kafka consumer in a Spring Boot application using a […]

Design for customer needs

Spring Cloud Functions and Kafka

Introduction: Spring Cloud Stream is a framework for building message-driven microservice applications. Spring Cloud Stream builds upon Spring Boot and uses Spring Integration to provide connectivity to message brokers. It provides configuration of middleware, introducing the concepts of publish-subscribe, consumer groups, and partitions.   Example: To use SCF (Spring Cloud Function) with in SCS(Spring Cloud […]

Development Team Cooperating In Their Office.

Keep Your Fish Warm: Event-Driven Architecture on OpenShift

Typically, the idea of container orchestration is associated with DevOps, and while IT departments have quickly adopted the tech for OPS, the development part has been misunderstood and underrated. With the array of OpenShift tools at a developers’ disposal, it’s time to deliver on the premise of DevOps and bring power back to the developers. […]

Real-time Machine Learning in Azure

In the war of cloud computing, AWS is currently the undisputed leader but Microsoft Azure seems to be chipping away at AWS’ lead with every passing quarter. While Google Cloud offers impressive tools as well, it is struggling to keep pace with Azure. This could be traced to Microsoft’s longer tenure in the enterprise market. […]

How to Integrate Custom Zookeeper with Kafka Cluster

The zookeeper is a popular configuration management and coordination centralized service supported by Apache. It manages the metadata based on a tree-like, hierarchical structure which make it respond quickly and integrally even in a huge distributed system like Kafka. It is required for Kafka by default, but most enterprises will have their own Zookeeper system. […]

How to Produce and Customize a Kafka Message

The Kafka became more and more popular as a famous real-time message delivering and communication system for a period of years. It was born in LinkedIn and contributed to Apache in 2011. Then it grew to be one of the top Apache projects. For now, it has been accepted by thousands of enterprises as the […]

How to Install a Kafka Cluster in Docker Containers

The Kafka is a stable and real-time communication and message delivery distribution system. Usually the enterprise Kafka application and system will ask for several machine servers supports. But for proof-of-concept or for special circumstances, we want to show you a simpler way to use the Kafka application. Below, I will show you how to install a Kafka […]

Big Data and You: DataOps

Welcome to “Big Data and You (the enterprise IT leader),” the Enterprise Content Intelligence group’s demystification of the “Big Data” . The often missing piece of the Infrastructure as code movement emerging from the DevOps space is what we think of as DataOps. Big Data technologies are uniquely poised to fill this gap because they […]