Apache Kafka Docker Image Installation and Usage Tutorial on Windows

Introduction

My previous tutorial was on Apache kafka Installation on Linux. I used linux operating system (on virtualbox) hosted in my Windows 10 HOME machine. At times, it may seem little complicated becuase of the virtualbox setup and related activities. Hence, I thought of writing this tutorial to run kafka purely on windows. For this purpose, I had to upgrade my Windows 10 HOME operating system to Windows 10 Pro.

While searching, I got a good deal and purchased the Windows 10 Pro license key from shopclues 

Tech Stack

Here is the tech stack for this tutorial.

Installation and verification

You can download the Docker for Windows from docker official download page. Ensure to download from stable channel only. Once downloaded, installation is pretty straight forward; just follow the simple instructions. Next, click on the Docker for Windows icon on desktop to start the docker. When you click this icon, you may see a pop-up like following asking to enable Hyper-V feature. Click on OK Button.

windows-10-docker-hyper-v-enable-warning

windows-10-docker-hyper-v-enable-warning

You may have to wait for a while;as the system will restart automatically. Keep patience, once the machine starts, docker will be in running state. You can check the docker running status from the task bar, bottom right corner.

Now, open a command prompt and run the command docker –version like below; you will see the version of the docker running.

Now to ensure, the docker is properly installed and set, we will run hello-world image. Execute the following command –

When it runs, you will see some texts like below. The highlighted lines (8-9) shows that docker installation appears proper.

Kafka Image Installation on Windows

We will use a docker image to install Kafka. The image we’ll use here, is developed by Landoop. The image and the usage instruction is available in github; refer to https://github.com/Landoop/fast-data-dev.

Run the following command; it will fetch the Landoop’s Kafka image and and run the same. While the command is running, if you notice Windows/any other firewall blocking some apps; grant access  –

In the command window, you will notice logs like below –

First few lines in the log warns about insufficient memory and possible performance issue. We can still continue using this setup. However, if you have enough RAM available in your system, you can also use steps mentioned in landoop github page to create a better performing setup (by assigning more RAM).

Now, you can also access landoop’s excellent web-portal by hitting http://127.0.0.1:3030. This portal will provide you a comprehensive visual representation of your Kafka setup. You will see a UI depicting the current setup of Kafka.  You’ll be able to see number of schema, topics etc. Towards the end of the page, you will also see various service ports. You will see a running circle under the COYOTE HEALTH CHECKS. This is basically verifying the settings. Depending on your system’s configuration, it may take some time to complete. Below is a snapshot of the UI in my laptop while writing the post –

kafka-landoop-ui-components

kafka-landoop-ui-components

 

7

2 Responses

  1. Rohit
    October 15, 2018
  2. Sadruddin Md
    October 15, 2018

Write a response

This site uses Akismet to reduce spam. Learn how your comment data is processed.