Muhammad Arif created KAFKA-12179:
-------------------------------------
Summary: Install Kafka on IBM Cloud
Key: KAFKA-12179
URL: https://issues.apache.org/jira/browse/KAFKA-12179
Project: Kafka
Issue Type: Improvement
Components: docs, documentation
Affects Versions: 2.7.0
Reporter: Muhammad Arif
Fix For: 2.7.0
Attachments: Kafka1.png, Kafka1.png, Kafka2.png, KafkaVerify1.png,
KafkaVerify2.png, KafkaVerify3.png, KafkaVerify4.png, Kubernetes1.png,
Kubernetes2.png, Kubernetes3.png, Kubernetes4.png, Kubernetes5.png,
Kubernetes6.png, Kubernetes7.png, Storage1.png, Storage2.png
*Installing Kafka on IBM Cloud*
*+Contents+*
# Introduction
# Provision Kubernetes Cluster
# Deploy IBM Cloud Block-Storage Plugin
# Deploy Kafka
# Verifying the Kafka Installation
*Introduction*
To complete this tutorial, you should have an IBM Cloud account, if you do not
have one, please [register/signup|https://cloud.ibm.com/registration] here.
For installing Kafka, we have used the Kubernetes cluster, and used the IBM
Cloud Block-Storage plugin for our persistent volume. Upon the completion of
this tutorial, you would have the Kafka up and running on the Kubernetes
cluster.
# Provision the Kubernetes cluster, if you have already setup one, skip to
step 2.
# Deploy the IBM Cloud Block-Storage Plugin to the created cluster, if you
have already done this, skip to step 3.
# Deploy the Kafka.
*Provision Kubernetes Cluster*
* Click on the *Catalog* button on top center. Open
[Catalog|https://cloud.ibm.com/catalog].
* In search catalog box, search for *Kubernetes Service* and click on it
* You are now at Create Kubernetes Cluster page, there you have the two plans
to create the Kubernetes cluster, either using free plan or standard plan.
*Using Free Plan:*
* Select Pricing Plan as “*Free*”.
* Click on *Create*.
* Wait a few minutes, and then your Cloud would be ready.
*_>Note_*_: Please be careful when choosing free cluster, as your pods could be
stuck at pending state due to insufficient compute and memory resources, if you
face such kind of issue please increase your resource by creating them choosing
the standard plan._
*Using Standard Plan:*
* Select Pricing Plan as “*Standard*”
* Select your Kubernetes Version as latest available or desired one by
application, in our example we have set it to be ‘*18.13*’.
**
* Select Infrastructure as “*Classic*”
* Leave Resource Group to “*Default*”
* Select Geography as “*Asia*” or your desired one.
* Select Availability as “*Single Zone*”.
> _This option allows you to create the resources in either single or multi
> availability zones. Multi availability zone provides you the option to create
> the resources in more than one availability zones so in case of catastrophe
> it could sustain the disaster and continues to work._
* Select Worker Zone as *Chennai 01.*
*__*
* In Worker Pool, input your desired number of nodes as “*3*”
* Leave the Encrypt Local Disk option to “*On*”
* Select Master Service Endpoint to “*Both private and public endpoints*”
* Give your cluster-name as “*Kafka-Cluster*”
* Provide *tags* to your cluster and click on *Create*.
* Wait a few minutes, and then your Cloud would be ready.
*Deploy IBM Cloud Block-Storage Plugin*
* Click on the *Catalog* button on top center.
* In search catalog box, search for *IBM Cloud Block Storage Plug-in* and
click on it
* Select your cluster
* Provide *Target Namespace* as “*kafka-storage*”, leave *name* and *resource
group* to *default*
* Click on *Install*
*Deploy Kafka*
* Again go to the *Catalog* and search for Kafka.
* Provide the details as below.
* Target: *IBM Kubernetes Service*
* Method: *Helm chart*
* Kubernetes cluster: *Kafka-Cluster*(jp-tok)
* Target namespace: *kafka*
* Workspace: *kafka-01-07-2021*
* Resource group: *Default*
* Click on *Parameters with Default Values*, you can set the deployment values
or use the default ones, we have used the default ones in this example.
* Click on *Install*.
*Verifying the Kafka Installation*
* Go to the *Resources List*in the Left Navigation Menu and click on
*Kubernetes* and then *Clusters*
* Click on your created *Kafka-Cluster.*
* A screen would come up for your created cluster, click on *Actions,* and
then *Web Terminal*
* A warning will appear asking you to install the Web Terminal, click on **
* When the terminal is installed, click on the action button again and click
on web terminal and type the following command in below command window. It will
show you the workspaces of your cluster, you can see *kafka* active.
$ kubectl get ns
$ kubectl get pod –n Namespace –o wide
$ kubectl get service –n Namespace
The installation is done. Enjoy!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
