Hadoop Distributed Storage Cluster : “Share Limited Storage of Slave to the Master”

Tamim Dalwai
2 min readOct 22, 2020

--

Hola guys 🙋🏻‍♂️,
In this article we are going to see ”how we can share limited storage of slave node with master node.”

For demo I have used two virtual machine one as a master node one as slave node.

🔰 Prerequisites :
Install jdk and Hadoop software in both the machines and just follow this tutorial 🔥

🔰 Creating external HDD and Attaching it to VM :

First of all I have created one external drive for slave node which is of size 2GB and attached it to the slave virtual machine.

🔰 Partitioning , formmating , mounting that drive to directory :

For any storage to make in use we have to follow three steps first is to partition the drive and after partitioning format that drive and final step is to mount it to start using it. In first step we have attached external drive of 2GB to slave node out of which we are going to share only 100MB storage with the master node. So for this we have to partition the external drive with the size of 100MB and also have to mount it to the directory which we want to share with the master.

🔰 Configuring the slave node with mounted directory :

As we have mounted the created partition to the directory, now we are going to configure the slave node with that directory.
Follow the video tutorial 👇🏻.

🔰 Configuration of master node :

Now it’s time to make our master node.in this below video I have shown how you can configure the master node.

✅ Final Test :

Now all setup is done and only thing remaining is to format the master node and start the services of master and slave nodes.

In the above video after running the below command,

#hadoop dfsadmin -report

We can see that slave node has shared limited storage i.e. 100MB with the master node even though it’s actual size is 2GB.

Thanks for reading 🤝🏻

Happy Learning 😊

--

--

No responses yet