Yadda za a Kafa Samuwar Samun Namenode - Sashe na 5


Hadoop yana da abubuwa biyu masu mahimmanci wadanda sune HDFS da YARN. HDFS shine don adana bayanan, YARN kuma don sarrafa bayanan. HDFS shine Hadoop Rarraba Tsarin Fayil, yana da Namenode azaman Babbar Jagora da Datanode azaman Bawa.

Namenode shine babban ɓangaren Hadoop wanda ke adana metadata na bayanan da aka adana a cikin HDFS. Idan Namenode ya sauka, gaba dayan gungu ba za a iya samun damar su ba, shine maki guda daya na gazawa (SPOF). Don haka, yanayin samarwa zai kasance mai Samun Namenode mai yawa don kaucewa lalacewar kayan aiki idan Namenode ɗaya ya sauka saboda dalilai daban-daban kamar haɗarin inji, ayyukan gyaran da aka shirya, da dai sauransu.

Hadoop 2.x ya samar da damar inda zamu sami Namenodes guda biyu, daya zai kasance mai aiki Namenode wani kuma zai kasance Tsayayyar Namenode.

  • Namenode mai aiki - Yana sarrafa duk ayyukan kwastomomi.
  • Namenode Na Jiran - Ba shi da aikin Namenode mai aiki. Idan Active NN ya faɗi ƙasa, to Tsayayyar NN za ta ɗauki duk nauyin Aiki mai aiki

Kunna Namenode High Availability yana buƙatar Zookeeper wanda yake wajibi ne don ɓata kai tsaye. ZKFC (Mai Kula da Kyautar Dabba) abokin ciniki ne na Zookeeper da ake amfani da shi don kula da jihar Namenode.

  • Mafi Kyawawan Ayyuka don Sanya Hadoop Server akan CentOS/RHEL 7 - Sashe na 1
  • Kafa Hadoop Abubuwan da ake buƙata da Hardarfafa Tsaro - Sashe na 2
  • Yadda za a Shigar da Sanya Manajan Cloudera akan CentOS/RHEL 7 - Sashe na 3
  • Yadda za a Shigar da CDH da kuma Sanya Wuraren Sabis akan CentOS/RHEL 7 - Sashe na 4

A cikin wannan labarin, zamu ƙarfafa Namenode High Availability a cikin Cloudera Manager.

Mataki 1: Shigarwa na Zookeeper

1. Shiga cikin Cloudera Manager.

http://Your-IP:7180/cmf/home

2. A cikin hanzarin aiki na Cluster (tecmint), zaɓi\"Serviceara Sabis".

3. Zaɓi sabis\"Zookeeper".

4. Zaɓi sabobin inda za a girka Zookeeper.

5. Zamu sami Masu Kula da Zoo 3 don samar da Kundin Makiyaya. Zaɓi sabobin kamar yadda aka ambata a ƙasa.

6. Sanya kadarorin Zookeeper, a nan muna da wadanda muke dasu. A cikin lokaci na ainihi, dole ne ku sami keɓaɓɓun kundin adireshi/wuraren hawa don adana bayanan Zookeeper. A cikin Sashe-1, munyi bayani game da daidaitawar ajiya don kowane sabis. Danna 'ci gaba' don ci gaba.

7. Shigarwa zai fara, da zarar an shigar da Zookeeper za'a fara. Kuna iya duba ayyukan bango anan.

8. Bayan nasarar kammala wannan matakin na sama, Matsayi zai 'ishedare'.

9. Yanzu, An yi nasarar Shigar da Tsararrun Maɗaukaki. Danna 'Gama'.

10. Kuna iya duba sabis na Zookeeper akan Dashboard Cloudera Manager.

Mataki 2: Kunna Namenode High Availability

11. Jeka zuwa Manajan Cloudera -> HDFS -> Ayyuka -> Enable High Availability.

12. Shigar da Sunayen Sunaye azaman\"nameservice1" - Wannan sanannen filin suna ne na mai aiki da mai jiran aiki Namenode.

13. Zaɓi Namenode na biyu inda zamu sami Namenode mai jiran aiki.

14. Anan muke zaban master2.linux-console.net don jiran Namenode.

15. Zaɓi nodes na Jarida, waɗannan ayyuka ne na tilas don aiki tare da Active da Namenode na jiran aiki.

16. Muna yin Quorum Journal ta hanyar sanya Journal node a cikin sabobin 3 kamar yadda aka ambata a ƙasa. Zaɓi sabobin 3 kuma danna 'Ok'.

17. Danna 'Ci gaba' don ci gaba.

18. Shigar da hanyar kundin adireshin Jarida. Kawai muna buƙatar ambaci hanyar yayin shigar da wannan kundin adireshin za a ƙirƙira ta atomatik ta sabis ɗin kanta. Muna ambata a matsayin ‘/ jn’ . Danna 'Ci gaba' don ci gaba.

19. Zai fara kunna High Availability.

20. Da zarar mun kammala duk abubuwanda ake gudanarwa, zamu sami Matsayin 'Finarshe'.

21. A ƙarshe, za mu sami sanarwa 'An sami nasarar kunna babban Samu'. Danna 'Gama'.

22. Tabbatar da Namenode mai aiki da Jiran aiki ta hanyar zuwa Manajan Cloudera -> HDFS -> Misalai.

23. Anan, zaku iya yin Namenodes biyu, ɗayan zai kasance a cikin 'Active' wani kuma zai kasance a cikin 'Jiran aiki'.

A cikin wannan labarin, mun shiga cikin mataki zuwa mataki don bawa Namenode High Availability dama. Ana ba da shawarar sosai don samun Namenode High Availability a cikin dukkanin gungu a cikin yanayi na ainihi. Da fatan za a sanya shakku idan kun fuskanci wani kuskure yayin yin wannan aikin. Za mu ga Babbar Jagorar Ma'aikata a cikin labarin na gaba.