Kyawawan Ayyuka don Sanya Hadoop Server akan CentOS/RHEL 7 - Sashe na 1


A cikin wannan jerin labaran, zamu rufe dukkanin ginin Cloudlus Hadoop Cluster Cluster tare da Mai sayarwa da Masana'antu mafi kyawun ayyuka.

Shigar OS da yin matakin OS pre-requisites sune matakan farko don gina Hadoop Cluster. Hadoop na iya yin aiki a kan dandano daban-daban na dandamali na Linux: CentOS, RedHat, Ubuntu, Debian, SUSE da dai sauransu. a cikin wannan jerin koyarwar.

A cikin Organizationungiya, ana iya shigar da OS ta amfani da kickstart. Idan rukuni ne na 3 zuwa 4, girke-girke na hannu yana yiwuwa amma idan mun gina babban tari tare da fiye da node 10, yana da wuya a girka OS ɗaya bayan ɗaya. A wannan yanayin, hanyar Kickstart ta shigo hoto, zamu iya ci gaba tare da girka taro ta amfani da kickstart.

Samun kyakkyawan aiki daga Mahalli na Hadoop ya dogara da samar da ingantattun Kayan aiki & Kayan aiki. Don haka, ginin masana'antar Hadoop tari ya ƙunshi yin la'akari mai yawa game da Kayan aiki da Software.

A cikin wannan labarin, zamu bi ta wasu Abubuwan Alamar game da girke-girke na OS da wasu kyawawan ayyuka don tura Serverera Hadoop Cluster Server akan CentOS/RHEL 7.

Muhimmiyar Tunani da Ingantattun Ayyuka don Sanya Hadoop Server

Abubuwan da ke zuwa sune mafi kyawun ayyuka don saita tura Cloudera Hadoop Cluster Server akan CentOS/RHEL 7.

  • sabobin Hadoop basa buƙatar sabobin daidaitattun kamfanoni don gina tarin, yana buƙatar kayan masarufi.
  • A cikin rukunin samarwa, ana bada shawarar samun diski na bayanai 8 zuwa 12. Dangane da yanayin nauyin aiki, muna buƙatar yanke shawara akan wannan. Idan gungu don aikace-aikace ne masu ƙididdigar lissafi, samun tuki 4 zuwa 6 shine mafi kyawun aiki don kauce wa al'amuran I/O.
  • Ya kamata a raba masu tafiyar da bayanai daban-daban, misali - fara daga/data01 zuwa/data10.
  • Ba a ba da shawarar daidaita RAID ba don nodes na ma'aikata, saboda Hadoop kanta tana ba da haƙuri-kan haƙuri ta hanyar maimaita tubalan zuwa 3 ta tsohuwa. Don haka JBOD shine mafi kyawu ga mahaɗan ma'aikata.
  • Ga Master Servers, RAID 1 shine mafi kyawun aiki.
  • Tsarin fayil ɗin tsoho akan CentOS/RHEL 7.x shine XFS. Hadoop yana goyan bayan XFS, ext3, da ext4. Tsarin fayil ɗin da aka ba da shawarar ext3 ne yayin da aka gwada shi don kyakkyawan aiki.
  • Duk sabobin su kasance suna da nau'I na OS iri ɗaya, aƙalla ƙaramar sakiyar da ta dace.
  • Mafi kyawun aiki shine a sami kayan haɗi iri ɗaya (duk ƙwararrun ma'aikatu su sami halaye iri ɗaya (RAM, sararin faifai & Core da sauransu).
  • Dangane da yawan aiki na aiki (Balanced Workload, Compute Intensive, I/O Intensive) da girma, tsarin (RAM, CPU) a kowace sabar zai banbanta.

Nemo Misalin da ke ƙasa don Rabawar Disk na sabobin ajiya 24TB.

Shigar da CentOS 7 don Serveraddamar da Sabar Hadoop

Abubuwan da kuke buƙatar sani kafin shigar da sabar CentOS 7 don Hadoop Server.

  • installationaramar shigarwa ta isa ga Hadoop Servers (ma'aikatan nodes), a wasu lokuta, ana iya shigar da GUI kawai don sabar Jagora ko sabobin Gudanarwa inda za mu iya amfani da masu bincike don UI na Gidan yanar gizo na kayan aikin Gudanarwa.
  • Ana daidaita ayyukan cibiyoyin sadarwa, sunan mai masauki, da sauran saitunan da suka danganci OS bayan girka OS.
  • A cikin lokaci na ainihi, masu siyar da kayan aiki zasu kasance suna da nasu na'ura mai kwakwalwa don mu'amala da sarrafa sabar, misali - Kamfanin Dell suna da iDRAC wanda yake na'urar ne, an saka ta cikin sabobin. Amfani da wannan hanyar iDRAC ɗin za mu iya shigar OS tare da samun hoton OS a cikin tsarinmu na gida.

A cikin wannan labarin, mun girka OS (CentOS 7) a cikin VMware mai amfani. Anan, ba za mu sami fayafai da yawa don aiwatar da ɓangarori ba. CentOS yayi kama da RHEL (aiki iri ɗaya), saboda haka zamu ga matakan girka CentOS.

1. Farawa ta hanyar saukar da hoton CentOS 7.x ISO a cikin tsarin windows na gida ku zabi shi yayin kunna na'urar kama-da-wane. Zaɓi 'Sanya CentOS 7' kamar yadda aka nuna.

2. Zaɓi Yare, tsoho zai zama Ingilishi, sannan danna ci gaba.

3. Zaɓin Software - Zaɓi 'Minananan Shigarwa' kuma danna 'Anyi'.

4. Kafa tushen kalmar sirri kamar yadda zai tunzura mu mu saita.

5. Gurin Shigarwa - Wannan shine mahimmin matakin taka tsantsan. Muna buƙatar zaɓar diski inda za a shigar da OS, yakamata a zaɓi keɓaɓɓiyar faifai don OS. Danna 'Instaddamarwar allationaddamarwa' kuma zaɓi Faifan, a ainihin lokacin-diski masu yawa za su kasance a wurin, muna buƙatar zaɓar, wanda aka fi so 'sda'.

6. Sauran Zaɓuɓɓukan Ma'aji - Zaɓi zaɓi na biyu (Zan saita rarrabuwar kawuna) don saita rarraba OS ɗin da ke da alaƙa kamar/var,/var/log,/gida,/tmp,/opt,/swap.

7. Da zarar kayi, fara shigarwa.

8. Da zarar an gama Shigarwa, sai a sake kunna sabar.

9. Shiga cikin sabar kuma saita sunan mai masauki.

# hostnamectl status
# hostnamectl set-hostname tecmint
# hostnamectl status

A cikin wannan labarin, mun wuce cikin matakan shigarwa na OS da kyawawan halaye don rarraba tsarin fayiloli. Waɗannan duka ƙa'idodi ne na gaba ɗaya, gwargwadon yanayin nauyin aiki, ƙila muna buƙatar mu mai da hankali kan ƙarin nuances don cimma mafi kyawun aikin gungu. Tsarin gungu zane ne ga mai gudanarwa na Hadoop. Za mu yi zurfin zurfafa zurfafawa cikin matakan farko na OS da tsaro Hardening a cikin labarin na gaba.