Yadda ake Shigar CDH da Sanya Sanadin Sabis akan CentOS/RHEL 7 - Sashe na 4
A cikin labarin da ya gabata, munyi bayanin shigarwar Cloudera Manager, a cikin wannan labarin, zaku koyi yadda ake girka da saita CDH (Cloudera Distribution Hadoop) a cikin RHEL/CentOS 7.
Yayin shigar da kunshin CDH, dole ne mu tabbatar da Cloudera Manager da dacewa CDH. Cloudera version yana da sassa 3 -
Misali, muna amfani da Cloudera Manager 6.3.1 da CDH 6.3.2. Anan 6 babba ne kuma 3 shine ƙananan sigar. Manya da orananan dole ne su zama iri ɗaya don guje wa al'amuran dacewa.
- Mafi Kyawawan Ayyuka don Sanya Hadoop Server akan CentOS/RHEL 7 - Sashe na 1
- Kafa Hadoop Abubuwan da ake buƙata da Hardarfafa Tsaro - Sashe na 2
- Yadda za a Shigar da Sanya Manajan Cloudera akan CentOS/RHEL 7 - Sashe na 3
Za mu ɗauki ƙananan nodes 2 don ƙasa don CDH. Tuni mun girka Cloudera Manager a cikin master1, shima muna amfani da master1 azaman repo server.
master1.linux-console.net worker1.linux-console.net
Mataki 1: Zazzage CDH Parcels akan Babbar Jagora
1. Da farko, a haɗa zuwa uwar garken master1 kuma zazzage fayilolin CDH Parcels a cikin/var/www/html/cloudera-repos/cdh directory. Dole ne mu sauke fayilolin 3 da ke ƙasa da aka ambata waɗanda ya kamata su dace da RHEL/CentOS 7.
CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha1 manifest.json
2. Kafin sauke waɗannan fayilolin, tabbatar ka ƙirƙiri cdh directory ƙarƙashin/var/www/html/cloudera-repos/location.
$ cd /var/www/html/cloudera-repos/ $ sudo mkdir cdh $ cd cdh
3. Na gaba, zazzage fayilolin 3 da muka ambata a sama ta amfani da umarnin wget mai zuwa.
$ sudo wget https://archive.cloudera.com/cdh6/6.3.2/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel $ sudo wget https://archive.cloudera.com/cdh6/6.3.2/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha1 $ sudo wget https://archive.cloudera.com/cdh6/6.3.2/parcels/manifest.json
Mataki na 2: Saitin Cloudera Manager Repo Akan Abokan Aikin
4. Yanzu, haɗi zuwa sabobin ma'aikaci kuma kwafe fayil ɗin repo (Cloudera-manager.repo) daga sabar repo (master1) zuwa duk sauran sabar ma'aikacin. Wannan fayil ɗin repo yana tabbatar da sabobin cewa duk abubuwan da ake buƙata da RPMs za a sauke su daga sabar repo yayin girkawa.
cat >/etc/yum.repos.d/cloudera-manager.repo <<EOL [cloudera-repo] name=cloudera-manager baseurl=http://104.211.95.96/cloudera-repos/cm6/ enabled=1 gpgcheck=0 EOL
5. Da zarar an kara repo, saika lissafa wuraren ajiyar bayanan don tabbatar da cewa an kunna Cloudera-manager repo.
$ yum repolist
Mataki na 3: Shigar Daemons Manajan Cloudera da Wakili akan Sabbin Ma'aikata
6. Yanzu, muna buƙatar shigar da girgije-manajan-daemons da Cloudera-manager-wakili a cikin duk sauran sabar.
$ sudo yum install cloudera-manager-daemons cloudera-manager-agent
7. Gaba, kuna buƙatar saita wakili na Cloudera Manager don ba da rahoton sabar Cloudera Manager.
$ sudo vi /etc/cloudera-scm-agent/config.ini
Sauya localhost tare da adreshin uwar garken Cloudera Manager IP.
8. Fara Wakilin Cloudera Manager kuma tabbatar da halin.
$ sudo systemctl start cloudera-scm-agent $ sudo systemctl status cloudera-scm-agent
Mataki na 4: Shigar da saita CDH
Muna da kunshin CDH a cikin sabar master1 - repo. Tabbatar cewa duk sabobin suna da fayil na Cloudera Manager repo fayil a /etc/yum.repos.d/ idan kun bi shigarwa ta atomatik ta amfani da Cloudera Manager.
9. Shiga cikin Manajan Cloudera ta amfani da URL na ƙasa a tashar tashar jiragen ruwa 7180 kuma yi amfani da sunan mai amfani da kalmar wucewa ta Manajan Cloudera.
http://104.211.95.96:7180/cmf/login Username: admin Password: admin
10. Da zarar ka shiga, za a gaishe ka da shafin Maraba. Anan zaku iya samun bayanan Saki, Sabbin Fasali na Manajan Cloudera.
11. Karɓi Lasisin kuma Ci gaba.
12. Zaɓi Bugawa. An zaɓi sigar fitina ta tsohuwa, za mu iya ci gaba da hakan.
13. Yanzu, bi Matakan Shigar Matsala. Ci gaba da Shafin Maraba.
14. Sanya wa gungu kuma ku ci gaba, mun sanya masa suna\"tecmint". Akwai nau'ikan gungu 2 da zaku iya ayyana su. Muna ci gaba da Regular Cluster.
- Gungu-gungu na Yau da kullun: Zai ƙunshi kumburin ajiya, ƙididdigar ƙira, da sauran hidimomin da ake buƙata.
- uteididdigar uteididdigar: Za ta ƙunshi ƙwayoyin lissafi kawai. Ana iya amfani da ajiyar waje don adana bayanai.
15. Mun riga mun sanya Cloudera Manager Agents a cikin dukkan sabobin. Kuna iya samun waɗancan sabobin a cikin\"A halin yanzu Rundunan Mai Gudanarwa". Don shigarwa ta atomatik, dole ne ku shigar da FQDN ko IP na sabobin a cikin zaɓi na "" Sabbin Rundunoni "kuma bincika. Cloudera Manager zai gano rundunonin da muke buƙatar shigar CDH kai tsaye.
Anan, latsa\"A halin yanzu Rundunan Mai Gudanarwa", zaɓi duk rundunonin ta zaɓi 'Sunan mai masauki' kuma ci gaba.
16. Zaɓi Ma'aji - ta amfani da celunshi hanya ce da aka ba da shawarar. Danna 'Optionsarin Zaɓuɓɓuka' don saita wurin ajiya.
17. Shigar da adireshin URL na gida kamar yadda aka ambata a ƙasa. Cire duk sauran wuraren adana jama'a wadanda suke nuna yanar gizo (Cloudera Repositories).
Wannan shine URL ɗin CDH na cikin gida wanda muke riƙe a cikin master1.
http://104.211.95.96/cloudera-repos/cdh/
18. Da zarar an shigar da adireshin ajiya na URL, wannan shafin zai nuna alamun da ke akwai kawai. Ci gaba da wannan matakin.
19. Yanzu ana ta zazzage parcels, ana rarrabawa, ba'a kwashe su ba, kuma ana kunna su a cikin dukkan sabobin da ake dasu.
20. Da zarar an kunna CDH Parcels, bincika inspectungiya. Wannan matakin zai yi duba lafiyar mahalartar. Anan muke tsallakewa muna Cigaba.
Mataki na 5: Tsarin Kanfiga
21. Anan muna buƙatar zaɓar Sabis ɗin da za'a girka a cikin Cluster. Wasu abubuwan haɗuwa zasu kasance ta hanyar tsoho, zamu tafi tare da Sabis na Custom.
22. A cikin Sabis-sabis na Kwastomomi, muna shigar da Compananan Maɗaukaki ne kawai (HDFS da YARN) don wannan dalilin demo.
23. Sanya matsayin ga sabar. Zamu iya siffantawa bisa ga bukatunmu. Nemo ginshiƙi na ƙasa wanda ke bayanin describesididdigar Rawar da aka ba da shawara don ƙaramin ƙaramin rukuni na asali tare da nodes 5 zuwa 20 tare da Avaramar Samuwa.
24. Zaɓi nau'in Bayanan Bayanai, sunan masauki, Sunan DB, Sunan mai amfani, da Kalmar wucewa. Kamar yadda muke amfani da Embedded PostgreSQL, za'a zaɓi shi ta tsohuwa. Gwada haɗin, ya kamata ya ci nasara.
25. Wannan shafin zai nuna tsoffin abubuwan daidaito na HDFS da Yarn, gami da kundayen bayanai. Yi nazarin dukkan bayanan sanyi kuma zaku iya yin canje-canje idan an buƙata. Sannan Ci gaba da wannan.
26. Wannan shafin zai nuna cikakkun bayanai game da umarnin 'Farkon Gudu'. Kuna iya fadada shi don ganin cikakkun bayanai game da umarni masu gudana. Idan akwai wata hanyar sadarwa ko lamuran izini a cikin gungu, wannan matakin zai gaza. Yawancin lokaci, wannan matakin yana yanke shawarar shigarwa mai sauƙi na Ginin Cungiya.
27. Da zarar an gama matakin da ke sama, Danna 'isharshe' don kammala shigarwar. Wannan shine Dashboard na Cloudera Manager bayan girka CDH.
http://104.211.95.96:7180/cmf/home
Mun kammala Cloudera Manager da CDH girkawa cikin nasara. A cikin Cloudash Manager Dashboard, zaku iya samun saitunan jadawalin da aka riga aka ayyana inda zaku iya saka idanu Cluster CPU, Disk IO da sauransu. Zamu iya sarrafa dukkan Cungiyoyin ta amfani da wannan Cloudera Manager. Za mu ga duk ayyukan gudanarwa a cikin labarai masu zuwa.