Calamari在Centos7.1上成功部署的案例分享
***部分：部署環境說明
主機名 IP 角色 服務器版本
其中，Calamari Server的版本是從ceph社區百度網盤共享的鏡像安裝的。
網盤地址是： http://pan.baidu.com/s/1o6BT8sa#path=%252FCalamari%252FCentos%252FCentOS7.1%252BCalamari1.3
注意：本文在部署calamari之前已經將ceph環境部署好
- [root@bgw-os-node151 ~]# ceph -s
- cluster 00000000-0000-0000-0000-000000000002
- health HEALTH_OK
- monmap e1: 3 mons at {bgw-os-node151=192.168.216.151:6789/0,bgw-os- node152=192.168.216.152:6789/0,bgw-os-node153=192.168.216.153:6789/0}, election epoch 380540, quorum 0,1,2 bgw-os-node151,bgw-os-node152,bgw-os-node153
- mdsmap e62: 1/1/1 up {0=bgw-os-node151=up:active}, 2 up:standby
- osdmap e213915: 12 osds: 12 up, 12 in
- pgmap v543085: 384 pgs, 6 pools, 123 MB data, 488 kobjects
- 56185 MB used, 3295 GB / 3350 GB avail
- 384 active+clean
第二部分：Calamari Server端安裝配置
系統安裝(省略)
Calamari Server安裝
關閉selinux
vim /etc/selinux/config
SELINUX=disabled
setenforce 0
關閉iptables
systemctl stop firewalld
chkconfig firewalld off
設置hosts
cat /etc/hosts (需要在上述四個服務器上都執行)
- 192.168.240.200 calamari
- 192.168.216.151 bgw-os-node151
- 192.168.216.152 bgw-os-node152
- 192.168.216.153 bgw-os-node153
設置yum源
上傳鏡像文件(省略)并創建下面的掛載點，掛載鏡像文件
- mkdir -p /iso/calamari
- mkdir -p /iso/centos7
- mount -o loop /opt/CentOS-7-x86_64-DVD-1503.iso /iso/centos7/
- mount -o loop /opt/Calamari-1.3-CentOS-7.1-x86-64-20150430.iso /iso/calamari/
- cat /etc/yum.repos.d/CentOS-Base.repo
- [base]
- name=CentOS-7
- baseurl=file:///iso/centos7
- gpgcheck=0
- cat /etc/yum.repos.d/calamari.repo
- [calamari]
- name=calamari
- baseurl=file:///iso/calamari/
- gpgcheck=0
#p#
安裝基本包
- yum update
- yum -y install vim bash-completion net-tools pciutils sysstat wget
安裝Calamari和diamond包
yum -y install calamari-server diamond
初始化
- /usr/bin/calamari-ctl initialize
- 輸入用戶名：root (保持默認，也可以更改)
- 輸入密碼：123456(隨意設置，用于登錄，***一次設置好，修改比較麻煩)
配置calamari-client
Calamari-client是用來配置calamari登錄、管理所需要的相關頁面
cd ~
- cp /iso/calamari/packages/calamari-clients-20150430.tar.gz .
- tar xf calamari-clients-20150430.tar.gz
- cd calamari-clients/
- cp -r login/dist /opt/calamari/webapp/content/login
- cp -r manage/dist /opt/calamari/webapp/content/manage
- cp -r dashboard/dist /opt/calamari/webapp/content/dashboard
- cp -r admin/dist /opt/calamari/webapp/content/admin
至此，按照社區里奇總分享的鏡像和文檔進行安裝部署都很順利就能完成,感謝奇總!
登錄
登錄時使用上面初始化的用戶名和密碼即可。登錄后出現下面的界面
#p#
第三部分：Ceph端安裝配置
這一步是一個難點，通過各種搜索，終于搞定了，過程如下
查閱資料 http://tracker.ceph.com/issues/7851
安裝epel源
rpm -Uvh dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
上傳diamond-3.4.67-0.noarch.rpm (從上面源里可以找到)
安裝diamond和salt-minion和 ipvsadm
yum install diamond-3.4.67-0.noarch.rpm ipvsadm salt-minion
配置cephdeploy.conf
cat ~/.cephdeploy.conf (新建)
- [ceph-deploy-global]
- [ceph-deploy-install]
- [calamari-minion]
- name=ceph repo noarch packages
- baseurl=http://ceph.com/rpm-emperor/fc19/x86_64
- enabled=1
- gpgcheck=1
- type=repo-md
- gpgkey=https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/autobuild.asc
修改salt-minion配置
cat /etc/salt/minion.d/calamari.conf
- master: 192.168.240.200
如果完成上面的步驟后，直接啟動salt-minion, 然后在calamari server上執行salt-key -L 和 salt-key -A, 不會報錯，但是登錄頁面后看到的是下面的情況，這時候就需要采用下面的方式了(是參考上面資料的)：
將ceph節點加入calamari (三個ceph節點都要執行)
- 在執行下面的操作前，***是先stop掉salt-minion進程，稍等幾分鐘后就可以了
- ceph-deploy calamari --master 192.168.240.200 connect bgw-os-node151
- [ceph_deploy.conf][DEBUG ] found configuration file at: /root/.cephdeploy.conf
- [ceph_deploy.cli][INFO ] Invoked (1.5.9): /usr/bin/ceph-deploy calamari --master 192.168.240.200 connect bgw-os-node151
- [bgw-os-node151][DEBUG ] connected to host: bgw-os-node151
- [bgw-os-node151][DEBUG ] detect platform information from remote host
- [bgw-os-node151][DEBUG ] detect machine type
- [ceph_deploy.calamari][INFO ] Distro info: Red Hat Enterprise Linux Server 6.5 Santiago
- [bgw-os-node151][INFO ] installing calamari-minion package on bgw-os-node151
- [bgw-os-node151][INFO ] adding custom repository file
- [bgw-os-node151][INFO ] Running command: yum clean all
- [bgw-os-node151][DEBUG ] Loaded plugins: product-id, security, subscription-manager
- [bgw-os-node151][DEBUG ] Cleaning repos: base calamari-minion epel extras os-base os-ceph.repo os-epel
- [bgw-os-node151][DEBUG ] : os-i.repo puppet puppet.repo update
- [bgw-os-node151][DEBUG ] Cleaning up Everything
- [bgw-os-node151][WARNIN] This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
- [bgw-os-node151][INFO ] Running command: rpm --import https://ceph.com/git/?p=ceph.git;a=blob_plain;f=keys/autobuild.asc
- [bgw-os-node151][DEBUG ] set the contents of repo file to /etc/yum.repos.d/
- [bgw-os-node151][DEBUG ] creating config dir: /etc/salt/minion.d
- [bgw-os-node151][DEBUG ] creating the calamari salt config: /etc/salt/minion.d/calamari.conf
- [bgw-os-node151][INFO ] Running command: yum -y install salt-minion
- [bgw-os-node151][DEBUG ] Loaded plugins: product-id, security, subscription-manager
- [bgw-os-node151][WARNIN] No data was received after 300 seconds, disconnecting...
- [bgw-os-node151][INFO ] Running command: chkconfig salt-minion on
- [bgw-os-node151][INFO ] Running command: service salt-minion start
- [bgw-os-node151][DEBUG ] Starting salt-minion daemon: [ OK ]
上面啟動成功后，就可以在web界面上看到ceph節點的信息啦(如下圖)! 由于水平有限，歡迎拍磚~
博文出處：http://www.ceph.org.cn/topic/135
