AKAI TSUKI

System development or Technical something

Try to install Ceph in CentOS 7 referencing "STORAGE CLUSTER QUICK START"

Before you read this page, please check below page.
Install Ceph in CentOS 7. - AKAI TSUKI

STORAGE CLUSTER QUICK START

Please check this url.
http://docs.ceph.com/docs/master/start/quick-ceph-deploy/

Install ceph-deploy tool.

[root@ceph04 ~]# yum install ceph-deploy

When I execute ceph-deploy command, "ImportError" occurred.

[root@ceph04 ~]$ mkdir my-cluster
[root@ceph04 ~]$ cd my-cluster
[cuser@ceph04 my-cluster]$ ceph-deploy --help
Traceback (most recent call last):
  File "/usr/bin/ceph-deploy", line 18, in <module>
    from ceph_deploy.cli import main
  File "/usr/lib/python2.7/site-packages/ceph_deploy/cli.py", line 1, in <module>
    import pkg_resources
ImportError: No module named pkg_resources
[cuser@ceph04 my-cluster]$

So I install python2-pip.

[cuser@ceph04 my-cluster]$ sudo yum -y install python2-pip

then I can execute ceph-deploy.
I specify ceph01 one of the nodes for the command parameter.

[cuser@ceph04 my-cluster]$ ceph-deploy new ceph01
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cuser/.cephdeploy.conf
 *snip*
[cuser@ceph04 my-cluster]$

I confirm created files.

[cuser@ceph04 my-cluster]$ ls -1
ceph.conf
ceph-deploy-ceph.log
ceph.mon.keyring
[cuser@ceph04 my-cluster]$

I installed ceph to ceph cluster nodes (ceph01 ceph02 ceph03).

[cuser@ceph04 my-cluster]$ ceph-deploy install ceph01 ceph02 ceph03
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cuser/.cephdeploy.conf
 *snip*
[ceph03][DEBUG ] Complete!
[ceph03][INFO  ] Running command: sudo ceph --version
[ceph03][DEBUG ] ceph version 13.2.0 (79a10589f1f80dfe21e8f9794365ed98143071c4) mimic (stable)
[cuser@ceph04 my-cluster]$
[cuser@ceph04 my-cluster]$ ceph-deploy mon create-initial
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cuser/.cephdeploy.conf
 *snip*
[cuser@ceph04 my-cluster]$

http://docs.ceph.com/docs/master/start/quick-ceph-deploy/#create-a-cluster
This page show that there is ceph.bootstrap-rbd.keyring file on the local directory.
But ceph.bootstrap-rbd.keyring file don't exsit.

[cuser@ceph04 my-cluster]$ ls -1
ceph.bootstrap-mds.keyring
ceph.bootstrap-mgr.keyring
ceph.bootstrap-osd.keyring
ceph.bootstrap-rgw.keyring
ceph.client.admin.keyring
ceph.conf
ceph.conf.org
ceph-deploy-ceph.log
ceph.mon.keyring
[cuser@ceph04 my-cluster]$
[cuser@ceph04 my-cluster]$ ceph-deploy admin ceph01 ceph02 ceph03
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cuser/.cephdeploy.conf
 *snip*
[cuser@ceph04 my-cluster]$

Deploy a manager daemon to ceph01.

[cuser@ceph04 my-cluster]$ ceph-deploy mgr create ceph01
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cuser/.cephdeploy.conf
 *snip*
[cuser@ceph04 my-cluster]$

I specify the unused disk /dev/sdb for each nodes.

[cuser@ceph04 my-cluster]$ ceph-deploy osd create --data /dev/sdb ceph01
[ceph_deploy.conf][DEBUG ] found configuration file at: /home/cuser/.cephdeploy.conf
 *snip*
[ceph_deploy.osd][DEBUG ] Host ceph01 is now ready for osd use.
[cuser@ceph04 my-cluster]$
[cuser@ceph04 my-cluster]$ ceph-deploy osd create --data /dev/sdb ceph02
[cuser@ceph04 my-cluster]$ ceph-deploy osd create --data /dev/sdb ceph03

I confirm status. I get "HEALTH_OK" message.

[cuser@ceph04 my-cluster]$ ssh ceph01 sudo ceph health
HEALTH_OK
[cuser@ceph04 my-cluster]$