ceph
/
ceph-ansible
mirror of https://github.com/ceph/ceph-ansible.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Ansible playbooks to deploy Ceph, the distributed filesystem.
488 Commits
79 Branches
457 Tags
49 MiB
Python 85.9%
Jinja 11.2%
Shell 2.3%
Makefile 0.6%
 
 
 
 
Go to file
Leseb 6ae4026c92 Merge pull request #310 from ceph/more-repos 
Add more repo source for stable
 		2015-07-03 16:36:03 +02:00
contrib Adds ansible script to split this repo into roles. 2015-02-23 18:25:37 +01:00
fetch Fix the vagrant deployment 2015-01-06 00:21:16 +01:00
group_vars Add more repo source for stable 2015-07-03 16:35:17 +02:00
library Update provided facts key to return ansible_facts key 2014-03-11 11:12:41 +00:00
roles Add more repo source for stable 2015-07-03 16:35:17 +02:00
tests WIP: first implementation of functional tests 2015-02-22 02:31:28 +01:00
.gitignore Use an external file to manage Vagrant variables 2015-02-24 00:09:29 +01:00
.travis.yml Fix Travis 2015-01-21 16:33:26 +01:00
LICENSE Add Ceph Playbook 2014-03-03 19:08:51 +01:00
README.md Add vagrant demo video 2015-06-30 13:49:49 +02:00
Vagrantfile Cleanup daemon declaration 2015-07-02 15:22:18 +02:00
ansible.cfg Remove ansible managed header from ceph.conf 2014-10-10 15:41:31 +02:00
cluster-maintenance.yml Merge branch 'master' of https://github.com/ceph/ceph-ansible into improve-rolling-upgrade 2015-03-30 17:29:28 +02:00
cluster-os-migration.yml Add support for RGW 2015-04-08 16:19:28 +02:00
dummy-ansible-hosts Fix Travis 2015-01-21 16:33:26 +01:00
install-ansible.sh Minor change: Install latest Ansible from official PPA 2015-06-10 14:14:52 +08:00
monitor_keys_example Add Monitor Keys example 2015-01-30 16:17:46 +01:00
purge-cluster.yml Merge branch 'master' of https://github.com/ceph/ceph-ansible into improve-rolling-upgrade 2015-03-30 17:29:28 +02:00
rolling_update.yml Add more OSD flags 2015-04-27 19:08:05 +02:00
site.yml Only activate restpi when needed 2015-07-03 16:22:27 +02:00
test.yml Fix Travis 2015-01-21 16:33:26 +01:00
vagrant_variables.yml.sample Fix ubuntu box images name 2015-06-16 14:45:59 +02:00

README.md

ceph-ansible

Ansible playbook for Ceph!

Clone me:

git clone https://github.com/ceph/ceph-ansible.git
cp vagrant_variables.yml.sample vagrant_variables.yml

What does it do?

General support for:

  • Monitors
  • OSDs
  • MDSs
  • RGW

More details:

  • Authentication (cephx), this can be disabled.
  • Supports cluster public and private network.
  • Monitors deployment. You can easily start with one monitor and then progressively add new nodes. So can deploy one monitor for testing purpose. For production, I recommend to always use an odd number of monitors, 3 tends to be the standard.
  • Object Storage Daemons. Like the monitors you can start with a certain amount of nodes and then grow this number. The playbook either supports a dedicated device for storing the journal or both journal and OSD data on the same device (using a tiny partition at the beginning of the device).
  • Metadata daemons.
  • Collocation. The playbook supports collocating Monitors, OSDs and MDSs on the same machine.
  • The playbook was validated on Debian Wheezy, Ubuntu 12.04 LTS and CentOS 6.4.
  • Tested on Ceph Dumpling and Emperor.
  • A rolling upgrade playbook was written, an upgrade from Dumpling to Emperor was performed and worked.

Setup with Vagrant

Run your virtual machines:

$ vagrant up
...
...
...
 ____________
< PLAY RECAP >
 ------------
        \   ^__^
         \  (oo)\_______
            (__)\       )\/\
                ||----w |
                ||     ||


mon0                       : ok=16   changed=11   unreachable=0    failed=0
mon1                       : ok=16   changed=10   unreachable=0    failed=0
mon2                       : ok=16   changed=11   unreachable=0    failed=0
osd0                       : ok=19   changed=7    unreachable=0    failed=0
osd1                       : ok=19   changed=7    unreachable=0    failed=0
osd2                       : ok=19   changed=7    unreachable=0    failed=0
rgw                        : ok=20   changed=17   unreachable=0    failed=0

Check the status:

$ vagrant ssh mon0 -c "sudo ceph -s"
    cluster 4a158d27-f750-41d5-9e7f-26ce4c9d2d45
     health HEALTH_OK
     monmap e3: 3 mons at {ceph-mon0=192.168.0.10:6789/0,ceph-mon1=192.168.0.11:6789/0,ceph-mon2=192.168.0.12:6789/0}, election epoch 6, quorum 0,1,2 ceph-mon0,ceph-mon1,ceph-mon
     mdsmap e6: 1/1/1 up {0=ceph-osd0=up:active}, 2 up:standby
     osdmap e10: 6 osds: 6 up, 6 in
      pgmap v17: 192 pgs, 3 pools, 9470 bytes data, 21 objects
            205 MB used, 29728 MB / 29933 MB avail
                 192 active+clean

To re-run the Ansible provisioning scripts:

$ vagrant provision

Specifying fsid and secret key in production

The Vagrantfile specifies an fsid for the cluster and a secret key for the monitor. If using these playbooks in production, you must generate your own fsid in group_vars/all and monitor_secret in group_vars/mons. Those files contain information about how to generate appropriate values for these variables.

Vagrant Demo

Ceph-ansible Vagrant Demo