blog/content/ceph-benchmarking/index.md

+++ title = "Ceph Benchmarking" date = 2026-03-01 description = "The results of some of my recent ceph benchmarks" draft = true

[taxonomies] categories = ["Homelab"] tags = ["Homelab", "Ceph"] +++

Setup everything for the Benchmarking

On a machine in the ceph-cluster already:

1. Generate a minimal ceph config using ceph config generate-minimal-conf
2. Create a user for Benchmarking
   1. Create a new user ceph auth add client.linux_pc
   2. Edit the caps for my use-case
      • mgr: profile rbd pool=test-rbd
      • mon: profile rbd
      • osd: profile rbd pool=test-rbd
   3. Get the keyring configuration using ceph auth get client.linux_pc

On the client machine doing the Benchmarking:

1. Install basic ceph tools apt-get install -y ceph-common
2. Load the rbd kernel module modprobe rbd
3. Setup local ceph config
   • Copy the generated configuration to /etc/ceph/ceph.conf
   • chmod 644 /etc/ceph/ceph.conf
4. Setup local ceph keyring
   • Copy the keyring configuratio nto /etc/ceph/ceph.client.linux_pc.keyring
   • chmod 644 /etc/ceph/ceph.client.linux_pc.keyring
5. Confirm your configuration is working by running ceph -s -n client.linux_pc

Setup the benchmark itself:

1. rbd create -n client.linux_pc --size 10G --pool test-rbd bench-volume
2. rbd -n client.linux_pc device map --pool test-rbd bench-volume (which should create a new block device, likely /dev/rbd0)
3. mkfs.ext4 /dev/rbd0
4. mkdir /mnt/bench
5. mount /dev/rbd0 /mnt/bench

Benchmarks

TODO

• Try directly on the block device
• Try this using xfs instead of ext4
• Try this with and without drive caches