Conductor High Availability Cluster Upgrade Guide

Overview

This guide explains how to upgrade a high-availability Conductor Manager cluster to a new version.
Since the old version of Studio Conductor cluster was active-passive, the guide is the same for both this case and the Studio Conductor All-In-One case.
The best-practice to upgrade Studio Conductor is to deploy the new version on a new set of hosts, therefore a new host should be created for every existing Manager.

Upgrade to new hosts

Create and download a snapshot from the existing Manager. Please refer to the Backup and restore guide for further instructions.
Install a new Studio Conductor cluster. Please refer to the Studio Conductor cluster installation guide for further instructions.
After the cluster and CLI installation is done, ssh into all Managers except one (best practice - 2 out of 3) and run cfy_manager stop. This would stop Studio Conductor services on these hosts.
Copy the snapshot to the last Manager (the only active one).

Ssh into this Manager, and run the following code:

sudo /opt/patroni/bin/patronictl -c /etc/patroni.conf show-config | sudo tee /etc/patroni.conf.bak
sudo /opt/patroni/bin/patronictl -c /etc/patroni.conf edit-config -s ttl=86400 -s retry_timeout=86400 --force
if [[ -f /etc/haproxy/haproxy.cfg ]]; then
  sudo sed -i.bak -e 's/timeout client.*$/timeout client 1440m/' -e 's/timeout server.*$/timeout server 1440m/' /etc/haproxy/haproxy.cfg
  sudo service haproxy reload
fi

This will increase the Patroni and HAproxy timeouts, which is necessary for large snapshots to restore correctly.

On the same Manager, upload the snapshot, and restore it. Please refer to the Backup and restore guide for further instructions.

After the restore is done, revert the Patroni and HAproxy timeouts to their defaults:

sudo /opt/patroni/bin/patronictl -c /etc/patroni.conf edit-config --apply /etc/patroni.conf.bak --force
if [[ -f /etc/haproxy/haproxy.cfg ]]; then
  sudo mv /etc/haproxy/haproxy.cfg.bak /etc/haproxy/haproxy.cfg
  sudo service haproxy reload
fi

Connect to the inactive Managers, and on each one run cfy_manager start.
Reinstall agents. Please refer to the Agents installation guide for further instructions.
Delete old host/s.