How do I replace an auxiliary database station?

Purpose

Perform this procedure to replace an auxiliary database station with a station that has the same IP address, for example, after a hardware failure.

 

Add a hostname entry for the replacement station to the /etc/hosts file on each existing auxiliary database station.

Note: The hostname must be the fully qualified hostname, and not the short hostname.

Note: Hostnames are case-sensitive.


Log in as the root user on the replacement auxiliary database station.


Add a hostname entry to the /etc/hosts file on the replacement station using the following criteria.

  • The first entry for the station hostname in the file must be the station IP address that is reachable by each main server and NSP cluster.

  • The hostname must be the fully qualified hostname, and not the short hostname.

  • The hostname must:

    • contain only ASCII alphanumeric and hyphen characters.

    • not begin or end with a hyphen.

    • not begin with a number.

    • comply with the format defined in IETF RFC 1034.

    • use period characters delimit the FQDN components.

    • not exceed 63 characters.

Note: Hostnames are case-sensitive.


Transfer the following auxiliary database installation files to an empty directory on the auxiliary database station:

Note: You must ensure that the directory is empty.

Note: In subsequent steps, the directory is called the software directory.

  • nspos-auxdb-R.r.p-rel.v.rpm

  • VerticaSw_PreInstall.sh

  • nspos-jre-R.r.p-rel.v.rpm

  • vertica-R.r.p-rel.tar

where

R.r.p is the NSP release identifier, in the form MAJOR.minor.patch

v is a version number


Open a console window.


Navigate to the software directory.

Note: The directory must contain only the installation files.


Enter the following:

chmod +x * ↵


Enter the following:

./VerticaSw_PreInstall.sh ↵

The script displays configuration messages like the following, and a prompt:

Logging Vertica pre install checks to log_file

INFO: About to set proxy parameters in /etc/profile.d/proxy.sh...

INFO: Completed setting proxy parameters in /etc/profile.d/proxy.sh...

INFO: About to set kernel parameters in /etc/sysctl.conf...

INFO: Completed setting kernel parameters in /etc/sysctl.conf...

INFO: About to change the current values of the kernel parameters

INFO: Completed changing the current values of the kernel parameters

INFO: About to set ulimit parameters in /etc/security/limits.conf...

INFO: Completed setting ulimit parameters in /etc/security/limits.conf...

INFO: Backing up /etc/logrotate.conf to /etc/logrotate.conf.orig

INFO: Removing /var/log/wtmp entry from /etc/logrotate.conf

INFO: Adding /etc/logrotate.d/wtmp

Checking user group nsp... 

Adding user group nsp... 

Checking user nsp... 

Adding nsp... 

Checking Vertica user group samauxdb... 

Adding Vertica user group samauxdb... 

Checking Vertica user samauxdb... 

Adding samauxdb... 

Set password for samauxdb... New password:


Enter a password that conforms to the RHEL password criteria.

The following prompt is displayed:

Retype new password:


10 

Re-enter the password.

Messages like the following are displayed:

Changing password for user samauxdb.

passwd: all authentication tokens updated successfully.

Adding samauxdb to /etc/cron.allow

Moving logfile from /tmp ...

     ... to /opt/nsp/nfmp/auxdb/install/log

Changing ownership of the directory /opt/nsp/nfmp/auxdb/install to samauxdb:samauxdb.

Removing group write and world permissions from the directory /opt/nsp/nfmp/auxdb/install.

Appending Vertica section to /opt/nsp/nfmp/auxdb/install/.bashrc ...

Creating /opt/nsp/nfmp/auxdb/data for Vertica database files.

Changing ownership of /opt/nsp/nfmp/auxdb files.

INFO: Creating auxiliary database prep script.

INFO: Creating nspos-auxdb-prep systemd service.

INFO: Enabling nspos-auxdb-prep systemd service.

**************************************************************************                                                                       ** Changes were made that require a restart.                             ** Please restart this host before proceeding with Vertica installation. **                                                                       **************************************************************************

11 

Perform the following steps to restart the station.

  1. Enter the following:

    systemctl reboot ↵

    The station reboots.

  2. When the reboot is complete, log in to the station as the root user.

  3. Open a console window.

  4. Navigate to the software directory.


12 

Enter the following:

tar xvf vertica-R.r.p-rel.tar $(tar tf vertica-R.r.p-rel.tar | sort -V | tail -1) ↵


13 

Enter the following:

dnf install *.rpm ↵

The dnf utility resolves any package dependencies, and displays the following prompt:

Total size: nn G

Installed size: nn G 

Is this ok [y/N]: 


14 

Enter y. The following and the installation status are displayed as each package is installed:

Downloading packages:

Running transaction check

Running transaction test

Transaction test succeeded

Running transaction

The package installation is complete when the following is displayed:

Complete!


15 

Perform the following steps on each auxiliary database station.

  1. Log in to the station as the root user.

  2. Open a console window.

  3. Enter the following:

    rm -f ~root/.ssh/known_hosts ↵

  4. Enter the following:

    rm -f ~samauxdb/.ssh/known_hosts ↵


16 

Log in to an existing auxiliary database station as the root user.

Note: The station must be an auxiliary database station other than the station that you are replacing.


17 

Open a console window.


18 

Open the /etc/security/limits.conf file for viewing.


19 

Copy the following lines:

# The following 1 line added by Vertica tools. timestamp

samauxdb - nice value

# The following 1 line added by Vertica tools. timestamp

samauxdb - nofile value


20 

Close the file.


21 

Transfer the copied lines to the new station.

  1. Log in as the root user on the replacement station.

  2. Open the /etc/security/limits.conf file using a plain-text editor such as vi.

  3. Paste in the lines copied in Step 19 at the end of the file.

  4. Close the file.

  5. Enter the following to disable the auxiliary database services:

    systemctl disable nspos-auxdbproxy.service ↵

    systemctl disable nspos-auxdb.service ↵

    systemctl disable nspos-nodeexporter.service ↵

  6. Enter the following to reboot the replacement station:

    systemctl reboot ↵


22 

When the station reboot is complete, log in as the root user on the replacement station and enter the following to enable auxiliary database services:

systemctl enable nspos-auxdbproxy.service ↵

systemctl enable nspos-auxdb.service ↵

systemctl enable nspos-nodeexporter.service ↵


23 

Enter the following on an existing auxiliary database station:

/opt/nsp/nfmp/auxdb/install/bin/auxdbAdmin.sh recoverNode internal_IP

where internal_IP is the internal auxiliary database IP address of the failed station


24 

Enter the following on an existing auxiliary database station:

/opt/nsp/nfmp/auxdb/install/bin/auxdbAdmin.sh configureTLS ↵


25 

Enter the following on each auxiliary database station in the cluster to restart the database proxy:

systemctl restart nspos-auxdbproxy.service ↵


26 

Close the open console windows.

End of steps