After upgrading NetScaler, the AppFirewall policies and profiles along with SSL certificates does not sync from Primary to Secondary NetScaler in High Availability (HA) setup.

The HA RPC node passwords does not match causing the file sync to fail. To resolve this issue set the same RPC node password on both nodes using the following Citrix Product Documentation - Creating or Changing an RPC Node Password .

Problem Cause

The following errors are seen in the logs:

Mar  3 07:40:00 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 12
Mar  3 07:41:01 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 255
Mar  3 07:42:00 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 255
Mar  3 07:43:00 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 12
Mar  3 07:44:00 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 12
Mar  3 07:45:01 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 255
Mar  3 07:46:00 <local0.info> ns-vpx-ext-1 nsfsyncd: NSFSYNCD: File-Sync FAILED 255

Errors in "nsfsyncd.log" indicates that there is a possible communication issue between the HA nodes with regards to syncing.

2015/03/03 13:31:00 [2242] rsync: connection unexpectedly closed (0 bytes received so far) [receiver]
2015/03/03 13:31:00 [2242] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [receiver=3.0.6]

Further noticed that the RPC node passwords on the HA nodes does not match. The RPC node password has to be the same on both the HA nodes for the sync process to complete.

show ns rpcnode

1)      IPAddress:  x.x.x.1  Password:  f07c0xxx74e72e70e3xxxxx23c
        SrcIP:  x.x.x.x      Secure:  OFF
2)      IPAddress:  10.x.x.2  Password:  f07c0xxx74952e70exxxxxe23c
        SrcIP:  x.x.x.x      Secure:  OFF

Note: In NetScaler 11.0 hash value or encrypted string for RPC node password will look different even though they are configured to be the same.This is by design.

Citrix Documentation - Creating or Changing an RPC Node Password
CTX109013 - Troubleshooting NetScaler High Availability (HA) Issues
Citrix Documentation - Configuring Synchronization
Citrix Documentation - Synchronizing Configuration Files in a High Availability Setup