[-]
  
  
  
  
  
  
  
  
  
  
  
  
[+]
[+]
[+]
 
Updated on 7/29/2019
Operations Guides
Replication Policy Failover - Recovery
Direct link to topic in this publication:
Home

Replication Policy Failover - Recovery

Always review DR Assistant failover log to use this table below.  

See screenshot below as reference to column heading name to see how to review the failover log

Failure to Complete StepDescription of Impact to FailoverRecovery StepsSpecial Instructions or Warnings or Data loss Impact
Replication Policy Failover - Recovery

One or more of the SyncIQ policies in the Failover job did not successfully complete its failover operation (multiple steps).

This is the parent task containing all sub policy steps (see screenshot above to see the order of parent and child steps)

IMPORTANT

The rollback will not be applied in the event of a failure in this section of the failover.  Previously networking and allow-writes steps have succeeded and the cluster is assumed as “failed over”.  Any policy with an error in this section on resync prep, apply schedule or run policy will need to be completed manually and will likely require EMC technical support to fix root cause on the failure.

  1. Use the table in the next section to determine why the SyncIQ policy did not successfully failover and address the issue.
  2. NOTE: SyncIQ policies that return error from the cluster will require EMC support case to be opened to resolve policies that will not start or run resync prep and these steps will need to be completed manually 

This is a parent step containing sub-steps for each replication policy. Recovery from a failure in this step depends on how far the failover proceeded through the child steps.

Data Loss Impact - none (failover for any policy without this step running is completed BUT reprotecting the filesystem is blocked until the mirror policy is created and run successfully)

Replication Policy Failover <Policy Name>

Note: On Eyeglass, step names in the following table contain actual name of the cluster(s) and the policy name.  These have been replaced with SOURCE, TARGET, and POLICY in the steps below.

See screenshot below as reference to column heading name to see how to review the failover log

Failure to Complete StepDescription of Impact to FailoverRecovery StepsSpecial Instructions or Warnings
SOURCE resync prep POLICY

The mirror policy cannot be created.

Policy is failed over. Target cluster is active.

Overall fail back readiness status is failed.

NOTE: as of 1.6 all policies involved in a failover job, are issued the make writeable command before Re-sync prep is executed.

NOTE: as of 2.0 an attempt to execute resync prep  is made against all policies in the failover where make writeable has previously succeeded. In the event of an error on a Resync Prep step failover logic continues and attempts Resync Prep for any policy where make writeable succeeded.

  1. Login to OneFS on the source cluster.
  2. Manually execute resync prep on the policy.  Address any errors that may arise.
  3. Manually set the schedule on the mirror policy.
  4. Consider this policy job as a success.
  5. (once Resync prep is completed) Manually run related Quota Jobs from Eyeglass or contact support to use post failover quota sync tool.
  6. NOTE: SyncIQ policies that return error from the cluster will require EMC support case to be opened to resolve policies that will not start or run resync prep

This step is not run during uncontrolled failover.

Data Loss Impact - none (failover for any policy without this step running is completed BUT reprotecting the filesystem is blocked until the mirror policy is created and run successfully)

TARGET run POLICY_mirror

The mirror policy is unrunnable.

Policy is failed over. Target cluster is active.

Overall failover status is failure.

  1. Login to OneFS on the target cluster.
  2. Manually run the mirror policy.  Address any errors.
  3. Manually set the schedule on the mirror policy.
  4. Consider this policy job as a success
  5. Contact Superna support for quota run procedures. 
  6. NOTE: SyncIQ policies that return error from the cluster will require EMC support case to be opened to resolve policies that will not start or run resync prep

This step is not run during uncontrolled failover.

Data Loss Impact- none (failover for any policy without this step running is completed BUT reprotecting the filesystem is blocked until the mirror policy is created and run successfully)

TARGET set schedule

The schedule on the mirror policy cannot be set.

Policy is failed over.

Target cluster is active.

Overall failover status is failure.

  1. Login to OneFS on the target cluster.
  2. Manually set the schedule on the mirror policy.
  3. Consider this policy job as a success
  4. Quotas will not failover contact Superna support.
Data Loss Impact - none (failover for any policy without this step running is completed BUT reprotecting the filesystem is blocked until the mirror policy is created and run successfully)

 

Copyright Superna LLC