Skip to main content

How to perform data replication in Mavis?

  • Updated

In Mavis, you can transfer your data, including session recordings and logs, with remote storage service through the data replication service.

In this article, you may know the feature below information:

  1. Why is data replication necessary?

Data replication includes transferring important data to another location or storage space to ensure optimal system performance, which is essential for protecting vital data and ensuring uninterrupted business operations.

 

  1. Migration rules and limitations

    When updating the remote storage path, the system will not re-migrate data that has already been successfully transferred, as this data may no longer exist on the local end. To ensure data integrity, users are advised to manually transfer the data from the old remote storage location to the new one while keeping the folder name unchanged. This will allow Mavis to reference the old path for future viewing and retrieval of videos.

     

  2. How to set up the remote storage path?

In Mavis, you need to assign the remote storage path as the target destination for data replication.

  • System management > Storage settings > Set up the remote storage path

 

    • Special scenario description: When using the AWS S3 service, it is necessary to add the Region information to the URL field when configuring the path to avoid path errors. (The URL determination is based on the domain of S3 containing "amazonaws.com").

  •  Original URL Example:
s3.amazonaws.com

Original Region Example:

ap-northeast-1



When the S3 domain contains "amazonaws.com", the URL needs to be adjusted by adding the Region identifier "-ap-northeast-1".

The adjusted URL will be:

s3-ap-northeast-1.amazonaws.com

The Region remains unchanged:

ap-northeast-1



In the exceptional case where the S3 domain contains "amazonaws.com" and the Region is set to the default "us-east-1", there is no need to adjust the URL.

The URL remains unchanged:

s3.amazonaws.com

The Region also remains unchanged:

us-east-1

 

 

  1. How to set and configure replication by local storage limitation?

In Mavis, you can set the storage quota to control the frequency of log replication operations. Mavis provides recommended default configurations for optimal data replication settings, which you can refer to and adjust according to your specific requirements.

  • System management > Storage settings > Set up the local storage limitation
    • Maximum session recording storage limit: 40 GB (Default)
    • Maximum log storage limit: 1 GB (Default)


 

 

  1. What risks of not enabling data replication?

If your remote storage path is not configured, there is a risk of work interruption, system crash, or failure, which may result in data loss or damage. Please refer to the End User License Agreement (EULA) for the impact and relevant terms.

By using Mavis, you agree to the terms of use of this product; if you do not agree to any of the terms, please do not install, copy, or use this product. Pentium Network reserves the right to change, modify, add, or remove any part of these terms of use at its sole discretion. For more details, please refer to the End User License Agreement (EULA).

 

 

  1. How to identify the data replication issue in Mavis? 

When the storage quota has reached 80% due to session recordings in Mavis, an alert banner notification will remind you to investigate and fix the data replication issue.

  • An alert banner notification: The storage quota has reached 80%, due to session recordings ....

 

Please get in touch with your system administrator for assistance or immediately configure the remote storage path. After setting up the remote path, the system will automatically transfer session recording files and delete local storage files when the storage quota has reached 80% of the set limit, in order to free up local storage space.

If you need to search for session recordings from a long time ago for playback, the system will search in remote storage space and will not use the local storage quota anymore.

 

Data Migration trigger mechanism (Applicable to versions Prior to v1.16)

Audit and System logs: Once the remote storage path is configured, the system will automatically copy these logs to the specified remote storage path when the logs accumulate to over 10,000 records (approximately 10MB). This design aims to reduce frequent migration operations, thereby enhancing system performance and minimizing the impact on daily usage.

Connection records: After configuring the remote storage path, all new connection records (including video files) will be copied to that path immediately. As for the existing logs, they will gradually be copied to that path after six hours. The system will also adhere to your set storage space limit (90%), ensuring that local storage space is gradually released without affecting current operations.

Related articles