How to optimize the network and communication channels for transferring large volumes of backups?
Transferring terabytes of backups over corporate networks often leads to performance degradation of core services due to the exhaustion of communication channel bandwidth. To solve this problem, a set of measures is applied to optimize network traffic and reduce the infrastructure load at the stage of sending data to the storage.
The first step is to implement local deduplication and data compression on the source side before sending them over the network. This allows transferring only unique blocks of information, which reduces traffic volume several times. It is also important to use incremental or synthetic copy creation schemes, avoiding the transfer of full archives with each task run.
To effectively manage bandwidth, the following methods are used: