As a major service provider to Dubai’s smart city initiative, du needed to ensure that their on-premise data lake was always available to the Smart Dubai Platform. This platform facilitates the exchange of open and shared data between the public sector, private sector and individuals, creating new opportunities for engagement, contributing to the smart city future of Dubai, and therefore data availability was key. du had tried using other data replication capabilities such as Apache NiFi but the manual intervention required in coding data migration and the time spent repairing data through erroneous data transfer proved prohibitive.
du has successfully implemented Cirata Data migration technology to effectively support the disaster recovery needs of their expansive data lake. This advanced technology offers an automated platform for data replication that is inherently resilient to network outages, ensuring uninterrupted operations. By requiring minimal manual intervention, it streamlines processes and reduces the likelihood of human error. Additionally, it guarantees that any live data changes are captured in real time at the disaster recovery site, thereby enhancing data integrity and reliability. Over the past 8 years, du has relied on this robust technology to support its 54 node Hadoop environment, ensuring a remarkable 24/7 availability. This consistent uptime is crucial for handling their extensive data processing needs and maintaining operational efficiency, ultimately leading to improved decision-making and business continuity challenging given the growth in the amount of data being ingested daily into the production data lake.