DEVELOPMENT OF DATA LAKE FOR REAL ESTATE PERFORMANCE
Problem
A UK company developing software for Real Estate Performance was faced with the challenge of gathering too much data from different sources crucial for their decision-making and platforms AI model.
10 M of data points from six different sources arrived every day and needed to be stored and used in a structured and scalable way.
Solution
To create scalable data architecture that supports fast queries, easy modeling, and BI solutions, we have built Data Lake in AWS. We did this by developing Data Vault Methodology as a source DWH design and Analytical Layer on top of it for faster KPI processing and reporting.
The solution included AWS tools such as AWS Glue, AWS Step Function, Red Shift, and AWS Athena to support the architecture.
Results
Production AWS Data Lake is being used for faster processing, reporting, and modeling that gives the client a better overview of its data.
