Blog Archive
Every post, in one place
Data Governance in the Era of Big Data: Challenges, Opportunities, and Key Techniques
IntroductionThe age of big data is here, and with it comes both incredible opportunities and daunting challenges. Organizations are collecting vast amounts of data at an unprecedented rate — but…
Simplifying Data Lakes with AWS Lake Formation
As a solutions architect at White Prompt, I’ve had the opportunity to delve deep into the intricacies of data management. Today, I’d like to share insights on a powerful tool that can revolutionize…
Data Governance in Software Development: Ensuring Quality, Integrity, and Security
IntroductionWe understand that the core of any successful software development effort lies not just in the code we write but in how we manage the data that drives our applications. Data governance,…
Implementing a Data Lakehouse Architecture in AWS — Part 4 of 4
IntroIn our previous blog post, part 3 of this series, we walked through the processing of data available from the AWS sample Tickit data. We then used EMR to process it from RAW zone to Trusted with…
Implementing a Data Lakehouse Architecture in AWS — Part 3 of 4
IntroIn our previous article, part 2 of the series, we walked through the extraction, processing, and creation of some data mart, using the New York City taxi trip data which is publicly available to…
Implementing a Data Lakehouse architecture in AWS — part 2 of 4
IntroductionIn part 1 of this article series, we walked through how to feed a Data Lake built on top of Amazon S3, based on streaming data, using Amazon Kinesis.In part 2, we will cover all of the…