Data Adventures

(2023-Oct-15)  When something important disappears, it's natural to start asking questions and looking for answers, especially when that missing piece has had a significant impact on your life. Similarly, when data that used to exist in your sourcing system suddenly vanishes without any trace, you're likely to react in a similar way. You might find yourself reaching out to higher authorities to understand why the existing data management system design allowed this to happen. Your colleagues might wonder if better ways to handle such data-related issues exist. Ultimately, you'll embark on a quest to question yourself about what could have been done differently to avoid the complete loss of that crucial data. Paul Felix wrote a good article on “ Dealing with Deletes in the Data Warehouse ” from which I will borrow a few terms to differentiate types of data deletions: Soft deletes – no physical data deletes are occurring; data records are simply tagged and deactivated. Hard