Data Adventures

(2025-July-06) Very often, real-time, high-speed streams of events come from IoT devices, social media logs, website user interactions, and financial transactions. So, working with streaming datasets can place you in a different category of data engineering professionals, where you tend to understand the difference between Lambda and Kappa architectures, Kafka is more than a book writer to you, and topics are not only found in human conversations.  In my post last week ( https://datanrg.blogspot.com/2025/06/salesforce-cdc-data-integration.html ), I talked about Salesforce Change Data Capture (CDC) event data streaming, where the initial event destination was file storage in Azure. But what if we anticipate a higher volume of incoming Salesforce source data or the addition of a new data feed? This could create the need for an alternative method of managing incoming events. Image by  Florian Kurz  from  Pixabay