Posts

Extracting data from Common Data Services (Microsoft Dynamics 365) using Azure Data Factory

(2020-Mar-30) Little did I know that I can use Azure Data Factory (ADF) to extract data from the Common Data Services (CDS). This data platform enables you to securely store and manage data that can be consumed by other business applications. You are totally free to rely on Standard CDS datasets (entities) or challenge yourself and create additional custom entities with cloud-based storage options for your data. 

Microsoft also has a very good set of documentation to clarify some of your knowledge gaps (those gaps are mine too :-) in using Azure Data Factory with CDS. This blog post is more to save my notes that I can use later to help and remind myself about some other additional aspects in creating data integration projects with CDS. 

I also would like to mention my coworker's name Dennian Clarke who helped me with finding my way around among myriads of standard and system CDS entities and showing me how to dynamically extract data from CDS using FetchXML queries.

Common Data Servi…

Transforming JSON to CSV with the help of Flatten task in Azure Data Factory - Part 2 (Wrangling data flows)

Transforming JSON to CSV with the help of Flatten task in Azure Data Factory

Using Azure Data Factory Mapping Data Flows to populate Data Vault - PASS Video

Azure Databricks Performance Notes

Continuous integration and delivery (CI/CD) in Azure Data Factory using DevOps and GitHub - Part 2