Posts

Extracting PostgreSQL database metadata for presentation in Excel format

(2024-Mar-16)  I have been a big fan of using the Excel application for various tasks for more than half of my life. I believe it's the most widely used spreadsheet application in the world. I'm not shy to acknowledge that I've used it for very small tasks like taking structured notes during meetings, as well as creating sophisticated tables that can be shared with other users and handling larger data as updatable sourcing datasets for database applications. Let's not forget the well-established marketing campaign by Microsoft promoting Excel as the main analytical platform about 15 years ago, with some tools still available and some relegated to memory (Power Query, Power Pivot, Power Map, Power View). The good old days! Image by  Pexels  from  Pixabay

Don't Trust the Defaults

Handling physical deletes from the source and continue populating your analytical data store

Azure DevOps: Enterprise Power BI report deployment with connections to Shared datasets

Adding microseconds to a timestamp in Azure Data Factory

Using Azure Data Factory to read and process REST API datasets

Metadata-driven pipelines in Azure Data Factory | Part 4 - Analytical Processing

Thinking about data points and more …

Azure DevOps: Deploying Power BI reports with a parameterized gateway-based Data Source

Azure DevOps: Merging code to Main branch from a specific branch only

Including reference data into a database deployment process or passing lookup tables to Production

Metadata-driven pipelines in Azure Data Factory | Part 3 - Column Metadata

Populating PostgreSQL JSONB column using Azure Data Factory Data Flow

Metadata-driven pipelines in Azure Data Factory | Part 2 - Feed Configuration

Metadata-driven pipelines in Azure Data Factory | Part 1 - Data Copy

Fixing a giant or running a SQL Server project deployment with Temporal tables

Trusting the Fine Print or connecting Azure Data Factory with Salesforce

Can I create a CI/CD pipeline to deploy Python Function to Azure Function App using Windows self-hosted Azure DevOps agent?

“Could not find the modules: 'Az.Accounts' with Version: ''” error message and a story to remember

Fail activity in Azure Data Factory and Why would I want to Fail

Error [IM002] [Microsoft][ODBC Driver Manager] "Data source name not found and no default driver specified" and who do you trust?

Lambda Architecture in data systems and possible meaning of this name

Data Modeling at your fingertips

New Azure Data Factory home page, what's in it for me?

Executing Azure Data Factory pipelines by Power App / Automate Flow

Azure Function Drain mode

Blog post about Copying Azure files to SharePoint, comparing Logic App and Power Automate Flow for this, and Trust No One

Creating a generic (template) pipeline in Azure Data Factory to send email messages with attached files from Azure Storage account

Recent updates on my work with Data Vault and Azure Data Factory