Posts

Down the Rabbit Hole: Dealing with Ad-Hoc Data Requests

"But I don’t want to go among mad people," Alice remarked. "Oh, you can’t help that," said the Cat: "we’re all mad here. I’m mad. You’re mad." "How do you know I’m mad?" said Alice. "You must be," said the Cat, "or you wouldn’t have come here.” ― Lewis Carroll, Alice in Wonderland (2025-Oct-13)  Recently, when I attended one of the IT conferences, there was a session where a presenter brought up the topic of ad-hoc data requests. The entire conference, and this particular session, was filled with AI narratives and promises of quick paths to data results driven by simple conversational queries. The presenter mentioned the term “ad-hoc data request” or perhaps “ad-hoc report”, I don’t quite remember which. But what struck me was the slightly lamenting tone she used, as if saying, “Oh, those poor little creatures…”. That made me think: what is the current state of such data requests? Is there still a place for such custom inquiries, a...

What a Summer Camp Kitchen Still Teaches Me

Stepping into Event Streaming with Microsoft Fabric

Salesforce CDC Data Integration

Logging in Azure Data Factory data flows

Dealing with Changing Data Formats: Schema Drift in Azure Data Factory

Data Masking with Azure Databricks

What I learned volunteering at a children's summer camp

Extracting PostgreSQL database metadata for presentation in Excel format

Don't Trust the Defaults

Handling physical deletes from the source and continue populating your analytical data store

Azure DevOps: Enterprise Power BI report deployment with connections to Shared datasets

Adding microseconds to a timestamp in Azure Data Factory

Using Azure Data Factory to read and process REST API datasets

Metadata-driven pipelines in Azure Data Factory | Part 4 - Analytical Processing

Thinking about data points and more …

Azure DevOps: Deploying Power BI reports with a parameterized gateway-based Data Source

Azure DevOps: Merging code to Main branch from a specific branch only

Including reference data into a database deployment process or passing lookup tables to Production

Metadata-driven pipelines in Azure Data Factory | Part 3 - Column Metadata

Populating PostgreSQL JSONB column using Azure Data Factory Data Flow

Metadata-driven pipelines in Azure Data Factory | Part 2 - Feed Configuration

Metadata-driven pipelines in Azure Data Factory | Part 1 - Data Copy

Fixing a giant or running a SQL Server project deployment with Temporal tables

Trusting the Fine Print or connecting Azure Data Factory with Salesforce

Can I create a CI/CD pipeline to deploy Python Function to Azure Function App using Windows self-hosted Azure DevOps agent?

“Could not find the modules: 'Az.Accounts' with Version: ''” error message and a story to remember

Fail activity in Azure Data Factory and Why would I want to Fail

Error [IM002] [Microsoft][ODBC Driver Manager] "Data source name not found and no default driver specified" and who do you trust?

Lambda Architecture in data systems and possible meaning of this name

Data Modeling at your fingertips