(2021-Feb-15) This post a continuation of my personal experience working with arrays (or simply JSON structures) in Azure Data Factory (ADF). It just happened that the more I work with JSON in ADF, the more interesting cases I have a chance to discover.
- Working with Arrays
- Setting default values for Array parameters/variables
- Extracting array first element
- Passing array of arrays as a parameter and the role of an @item element in this
Photo by from
To refresh my memory of what works well with JSON arrays in Data Factory, let's say we have a JSON list of imaginary breakfast items: ["Egg","Toast","Coffee"]
Yes, I know that properly constructed arrays can be referred to as variables when you specify your sub-pipelines, or hard-coded JSON can be replaced by streaming data that is properly extracted, formatted, and referenced in sub-pipelines parameters.
However, I'm still confused that the original JSON value is allowed and automatically validated during the setting sourcing parameters prior to ADF pipeline execution or setting default array variable values, but this is not allowed during Set Variable activities or passing array parameters between pipelines.
This is one of the "gotchas" that I need to remember while working with JSON values in ADF pipelines.