Niall's Data Blog

A Data Engineer / Architect writing about Tech, Data and the Community

Azure DevOps: SqlPackage Deployment Timeouts

I recently looked at an Azure DevOps pipeline for a client that was timing out whenever an index change or other long running task was deployed using a DacPac. All deployments that ran within a few minutes successfully completed, but those taking longer than 10 minutes were failing. A quick google for the issue shows a few helpful pages, a SqlPackage.exe bug from 2016 & a blog post from 2018. These suggested using either a couple of parameters when running SQLPackage, or setting a registry setting.

Posted by Niall's Data Blog on Sunday, August 29, 2021

Associative Grouping using tSQL (Part 2)

This is part of series of posts about associative grouping: Part 1 - Associative Grouping using tSQL Recursive CTE’s Part 3 - Associative Grouping using Spark In part one of this series we looked at how we could use recursive CTE’s to find overlapping groups in two columns in a table, in order to put them into a new super group of associated groups. Since I wrote that post, SQL Server 2019 CTP 3.

Posted by Niall's Data Blog on Friday, July 5, 2019

Associative Grouping using tSQL (Part 1)

This is part of series of posts about associative grouping: Part 2 - Associative Grouping using tSQL Graph Part 3 - Associative Grouping using Spark Recently I was asked by a friend to have a look at an interesting query problem he had been looking at. He was trying to find overlapping groups in two columns, in order to put them into a new super group of associated groups. The simplest way to describe the problem is with an demo, so off we go…

Posted by Niall's Data Blog on Friday, June 21, 2019

Signing Stored Procedures for Server Level Permissions

What’s the Problem Stored procedures are often used to allow users to access data in tables that they do not have explicit permissions to use. The mechanism that makes this possible is ownership chaining, whereby in the context of the stored procedure, the permissions of its owner are used (often dbo). This means users only have a limited set of explicit permissions (i.e. EXEC on the stored procedure), but are able to execute CRUD statements using the stored procedures.

Posted by Niall's Data Blog on Monday, October 23, 2017

Niall langley | Data Engineer, Speaker, Blogger

FEATURED TAGS

adlsv2 associative-grouping azure azure-devops data-cleansing data-factory tsql