Where We're Going, We Don't Need Servers
WARNING!
This presentation is now obsolete. The information in this talk has not been updated in a while and could be outdated. Use the information in this presentation at your own risk and be sure to double-check things to ensure that any information you use is accurate.ABSTRACT
Within Azure Synapse Analytics, the serverless SQL pool allows users to query data in a data lake using T-SQL but without spinning up dedicated resources. This lets data analysts, developers, and database administrators spelunk through the data without the need to integrate this data into a more permanent solution. In this talk, we will look at how to use the serverless SQL pool, including how it integrates with existing dedicated SQL pools and Spark pools. Then, we will gain a better understanding of the pricing model for the serverless SQL pool in comparison to dedicated SQL pools. Finally, we will discuss good practices around maximizing value when working with the serverless SQL pool. This includes performance tuning, cost management, and data preparation tips.ADDITIONAL MEDIA
No recordings or additional media are available for this talk.SLIDES
Click here to access the slides for this presentation.
The slides are licensed under Creative Commons Attribution-ShareAlike.
DEMO CODE
Click here to access demo code for this presentation.
The source code is licensed under the terms offered by the GPL.
LINKS & FURTHER INFO
Helpful Resources
- Azure Synapse Analytics serverless SQL pools originate in this paper on the Polaris serverless engine.
- Here is an Ignite session which preceded the paper and introduces the concept.
- Microsoft provides an overview of serverless SQL pools.
- Subaru Kokubun provides another overview of serverless SQL pools.
- Teo Lachev shares some thoughts on serverless SQL pools.
- Limitations in the T-SQL language when using serverless SQL pools.
- Microsoft Docs has some best practices for working with serverless SQL pools.
- Neel Ball shows how to use a SAS token to access directories in Azure Data Lake Storage Gen2.
- Jovan Popovic shows how we can emulate row-level security in a serverless SQL pool.
- If you run into an issue with a serverless SQL pool, start with this diagnostic page.