Data Exposed - Channel 9

Flexible Server is a new, next-generation option in the Azure Database for PostgreSQL managed service. Hosted on Linux OS, Flexible Server delivers superior out-of-box performance, zone resilient HA, customer-managed maintenance windows, plus a developer-friendly experience. Join this episode with Sunil Agarwal to learn more about why people are excited about the PostgreSQL managed service on Azure and the newly GA'd Flexible Server option. [00:32] Introductions[01:00] Flexible Server for Azure Database for PostgreSQL Overview[04:43] Getting started with Flexible Server Resources:What is Flexible Server in Azure Database for PostgreSQL? - Microsoft Tech Community Bringing the best of Azure and PostgreSQL innovation to developers - Microsoft Tech Community Azure Database for PostgreSQL - Flexible Server | Microsoft Docs

Data engineering is one of the most involved, dull, and repetitive tasks in the data industry today. Bringing up the subject is a sure way to instantly clear the room at a party or make your friends groan in despair. The work includes a lot of complicated tools, many, many lines of code, and a not-insignificant amount of gnashing of teeth. But what if I told you there is a way to quickly, easily, and cheaply do both data engineering and data exploration on most data without even having to import it into a database? What if I told you that Azure Synapse has a just about magical tool that can instantly connect to flat files and make them available as nice, well-behaved tables? I'm talking about Azure Synapse serverless pools, a great tool for both initial exploration and surprisingly complex data engineering. I'll walk you through what it is, how to set it up, and give you a few examples of basic data exploration, as well as a tad more complex data engineering. Oh, and did I mention you can actually store the end result in several different formats as well...?[00:56] Azure Synapse Serverless Pools Overview[01:54] Demo[11:05] Getting startedResources:Andy Cutler's blog on serverless poolsAndy Mallon's blog on bucketing with T-SQLAbout Alexander Arvidsson:Alexander is a principal solutions architect at Attollo in Sweden. Nobody really knows what it means to be a principal solutions architect, but he spends his days speaking, teaching courses or helping clients of all shapes and sizes to take better care of their data.He has spent the last 25 years toying with data, databases and related infrastructure services such as storage, networking and virtualization, occasionally emerging from the technical darkness to attend a Star Wars convention somewhere in the world.He is a frequent international speaker, Data Platform MVP, podcaster, Pluralsight author, blogger and a Microsoft Certified Trainer, focusing on the Microsoft data platform stack.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Did you know that Jupyter Notebooks can be automated? Join this episode with Julie Koesmarno to see an example of how you can use automate diagnostic notebooks automatically executed as an issue is assigned to you. We will be using Azure serverless architecture to illustrate this example. You will learn how you can leverage Azure Logic Apps and API that is available for executing Jupiter Notebook from command lines. [01:30] Automating Diagnostic Notebooks Overview[03:10] Demo[08:02] ArchitectureResources:Troubleshooting SQL Server made easy via Notebook

In this episode of Data Exposed with Julie Koesmarno, we will give you a sneak peek of what's new in Azure Data Studio. In this demo, Notebook view simplifies the workflow for your notebook consumers. At Microsoft, we continuously strive to come up with practical ideas that help our customers. With that, we have also been experimenting with converting a couple of highly used SQL Server docs to Notebooks.[00:58] Notebook Views overview[03:05] Demo[05:27] SQL Docs to Notebooks[07:33] Getting startedResources: Troubleshooting SQL Server made easy via Notebooks – seeking your feedback

Looking for a cross-platform Oracle schema conversion solution? Join Alexandra Ciortea, Alexander Ivanov, and Anna Hoffman to learn about the new experience we are building in Azure Data Studio. This feature is currently available in Insiders build of Azure Data Studio and will soon be available in the mainstream as well.[00:25] Introduction[01:15] What is DSCT[02:41] Demo[10:09] What to know when getting started[11:39] Scenarios[12:38] Roadmap Resources:Azure Data Studio – InsidersMigrating to SQL series playlist

Are you looking to modernize your on-premises databases to Azure SQL? Join Alexandra Ciortea, Raymond Truong, Wenjing Wang, and Anna Hoffman to understand how you can size your Azure SQL target accordingly, based on the current performance and business requirements. We will walk you through several approaches and models that can suit your needs.[00:40] Introductions[00:58] What is DMA[01:38] What is an SKU[02:23] SKU recommendation console application[03:43] Demo[12:34] How data is collected[14:10] Demo[20:11] How to migrateResources:Download Microsoft Data Migration Assistant v5.5Identify the right Azure SQL Database, Azure SQL Managed Instance or SQL Server on Azure VM SKU for your on-premises databaseRun Data Migration Assistant from the command line

In this episode of Data Exposed: MVP Edition, Javier Villegas will describe the concept of SQL Server Failover Cluster Instances (FCI) covering how we can use them for High Availability purposes using Azure Virtual Machines and the different Azure Storage options. Recently introduced in Azure VMs, SQL FCIs allows to easily migrate HA workload from on-premises environments to the cloud with the added benefit of application compatibility.[00:30] About Javier Villegas[01:20] Failover cluster overview[05:36] SQL Server Failover Cluster Instances in Azure[09:09] Demo: Created shared disc in Azure portal[11:42] Getting startedAbout Javier Villegas:Javier Villegas is IT Director (DBA & BI Services) at Mediterranean Shipping Company with more than 20 years of experience working with SQL Server, Including Azure SQL.His specialization is Administration, Performance Tuning, High Availability and Disaster Recovery.Javier is a Microsoft MVP Data Platform since 2016 and MCT.He is a frequent speaker in technical conferences and events such as SQL Saturdays, PASS Virtual Groups, PASS Marathons, 24 Hours SQL PASS , vOpen , GroupBy ,DataPlatformGeeks , Data Saturdays and Azure Global Bootcamps.He is one of the group leaders of SQL Argentina Community and Microsoft Azure Data Advisory Board Member.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Looking for the next Microsoft Learn modules to complete? Bob Ward, Buck Woody, and Anna Hoffman give you a run-down of Microsoft Learn, the learning paths they've launched, and the two new Microsoft Learn modules - Azure SQL IoT and Azure Arc-enabled data services - they've been working on that are now live. Start learning today![00:33] Introductions[00:52] SQL Workshops[02:05] About Microsoft Learn[02:38] Microsoft Learning Path - Build serverless, full stack applications in Azure[03:28] Microsoft Learning Path - Azure SQL Fundamentals[05:11] Microsoft Learn Module - Introduction to Azure Arc-enabled data services[07:26] Microsoft Learning Path - Azure Arc[08:33] Microsoft Learning Module - Deploy IoT Solutions with Azure SQL Database[09:43] Getting startedResources:Microsoft LearnSQL Server and Azure SQL Labs and WorkshopsMicrosoft Learning Path - Build serverless, full stack applications in AzureMicrosoft Learning Path - Azure SQL FundamentalsMicrosoft Learn Module - Introduction to Azure Arc-enabled data servicesMicrosoft Learning Path - Manage hybrid infrastructure with Azure ArcMicrosoft Learning Module - Deploy IoT Solutions with Azure SQL DatabaseAzure Arc Jumpstart

If you're looking to scale your Postgres database, the Citus open-source extension to Postgres makes sharding simple. And Citus is available on Azure as a managed service, too. Join Claire Giordano on the Citus team to learn about how Citus uses the Postgres extension APIs to shard Postgres—and the best way to get started with Citus. [01:24] What is Citus[03:40] What applications sharding Postgre with Citus[05:34] How large can a Citus cluster get?[07:45] When to use Citus[08:45] Getting statedResources: Citus open source repo on GitHubGetting Started with Citus resourcesCitus on Azure documentationCitus monthly newsletterVideo: How Citus Distributes PostgreSQL

Query store hints enables changing query plan shapes without modifying application code. In this episode of Data Exposed with Denzil Ribeiro, we will look at an example of improving the performance of bulk loading data using query store hints. [00:30] Introduction Denzil Ribeiro[01:40] Memory Grants Overview [02:49] Demo[13:05] Getting Started Resources:Performance impact of memory grants on data loads into Columnstore tables

It is important to ensure that your Azure Virtual Machine is meeting the performance and stability standards you have established in your organization. PerfInsights can help identify and report on your Azure SQL VM health and provide references to how administrators can mitigate the risks. PerfInsights is a self-help diagnostics tool that can be run through the portal or as a standalone tool that collects diagnostic data, produces analytic reporting, summarizes system information, and produces a system log output that can help troubleshoot virtual machine performance problems in Azure for various scenarios including SQL Server, Windows OS, Linux, Azure storage, and more. PerfInsights allows administrators to run quick analysis, produce a benchmark result, analyze slow virtual machines, analyze Azure files, and perform advanced scenarios including xperf, network tracing, storport tracing, perf counter traces, and diskspeed benchmarks. In part five of this seven-part series, we will analyze PerfInsights captures to review SQL Server findings, review storage analysis against Azure storage thresholds, resource reporting, and will review the system summary information that can make it a lot easier to document your Azure SQL Virtual Machine environment. [00:58] PerfInsights Overview[02:20] Demo[15:48] Getting started Resources:Advanced performance analysis: https://aka.ms/perfinsights/advancedAzure Files analysis: https://aka.ms/perfinsights/azurefilesQuick performance analysis: https://aka.ms/perfinsights/quickPerformance analysis: https://aka.ms/perfinsights/vmslowBPCheck - SQL Best Practices and Performance checks: http://aka.ms/BPCheckPremium storage disk sizes: https://docs.microsoft.com/en-us/azure/virtual-machines/premium-storage-performance#premium-storage-disk-sizesAzure SQL Virtual Machine Reimagined Series: https://aka.ms/azuresqlvmyt

As database professionals, we all know how to manage SQL Server Agent jobs using SQL Server Management Studio (SSMS), TSQL, and PowerShell. With Azure Data Studio and SQL Server Agent extension, we have new tools to create, maintain and manage SQL Agent jobs using Notebook. These are called Notebook Jobs. Once you successfully execute a Notebook job manually or via schedule, each run's results are saved into a separate Notebook, which you can easily share with others. In this episode of Data Exposed: MVP Edition, Taiob Ali will walk you through every step of Notebook Jobs.[00:31] About Taiob Ali[01:34] Benefits of SQL Server Agent Jobs[04:50] Demo[T012:30] Getting StartedResources:Github About Taiob Ali:Taiob Ali, Microsoft Data Platform MVP, is an accomplished technical leader with a proven record of success. During his last 15 years, he has worked with the Microsoft Data Platform and MongoDB, both on-premises and cloud. His experience includes all three major business sectors: finance, e-commerce, and healthcare. Taiob has hands-on experience managing large database projects, including massive data migration, intricate process design, testing and deployment, performance tuning, and long-term capacity planning. Taiob is currently working at "GMO LLC" as Database Solutions Manager, focusing on cloud migration, automation, improving, and streamlining operational workflow. He is a regular speaker at local and virtual chapters, Data Saturdays, and Azure conferences. He is a board member of New England SQL Server User Group, founder of 'Database Professionals Virtual Meetup Group', and organizer of Boston Data Saturday.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more.

Reports have never looked so great! The new features in SQL Server Migration Assistant help you easily identify automatically converted objects and estimate the effort associated with manually converted objects. Incorporate your findings into your migration process and accelerate your journey to Azure SQL.[00:30] Introductions[01:46] Importance of SSMA reports[02:42] Demo: Challenges that led to enhancements[06:58] Demo: New, enhanced reportsResources:SQL Server Migration Assistant - SQL Server | Microsoft DocsAzure Database Migration Guides | Microsoft DocsMigrating to SQL series playlist

When migrating your SQL Server workloads to Azure VM, there are literally hundreds of different VM sizes to choose from. Hopefully, you've seen our videos on sizing so you have an idea of the methodology we recommend to choose the right size, but what if you have a new SQL Server workload that you don't have metrics for? Where should you start? In part 4 of this eight-part series, we will highlight the Edsv4-series VMs and show you why we think they are the best VMs for your SQL Server workloads.[00:44] What are considerations for VM sizes[02:30] Favorite VM series[03:04] Edv4 and Edsv4-series documentation[07:37] Getting startedResources:Edv4 and Edsv4-seriesVM size: Performance best practices for SQL Server on Azure VMsHow to get the biggest bang for your buck with SQL Server on Azure VMAzure SQL Virtual Machine Reimagined Series

Azure Monitor is a technology used to collect telemetry data from your Azure and on-premises environments. You can use Azure Monitor to improve performance and support the stability of your applications by identifying issues quickly. Azure Monitor includes Azure Metrics and Azure Logs to store telemetry data and track data in real-time and for historical analysis.Azure Metrics track values collected at regular intervals and can be used to describe the health of your resources at a particular point in time. Azure Metrics are lightweight and useful for creating dashboard KPIs, alerting, and fast detection of issues.In part three of this seven-part Azure SQL VM series, we will use Azure metrics to identify the uncached and cached health of your virtual machine and disk resources. We will show how to find metrics at the VM scope, pin metrics to create a custom dashboard, how to manage alerts, and finally comparing cached and uncached metrics at the VM and disk levels. [00:48] Tracking VM cached health[02:55] Demo[09:23] Getting started Resources:Disk performance metricsAzure Monitor

In part two of this seven-part VM series, learn how to easily manage your Azure SQL virtual machines using the SQL IaaS Agent Extension with Pam Lahoud. Whether you are using an Azure Marketplace image or a custom image with a self-installed SQL Server, the SQL IaaS Agent Extension offers a number of features to discover and manage your SQL Server VMs quickly and easily through the Azure Portal. [00:44] What is SQL Server IaaS Agent Extension[01:30] Demo[05:23] Set-up[09:28] Getting started Resources:Automate Management with the SQL Server IaaS Agent ExtensionAutomatic Registration with SQL Server IaaS Agent Extension

Optimizing Virtual Machine storage is one of the most critical areas to focus on when architecting for performance with SQL Server on Azure Virtual Machines (VM). Virtual machines have input/output operations per second (IOPS) and throughput performance limits based on the virtual machine type and size as well as storage. In part one of this seven-part VM series, we'll cover how capping occurs at the virtual machine and storage levels and how caching can help remove the impact of these performance limits. [00:40] Optimizing Storage Performance[02:46] Azure Virtual Machine and Storage[03:49] Disk IO Capping[06:46] Azure VM IO Capping Resources:Checklist: Best practices for SQL Server on Azure VMsVM size: Performance best practices for SQL Server on Azure VMsStorage: Performance best practices for SQL Server on Azure VMsHow to get the biggest bang for your buck with SQL Server on Azure VMsDeep Dive: Azure SQL Virtual Machine Sizing | Data Exposed LiveAzure SQL Virtual Machine Reimagined Series

SQL Server object disks on Windows Server can be expanded at any time with no issues, but Linux doesn't quite work like that by default. In a situation where you run out of space, you're out of luck, unless you know some secrets about Linux. The mysterious Linux Logical Volume Manager must be used before you put anything on the disks to properly set up the disks so you can expand them in a pinch in the future. In this episode with David Klee, we're going to walk through how to use this service to set up your object volumes the right way from the beginning and show you how to expand the disks with no outage. Break out your pocket protectors and come learn with someone who was compiling Linux kernels while in elementary school! [00:37] About David Klee[01:18] Challenge overview[02:14] Linux Logical Volume Manager [03:00] Demo: Logical Volume Manager Setup[09:22] Who should this set up[10:05] Getting started Resources:$2 Million Reasons to Start with TuningDavid Klee's websiteHeraflux Data Platform ConsultantsSQLlibrium Training About David Klee:David Klee is a Microsoft Data Platform MVP and VMware vExpert with a lifelong passion for technology. David spends his days focusing on the convergence of data and infrastructure as the Founder of Heraflux Technologies and SQLibrium Education. His areas of expertise are cloud, virtualization, performance tuning, and business continuity. David speaks at a number of national and regional technology-related events, including the PASS Summit, VMware VMworld, SQLBits, SQL Saturday events, and many SQL Server User Groups. About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

In this episode of Data Exposed with Davide Mauri, get an overview of the newly released feature for Azure SQL Hyperscale Database: Named replicas. Named replicas allow for incredible scalability, giving you the option to scale out the database up to 30 named replicas, so that you can sustain any workload of any size. We'll dive into the key features that make Named replicas unique, the use case where Named replicas excels and some tips and tricks to architect solutions to take advantage of them, to get great performance and also to save a substantial amount of money.[00:36] Introductions[02:38] Azure SQL Hyperscale Overview[04:15] Azure SQL Hyperscale Replicas[05:30] High-Availability Replica[07:22] Named Replica[11:02] Named Replica - Use Cases & Sample Scenarios[15:06] Demo[20:00] Getting startedResources:Named replica (in Preview)

SQL Data Sync lets you synchronize the data you select bi-directionally across multiple databases, both on-premises and in the cloud. In this Data Exposed episode with Mara-Florina Steiu, we will cover common use cases and scenarios for Sync, discuss key technical implementation details, and try out a demo. [01:03] SQL Data Sync Overview[04:40] Use Cases[06:00] Additional Considerations[07:11] Demo[15:40] Getting started Resources:What is SQL Data Sync for Azure?Set up Data SyncBest practices for Azure SQL Data SyncTroubleshoot issues with SQL Data Sync

Azure Data Factory (ADF) is a fully managed, easy-to-use, serverless data integration solution to ingest all your on-premises, hybrid, and multi-cloud data In this episode with Wee Hyong Tok, you will learn about the latest product updates to ADF, and how ADF is integrated with Azure Synapse Analytics and Azure Purview.[00:48] What's new in Azure Data Factory[01:43] First tip - Synapse Pipelines and Data Flows[04:11] Second tip - Azure Purview and Azure Data Factory[13:01] Third tip - Performance Tuning Guides[15:04] Fourth tip - Visual Guide to Azure Data Factory[16:43] Fifth tip - Your Journey to Success with ADF Resources:What is Azure Data Factory?Jumpstart your journey with ADFADF YouTube channelAzure Friday Videos

Change data capture (CDC) records insert, update, and delete activity that applies to tables in SQL Server, Azure SQL Managed Instance or Azure SQL Databases. In this Data Exposed episode with Mara-Florina Steiu, we will cover common use cases and scenarios for CDC, discuss key technical implementation details, and try out a CDC demo. [00:37] Introductions[01:19] What is Change Data Capture (CDC)[03:43] Why use CDC[05:08] Enabling/disabling CDC in Azure SQL Databases[07:22] Performance Considerations for CDC[09:00] Demo: How CDC works on Azure SQL Database[14:00] Getting started Resources:About Change Data Capture (SQL Server)Enable and Disable Change Data Capture (SQL Server)Work with Change Data (SQL Server)Administer and Monitor Change Data Capture (SQL Server)Change Data Capture and Other SQL Server Features

Whether it's for reporting and offloading queries from production, there are things you need to keep in mind when using a Geo Replicated Azure SQL Database Readable Secondary. Discuss with MVP Monica Rathbun the challenges when it comes to performance tuning, what to keep in mind, and what to expect.[00:35] About Monica Rathbun[01:28] Demo[09:27] Getting started Resources:Offload read-only workload to secondary replica of an Always On availability groupBest practices with Query StoreGlenn's SQL Server PerformanceUse read-only replicas to offload read-only query workloadsAbout Monica Rathbun:Monica Rathbun lives in Virginia, is a Microsoft MVP for Data Platform and Microsoft Certified Solutions Expert. She has nearly two decades of experience working with a wide variety of database platforms with a focus on SQL Server and the Microsoft Data Platform. She is a frequent speaker at IT industry conferences on topics including performance tuning and configuration management. She is the Leader of the Hampton Roads SQL Server User Group and a Mid‐Atlantic PASS Regional Mentor. She is passionate about SQL Server and the SQL Server community, doing anything she can to give back. Monica can always be found on Twitter (@sqlespresso) handing out helpful tips. You can find Monica blogging at sqlespresso.comAbout MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

In this episode of Data Exposed with Jason Anderson, learn what the ledger feature of Azure SQL Database is and where using ledger can help enable digital trust in your data. There will also be some quick demos on how to enable this exciting new capability and how to show to others that your data is in-fact, intact. [00:35] Introduction[01:46] Azure SQL Database Ledger Overview[08:04] Demo[13:03] Scenarios for ledger tables[15:34] Getting started Resources:Announcing Azure SQL Database Ledger BlogAzure SQL Database Ledger DocumentationMaintain Cryptographically Verifiable Data in Azure SQL Database WhitepaperWatch the Microsoft Build KeynoteRead what Avanade thinksAzure SQL Security Video Series

In this episode with Rajesh Setlem, learn about the new integrated assessment and migration experience for Azure SQL from Azure Data Studio as well as how easy it is to get started.[01:00] Azure SQL readiness and migrations from Azure Data Studio (preview)[01:24] Architecture[05:05] Demo[15:32] Getting startedResources:Assessment rules for SQL Server to Azure SQL Managed Instance migrationDownload and install the latest version of ADS insiders build. This can be installed side by side with a stable release of ADS. Install "Azure SQL Migration" extension from extension marketplaceRefer to get started document for detailed documentation on capabilities and current limitationsMigrating to SQL series playlist

In this episode of Data Exposed, Joe Sack, Principal Group Program Manager of SQL Server engine and SQL Hybrid, and Anna Hoffman, Data & Applied Scientist, talk about a new way in Azure SQL Database to optimize the performance of queries when you are unable to directly change the original query text. They will cover the new public preview feature Query Store Hints, which leverages queries already captured in Query Store to apply hints that would have originally required modifications to the original query text through the OPTION clause.[00:32] Introduction[01:10] What are Query Hints?[03:10] Applying Query Hints today[04:26] Introducing Query Store Hints[05:07] How to use Query Store Hints - Step 1[05:46] How to use Query Store Hints - Step 2[06:36] Demo[12:10] Query Store Hint Scope and Behavior[14:10] Use-cases for Query Store HintsFeedback? Email QSHintsFeedback@microsoft.com

SQL insights is a comprehensive solution for monitoring any product in the Azure SQL family. Learn about how to set up Azure Monitor for SQL insights with Alain Dormehl, Senior Program Manager at Microsoft. [01:00] Azure Monitor SQL insights overview[03:06] Documentation[03:40] Set up storage - Log Analytics Workspace[04:52] Set up a virtual machine[07:22] Set up a user[14:30] Getting started Resources:Monitor your SQL deployments with SQL insights (preview)Deep Dive on Azure SQL Insights

Looking for a way to preserve your Oracle partition strategy while modernizing Azure SQL? SQL Server Migration Assistant's new automatic partition conversion allows you to retain your current partition model even when there is no direct type mapping. Dive into this significant time-saving feature in this episode of Data Exposed with Alexandra Ciortea and Xiao Yu.[01:45] New feature - Automatic Conversions for Partitioned Tables[03:05] Demo[12:25] Getting startedResources:SQL Server Migration AssistantSQL Server Migration Assistant for Oracle (OracleToSQL)Download Microsoft SQL Server Migration Assistant for OracleAzure Database Migration Guides

Planning a proper disaster recovery solution is a critical piece of any infrastructure design, even when working in the cloud solutions like Azure SQL Database. Thankfully, the Azure architecture provides a solution that with only clicks of the mouse a DR plan can be implemented. In this episode with MVP John Morehouse, we'll take a look at how easy it is to set up and configure a disaster recovery solution for Azure SQL Database. [00:37] About John Morehouse[01:27] Demo: Backups[04:42] Demo: Active geo-replication [10:39] Demo: Failover groups[15:20] Getting startedResources:BackupsActive Geo-replicationAuto Failover groups About John Morehouse:John Morehouse is currently a Consultant with Denny Cherry & Associates living in Louisville, Kentucky. With over 2 decades of technical experience in various industries, John now focuses on the Microsoft Data platform and specializes in Microsoft SQL Server. He is honored to be a Microsoft Data Platform MVP, VMWare vExpert, 2016 Idera Ace, Friend of Red Gate, Sentry One PAC member & Community Ambassador. John has a passion around speaking, teaching technical topics and giving back to the technical community as much as possible. He is a user group leader, SQL Saturday organizer, and former PASS regional mentor. He is also a blogger, avid tweeter, and a frequent speaker at SQL Saturday's as well as other conferences. If you want to find John, you can find him on Twitter (@sqlrus) or on his blog, https://sqlrus.com.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram.

Worried about your data validation post-migration to SQL Server or Azure SQL? Join us in this episode with Alexandra Ciortea and Xiao Yu to learn how you can create your leverage SQL Server Migration Assistant (SSMA) Tester to verify that converted objects work the same way and that all data was transferred properly. We will also share the enhancements which enable validation for Azure SQL targets and streamline the setup process. [02:00] SQL Server Migration Assistant Overview[04:26] Validate Migrated Objects Using SSMA Demo[08:20] Backup Management Feature Demo Resources:SQL Server Migration AssistantSQL Server Migration Assistant for Oracle (OracleToSQL)Download Microsoft SQL Server Migration Assistant for OracleAzure Database Migration Guides

Looking to leave Oracle behind? Watch the episode of Data Exposed with Alexandra Ciortea to find out how to ease into the migration journey by automating Oracle migrations to SQL Server or Azure SQL using SQL Server Migration Assistant. Customers looking to migrate from other database systems to Azure experience challenges in schema conversion, data movement. Microsoft SQL Server Migration Assistant (SSMA) is a suite of 5 tools designed to automate heterogeneous database migration to Azure SQL and SQL on-premises from Oracle, DB2, MySQL, Microsoft Access, and SAP ASE. [01:01]​ Challenges[02:16]​ SQL Server Migration Assistant Demo[14:40] Converting Statements Demo Resources:SQL Server Migration AssistantSQL Server Migration Assistant for Oracle (OracleToSQL)Download Microsoft SQL Server Migration Assistant for OracleAzure Database Migration Guides

Are you planning your SQL Server data estate migrations to Azure? Your first step is to discover and assess your SQL Server data estate and understand the Azure SQL readiness. Join Venkata Raj Pochiraju to get a sneak-peak into how you can leverage our Azure Migrate Service can provide comprehensive discovery and assessment of your SQL Servers migration to Azure Cloud that helps your migration planning.[01:00] End to end SQL Server migrations at scale using Azure Migrate (public preview)[02:32] User workflow[03:58] Demo[15:17] Getting started Resources:Database Migration guideAzure MigrateTutorial: Discover servers running in VMware environment with Azure MigrateTutorial: Assess SQL instances for migration to Azure SQL

Understand the various cloud migration drivers, migration strategies, and various phases in the migration journey in this episode of Data Exposed with Venkata Raj Pochiraju. He'll also introduce various database migration tools and services that Microsoft builds to help you in the migration journey. [01:14] Migration planning and execution[05:39] Application Portfolio Rationalization (MSIT)[08:57] Migration Investiments[12:01] Getting Started Resources:Database Migration GuidesAzure MigrateTutorial: Discover servers running in VMware environment with Azure Migrate: Discovery and assessmentTutorial: Assess SQL instances for migration to Azure SQL

In this episode of Data Exposed with Kate Smith, she'll take you through the basics of why query processing matters, what it does, and how Intelligent Query Processing makes your workloads faster and more efficient.[01:10] What is Query Processing[03:47] Query Processing vs Intelligent Query Processing[07:16]​ Getting started[08:14]​ Benefits of Intelligent Query Processing Resources:The Positive Impact of Intelligent Query Processing - Microsoft Tech CommunityIntelligent query processing in SQL databases

Why is storage so important for Data Engineering? Learn how storage impacts the performance of your database solution. In this episode with MVP Argenis Fernandez, we will go over the basics of I/O, what the different access patterns are for the database engine and how to tell when there is an issue with underlying storage for your database.[00:34]​ About Argenis Fernandez[01:23]​ Why is storage so important for data engineering?[02:12]​ Latency[03:04]​ IOPS[04:17]​ Bandwidth[08:45]​ Different IO Block Sizes[12:03]​ SQL Server I/O Patterns[18:19]​ Getting startedResources:Argenis' blog on IO Block SizeGianluca's WorkloadTools MVP Edition episodeFor any questions, reach out to Argenis and other MVPs on Twitter with #SQLHelpAbout Argenis Fernandez:Argenis Fernandez is a Principal Architect for Pure Storage. He works with customers around the world to make their experience with storage better. He's a Data Platform MVP, a VMware vExpert and a Microsoft Certified Master. Argenis also worked on the SQL Server engineering team as a Principal Program Manager handling various areas of the database engine as well as other internal projects within Microsoft. Argenis is a community enthusiast and speaks at all major Azure SQL-related conferences.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have a very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products, and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and the quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Jupyter Notebooks bring a wonderful capability to hand someone a single file that contains both code, and instructions on how to run that code. This is great and can be used in many different ways, one of which is to help new team members get up to speed. But what happens when you need to do the same thing as one of your existing Notebooks, but now you need to do it at scale? What if you could take your existing Notebook and add parameters for things like Server name & Database? In this episode with Aaron Nelson, take a look at how new features in Azure Data Studio can help you take your Notebooks to the next level of re-usability.[00:58]​ Notebooks overview[02:54]​ Create a Parameterized Notebook- Demo[03:51]​ SQL-on-Linux instance in a Docker container - Demo[09:00]​ Export Power BI Workspace Assets with PowerShell - Demo[12:22]​ Getting startedResources:Parameterization of Notebooks in Azure Data Studio - Azure Data Studio | Microsoft DocsUse Invoke-ExecuteNotebook to build a SQL-on-Linux instance in a Docker container, by calling Invoke-ExecuteNotebook to execute the Notebook, and passing in the sa_password & digits for the name/port number to the Notebook as a parameter

Helm is the package manager for Kubernetes itself. Learn with Amit Khandelwal on Data Exposed how you can use Helm from your Windows machine to deploy SQL Server 2019 containers on Kubernetes all in less than 5 minutes.[01:36] What is Helm[02:48] What do I need to get started?[05:20] Demo[24:00] Getting startedResources:Deploy SQL Server on Azure Kubernetes Service cluster via Helm Charts - on a windows client machineGithub

In this episode of Data Exposed, Manoj Raheja shows us how to seamlessly integrate with Azure Data Explorer from Apache Spark for Azure Synapse Analytics.[01:13] Azure Data Explorer Overview[02:52] Azure Data Explorer connector for Azure Synapse[05:20] Demo[09:20] Getting startedResources:Connect to Azure Data Explorer using Apache Spark for Azure Synapse AnalyticsGitHub (Sample Code)

Database migrations often involve multiple phases, steps, and tools based on various scenarios and workload requirements. To help you migrate your databases to Azure, we have published a set of new Azure Database Migration Guides and a Hub page that provides scenario-based migration content and "How To" guides depending on your source database and target database platforms. In this episode with Mohamed Kabiruddin, he will walk you through the new migration hub page to easily navigate to the content you need based on your scenario, how to use the relevant database migration guides, and how to provide feedback to Microsoft for any specific content.[01:07] Migrations Process Flow[02:54] Azure Database Migration Guides Overview[08:08] Customer Case Studies[09:47] How to provide feedback[11:08] Getting startedResources:New Migration Hub pageAzure Migration Center

In this episode of Data Exposed with David Trigano and David Brookler, learn how you can leverage new capabilities in Dynamic Data Masking, help your organization prevent unauthorized access to sensitive data, and gain control by masking it to a non-privileged user at different levels of your database. [01:45] What is Dynamic Data Masking[02:14] Demo using Azure Portal[04:01] Demo using SQL Server Management Studio (SSMS) Resources:Dynamic data masking

In this episode with Gaston Cruz, he'll show you the options to process Azure Analysis Services models (Semantic Layer) connecting to an Azure SQL DB as a data source (using SSDT), and then create an architecture using a Service Principal account to process the model (DB, Tables, Partitions) in an automatic way deploying an Azure Logic Apps, and then calling from Azure Data Factory to trigger the process. Finally, he'll conclude by showing you the advantages of using a live connection from Power BI to connect to AAS models. [00:35] About Gaston Cruz[01:43] Architectures[04:20] Demo[12:30] Adding other data sources Resources: Gaston's YouTube ChannelAAS REST API official doc

We all know one of the most important and secure methods of authentication in SQL Server is through AD authentication. Learn today in this episode of Data Exposed with Amit Khandelwal how to enable AD authentication for a SQL container and log in using an AD account all in less than 5 minutes using a tool called adutil.[02:41] What is Adutil (Preview)? And why are we talking about it?[04:47] Setup[08:30] Demo: Enable AD authentication for SQL 2019 containers Resources:Tutorial: Configure Active Directory authentication with SQL Server on Linux containersIntroducing adutil - A tool to ease configuration of AD authentication for SQL on Linux/ContainersTutorial: Configure Active Directory authentication with SQL Server on Linux using adutil

Azure SQL Auditing recently announced two new destinations now Generally available, and a new capability called Azure SQL Auditing of Microsoft support operations. In this episode, Anna Hoffman and David Trigano will cover all these new capabilities that allow you to capture any operations done against your SQL assets on Azure at scale.[00:50]​ Announcements[03:30] Demo: Enabling Azure SQL Auditing and Auditing of Microsoft support operations[05:30]​ Demo: Deploy Azure SQL Auditing at scale with Azure Sentinel [07:18]​ Demo: Log analytics[08:50]​ Getting startedResources: Auditing for Azure SQL Database and Azure Synapse Analytics

SQL Assessment API provides a mechanism to evaluate the configuration of your SQL Server for best practices. The API is delivered with a ruleset containing best practice rules suggested by SQL Server Team. This ruleset is enhancing with the release of new versions but at the same time, the API is built with the intent to give a highly customizable and extensible solution. So, users can tune the default rules and create their own ones. The API can be used to assess SQL Server versions 2012 and higher and Azure SQL Managed Instance. In this episode with Aaron Nelson, we'll show you the basics of the SQL Assessment PowerShell commands, and how you can run the assessments for your Azure SQL Managed Instances as well as your on-prem SQL Server instances.[01:23] Intro to SQL Assessment checks[02:19] Demo: SQL Assessment checks[09:08] Getting startedResources:SQL Server Samples

Running complex aggregations and analytical functions on real-time operational databases is a powerful capability in Azure SQL. In the last part of this three-part series with Silvano Coriani, we will see how Window Functions can be a great tool to express analytical calculations on real-time data sets. [01:30]​ Operational Analytics: what kind of analytics?[03:12]​ A Common Business Scenario[05:10]​ Old school[06:22]​ Performance with self-join and subqueries[06:42]​ New school[08:01]​ Performance with Window Functions[08:50]​ Demo: Performance with Window Functions[13:18]​ Window Functions capabilities[14:54]​ Getting started More episodes in this Operational Analytics Series:How Azure SQL Enables Real-time Operational Analytics (HTAP) - Part 1Optimize Existing Databases & Apps with Operational Analytics in Azure SQL - Part 2 Resources:Get started with Columnstore for real-time operational analyticsSample performance with Operational Analytics in WideWorldImportersT-SQL Window Functions: For data analysis and beyond, 2nd EditionReal-Time Operational Analytics:Memory-Optimized Tables and Columnstore IndexDML operations and nonclustered columnstore index (NCCI) in SQL Server 2016Filtered nonclustered columnstore index (NCCI)

You don't necessarily need to change your data models and applications to run operational analytics workloads on Azure SQL. In part two of this three-part series with Silvano Coriani, we will explore Azure SQL capabilities to optimize your databases for mixed workloads on real-time data. [01:47] Traditional Analytical Architecture[03:10] Minimizing Data Latency for Analytics[04:42] Operational Analytics: Nonclustered Columnstore Index (NCCI)[06:19] Demo: Operational Analytics with Nonclustered Columstore Index[10:35] Operational Analytics: Columnstore on In-Memory Tables[14:45] Demo[18:45] Getting startedMore episodes in this Operational Analytics Series:How Azure SQL Enables Real-time Operational Analytics (HTAP) - Part 1 Resources:Get started with Columnstore for real-time operational analyticsSample performance with Operational Analytics in WideWorldImportersT-SQL Window Functions: For data analysis and beyond, 2nd EditionReal-Time Operational Analytics:Memory-Optimized Tables and Columnstore IndexDML operations and nonclustered columnstore index (NCCI) in SQL Server 2016Filtered nonclustered columnstore index (NCCI)

Join Data Platform MVP Ben Weissman as he explores Azure Arc for Data Services, Microsoft's solution to deploy services like Azure SQL to any cloud – including private clouds – using Kubernetes. He will take us through the core concepts of Azure Arc for Data Services and also demo how easy it is to deploy an Azure SQL Managed Instance on-premises while still being able to see its telemetry from the Azure portal.[01:10]​ Azure Arc overview[03:16]​ Azure Arc-enabled Data Services[06:04]​ Demo[12:45]​ How to learn moreResources:Azure Arc-Enabled Data Services RevealedAbout Ben Weissman:Ben Weissman has been working with SQL Server since SQL Server 6.5, mainly in the BI/Datawarehousing field. He is a Data Platform MVP, MCSE Data Management and Analytics, and a Certified Data Vault Data Modeler. He is also the first BimlHero Certified Expert in Germany and a co-author of "SQL Server Big Data Clusters" and "The Biml Book". Ben has been involved in more than 150 BI Projects and is always looking for ways to become more productive and make SQL Server even more fun!About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Azure SQL enables hybrid transactional/analytical workloads for real-time operational analytics scenarios through a mix of in-memory and columnar database technologies. In the first episode of this three-part series with Silvano Coriani, we will explore Azure SQL capabilities to run a mix of transactional and analytical queries on the same underlying data store.[00:49]​ Different type of workloads[03:59]​ Hybrid transaction/analytical processing[04:45]​ Enable HTAP: real-time operational analytics[07:00]​ Coming upResources:Get started with Columnstore for real-time operational analyticsSample performance with Operational Analytics in WideWorldImportersT-SQL Window Functions: For data analysis and beyond, 2nd EditionReal-Time Operational Analytics:Memory-Optimized Tables and Columnstore IndexDML operations and nonclustered columnstore index (NCCI) in SQL Server 2016Filtered nonclustered columnstore index (NCCI)

SQL assets are critical resources and contain the most precious information a company owns, which makes them one of the preferred targets for attackers. Protecting them across the environments can be challenging and requires multiple skills to deploy, manage, and remediate those precious resources. In this episode with David Trigano, you will learn how Azure Defender for SQL protects your SQL anywhere and offers capabilities to discover misconfigurations and raise alerts in case of usual activities across every flavor of SQL you are using today, in any environment. [01:09] What is Azure Defender for SQL[02:00] Where is Azure Defender for SQL supported[02:40] Demo[08:24] Getting started Resources:Introduction to Azure Defender for SQLAzure Security Center

In this episode with Dani Ljepava, we will show you how to manually trigger a planned failover on SQL Managed Instance to test your applications for fault tolerance and will talk about best practices for your applications to achieve tolerance to transient faults typical for the cloud environments. Transient faults in the cloud (for example software patching, security updates, failover, and similar) include a momentary loss of network connectivity, temporary unavailability of a service, or timeouts when service is busy. These faults are often self-correcting due to which your applications need to be able to handle such occurrences with the appropriate retry logic. While migrating legacy apps to the cloud or developing new cloud-born apps, it is strongly advised to ensure that your applications follow the best practices disclosed in this episode helping you build cloud-ready apps.[00:46]​ About Dani Ljepava[01:30]​ Transient errors in the cloud[02:50]​ Cloud Ready Apps[04:07]​ Understanding failover as part of HA on SQL MI[06:00]​ Demo: User-initiated failover on SQL Managed Instance[11:35] How to check if failovers occurred[12:35]​ Best practicesResources:User-initiated manual failover on SQL Managed Instance

Join Anna Hoffman and Buck Woody as they take a tour of the incredible learning resource the Microsoft Engineering team has put together. From labs to full hands-on workshops and much more, you'll find a wealth of high-quality, free-cost training. You'll also learn about many of the other valuable references and assets you can find at SQL Workshops. To get started with SQL Workshops, click here. [01:05] What is SQL Workshops[02:41] Walking through SQL Workshops