Podcasts about Microsoft SQL Server

Family of database software

  • 78PODCASTS
  • 134EPISODES
  • 40mAVG DURATION
  • ?INFREQUENT EPISODES
  • Dec 18, 2024LATEST
Microsoft SQL Server

POPULARITY

20172018201920202021202220232024


Best podcasts about Microsoft SQL Server

Latest podcast episodes about Microsoft SQL Server

TechCentral Podcast
TCS+ | Moving from SQL Server to Azure SQL – what you need to know

TechCentral Podcast

Play Episode Listen Later Dec 18, 2024 14:34


Is your company thinking about modernising its IT infrastructure? Is it planning to migrate from an on-premises Microsoft SQL Server database to the cloud-based Azure SQL solution? Then this podcast is for you. In this two-part series, we delve into greater detail on what's involved in a cloud database migration. First Distribution's Microsoft Azure product manager Preegan Chetty is our guest in the studio for this episode. He unpacks: • The risks and opportunities involved in the migration; • What companies need to be aware of before they even embark on a migration to Azure SQL; • How Microsoft helps companies with their migration projects; and • The top motivating factors driving companies to migrate away from an on-premises SQL Server solution to Azure SQL. Don't miss this informative discussion – and be sure to catch episode 2 in this series with First Distribution. TechCentral

SQL Server Radio
Episode 166 - DR Planning for SQL Server and Loading Large CSV Files

SQL Server Radio

Play Episode Listen Later Aug 12, 2024 35:32


Guy and Eitan discuss the recent CrowdStrike incident and what it would mean for DBAs, and discuss options to load huge CSV files into SQL Server as fast as possible. Relevant links: 101 of Troubleshooting SQL Server on Linux - Microsoft Community Hub bcp utility - SQL Server | Microsoft Learn Altering lock escalation for SQL Server tables (mssqltips.com) dbatools docs | Import-DbaCsv A Fast Way to Load Large CSV Files into Microsoft SQL Server | by Sasha Korovkina

Hashtag Trending
Is this why MacDonald's decided to "take out" their AI software? Hashtag Trending for Wednesday, June 19, 2024

Hashtag Trending

Play Episode Listen Later Jun 19, 2024 7:07 Transcription Available


In this episode of Hashtag Trending, hosted by Jim Love, we explore the reasons behind McDonald's pause on its AI automated ordering system, including humorous and costly errors that surfaced on social media. We also highlight a groundbreaking AI cyber attack simulation conducted by the US government in collaboration with tech giants like Microsoft and Amazon. Additionally, we discuss the widespread use of outdated Microsoft SQL Server databases and the risks involved. Finally, we share encouraging news from FromSoftware, whose president commits to avoiding layoffs amidst industry trends.  Tune in for these stories and more! 00:00 Introduction and Sponsor Message 00:22 McDonald's AI Experiment Fails 02:18 US Government's AI Cyber Attack Simulation 03:20 Outdated Microsoft SQL Server Databases 05:14 FromSoftware's No Layoff Policy 06:32 Conclusion and Show Notes

SQL Server Radio
Episode 163 - When and Why to HADR

SQL Server Radio

Play Episode Listen Later May 13, 2024 34:37


Guy and Eitan discuss the various High Availability and Disaster Recovery options available to us in Microsoft SQL Server, their main advantages, limitations, and when it's most suitable to use or not to use them. Relevant links for further reading: AlwaysOn Basic Availability Groups / Database Mirroring AlwaysOn "Enterprize" Availability Groups Failover Cluster Instance Log Shipping Transactional Replication

2.5 Admins
2.5 Admins 194: Thundering Mastodon

2.5 Admins

Play Episode Listen Later May 9, 2024 30:14


Mastodon's link previews are causing downtime for web servers without properly configured caching, locking down DNS inside Windows networks, why using write-once backup media is a bad idea, and increasing the performance of a Microsoft SQL Server with SSDs and ZFS.   Plugs Support us on patreon and get an ad-free RSS feed with early […]

Late Night Linux All Episodes
2.5 Admins 194: Thundering Mastodon

Late Night Linux All Episodes

Play Episode Listen Later May 9, 2024 30:14


Mastodon's link previews are causing downtime for web servers without properly configured caching, locking down DNS inside Windows networks, why using write-once backup media is a bad idea, and increasing the performance of a Microsoft SQL Server with SSDs and ZFS.   Plugs Support us on patreon and get an ad-free RSS feed with early... Read More

Software Huddle
AGI is Surely Coming with Former Snowflake CEO Bob Muglia

Software Huddle

Play Episode Listen Later Dec 5, 2023 59:14


Today we have the former CEO of Snowflake, a 23 year veteran of Microsoft, Bob Muglia on the show. In this interview, we discuss Bob's book, Datapreneurs, which takes you on a journey about the people behind the first relational databases in the 1970s and early 80s, to Bob's experience launching Microsoft SQL Server and a ton of other products, developing the Data Cloud at Snowflake, and to the future of data and AI. We cover a lot of ground, including some of his experience working alongside the likes of Bill Gates and Steve Ballmer. Timestamps: 02:24 Introduction 04:53 Relational Databases 18:43 Speed of Innovations 24:30 Keeping the Early Stage Culture 31:04 Most successful leaders are difficult to deal with 34:31 Setting up Cloud Data Center at home 36:25 Joining Snowflake as the CEO 38:54 AWS made Snowflake happen 42:18 Google, AWS Missing the Snowflake Opportunity 46:13 Impact On Jobs 50:48 Existential Risk 52:28 Staying Optimistic Links: The Datapreneurs: The Promise of AI and the Creators Building Our Future https://www.thedatapreneurs.com/ Follow Bob: https://twitter.com/Bob_Muglia Follow Sean: https://twitter.com/seanfalconer Software Huddle ⤵︎ X: https://twitter.com/SoftwareHuddle LinkedIn: https://www.linkedin.com/company/softwarehuddle/ Substack: https://softwarehuddle.substack.com/

The Cloud Pod
211: The Cloud Pod finally Groks observability

The Cloud Pod

Play Episode Listen Later May 12, 2023 48:57


Welcome to the newest episode of The Cloud Pod podcast! Justin, Ryan, Jonathan, and Matthew are all here this week to discuss the latest news and announcements in the world of cloud and AI - including New Relic Grok, Athena Provisioned Capacity from AWS, and updates to the Azure Virtual Desktop. Titles we almost went with this week: None! This week's title was SO GOOD we didn't bother with any alternates. Sometimes it's just like that, you know?  A big thanks to this week's sponsor: Foghorn Consulting, provides top-notch cloud and DevOps engineers to the world's most innovative companies. Initiatives stalled because you have trouble hiring?  Foghorn can be burning down your DevOps and Cloud backlogs as soon as next week.

The Cloud Pod
209: The Cloud Pod Whispers Sweet Nothings To Our Code (**why wont you work**)

The Cloud Pod

Play Episode Listen Later Apr 28, 2023 44:35


Welcome to the newest episode of The Cloud Pod podcast! Justin, Ryan and Jonathan are your hosts this week as we discuss all the latest news and announcements in the world of the cloud and AI - including Amazon's new AI, Bedrock, as well as new AI tools from other developers. We also address the new updates to AWS's CodeWhisperer, and return to our Cloud Journey Series where we discuss *insert dramatic music* - Kubernetes!  Titles we almost went with this week: ⭐I'm always Whispering to My Code as an Individual

Microsoft Mechanics Podcast
SQL Server 2022 updates for query performance and database failover

Microsoft Mechanics Podcast

Play Episode Listen Later Feb 14, 2023 13:58


Improve hybrid workloads with updates to SQL Server 2022, now generally available. Link local SQL Servers to Azure SQL Managed Instances for bidirectional disaster recovery, achieve massive speedups with differential snapshot-based backup and restore, as well as anywhere management of your SQL Servers with Azure Arc-enabled SQL provisioning, and new pay-as-you-go licensing. For raw performance, we'll demonstrate intelligent Degree of Parallelism feedback where SQL optimizes the thread count of queries automatically. Bob Ward, Principal Architect for Microsoft SQL Server, joins Jeremy Chapman to share improvements to query performance, Azure integration, and costs for both licensing and compute, local or in the cloud. ► QUICK LINKS: 00:00 - Introduction 01:01 - Backup and disaster recovery 02:31 - Failover between SQL Server and Managed Instance 05:24 - Snapshot backups 07:57 - Restore a snapshot backup 08:59 - SQL Server management: Pay-as-you-go 10:40 - SQL Server performance: Query optimizations 13:21 - Wrap up ► Link References: Start a free version of SQL Server 2022 at https://aka.ms/getsqlserver2022 Check out our free online workshop at https://aka.ms/sql2022workshop ► Unfamiliar with Microsoft Mechanics? As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft. • Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries • Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog • Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast ► Keep getting this insider knowledge, join us on social: • Follow us on Twitter: https://twitter.com/MSFTMechanics • Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/ • Enjoy us on Instagram: https://www.instagram.com/msftmechanics/ • Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics 

Ingenios@s de Sistemas
Episodio 189 - Big Data 2

Ingenios@s de Sistemas

Play Episode Listen Later Jan 5, 2023 14:34


El objetivo del episodio: explorar los diferentes tipos de datos que se pueden recopilar y procesar en Big Data. Algunas de las posibles aplicaciones de Big Data, como la toma de decisiones empresariales, la investigación y el análisis de tendencias. Redes sociales: los datos generados por los usuarios de redes sociales, como publicaciones, comentarios y reacciones, pueden ser recopilados y procesados en Big Data. Estos datos pueden proporcionar información valiosa sobre las opiniones, intereses y comportamientos de los usuarios. Dispositivos de internet de las cosas (IoT): los datos generados por dispositivos conectados a internet, como termostatos inteligentes, relojes deportivos o cámaras de seguridad, pueden ser recopilados y procesados en Big Data. Estos datos pueden proporcionar información valiosa sobre el uso de los dispositivos y la forma en que estos se integran en la vida diaria de las personas. Transacciones comerciales: los datos generados por las transacciones comerciales, como compras en línea, pagos con tarjeta de crédito o transacciones bancarias, pueden ser recopilados y procesados en Big Data. Estos datos pueden proporcionar información valiosa sobre los hábitos de compra de los consumidores y las tendencias del mercado. Datos gubernamentales: los datos generados por los gobiernos, como estadísticas de población, empleo o consumo, pueden ser recopilados y procesados en Big Data Explica que el término "Big Data" se refiere a la cantidad de datos generados, no a su tamaño en términos de memoria o almacenamiento. Datos estructurados: Bases de datos relacionales: son bases de datos que almacenan información en tablas y utilizan claves para relacionar los datos entre sí. Ejemplos de bases de datos relacionales incluyen MySQL, Oracle y Microsoft SQL Server. Hojas de cálculo: son archivos que contienen información organizada en celdas y filas, y que pueden incluir fórmulas y gráficos. Ejemplos de hojas de cálculo incluyen Excel, Google Sheets y Apple Numbers. Archivos CSV: son archivos de texto que almacenan información organizada en filas y columnas, separadas por comas. Los archivos CSV pueden ser abiertos y editados con cualquier editor de texto o procesador de hojas de cálculo. Datos no estructurados: Documentos de texto: son archivos que contienen información escrita, como artículos, ensayos o informes. Ejemplos de documentos de texto incluyen archivos Word, PDF o texto plano. Imágenes: son archivos que contienen información visual, como fotografías o ilustraciones. Ejemplos de imágenes incluyen archivos JPEG, PNG o GIF. Audio: son archivos que contienen información sonora, como música o grabaciones de voz. Ejemplos de archivos de audio incluyen archivos MP3, WAV o AIFF. Video: son archivos que contienen información visual y sonora, como películas o vídeos. Ejemplos de archivos de video incluyen archivos MP4, MOV o AVI.. Datos semi-estructurados: Contenido de redes sociales: el contenido publicado en redes sociales, como publicaciones, comentarios y hashtags, puede ser considerado semi-estructurado. Correos electrónicos: los correos electrónicos también pueden ser considerados semi-estructurados, ya que tienen cierta estructura, como el remitente, el destinatario, el asunto y el cuerpo del mensaje, pero no están tan organizados como una tabla de datos. Archivos XML: el XML es un lenguaje de marcas extensible que permite definir estructuras para los datos Plan de Asesoria Personal Telegram Tecnolitas Déjame un mensaje de voz

TheMummichogBlog - Malta In Italiano
"REF : COMM-SYSC-ERP/2022/SEP Systems Consultant (ERP) FULL TIME Competitive Salary Offered EYESEL Business Suite Job Description Who Are We? Founded in 1994, our mission at Information Systems

TheMummichogBlog - Malta In Italiano

Play Episode Listen Later Nov 10, 2022 5:31


"REF : COMM-SYSC-ERP/2022/SEP Systems Consultant (ERP) FULL TIME Competitive Salary Offered EYESEL Business Suite Job Description Who Are We? Founded in 1994, our mission at Information Systems Limited is to provide the most comprehensive, cost-effective and innovative business software solutions through the cooperation of expertise and knowledge. We are committed to delivering the highest level of value to our customers and providing a dynamic and challenging environment for all our employees. The group now employs over 65 professionals, services over 600 customers both locally and overseas and is ISO 9001:2015 certified. Job Purpose Provide client support and consultancy on our ERP product – Eyesel Business Suite (EBS) either onsite or remotely in a timely manner. Duties and Responsibilities Provide on-going software consulting support to our clients in the form of application upgrades, training, customization, system enhancements Provide remote support, or on site as required Assist in any phase in the software project life cycle as required Qualifications, Skills and Experience. An IT qualification is required A business qualification or demonstrated knowledge of accounting fundamentals would be considered an asset. Working with Microsoft SQL Server & using Crystal Reports Business Objects would be considered an asset. Have at least 1 year experience in the industry performing a similar role using an ERP product Other Personal Qualities. Commitment to exceptional customer service and business improvement Abilty to work effectively within a team environment where flexibility is essential Effective communication, attention to details, time management, and analytical thinking An ability to work with personal accountability for results and productivity Other Requirements: Ideally, the candidates will already be based in Malta and hold a valid EU working permit. On the job training would be provided. Salary will be commensurate with experience, expertise and knowledge. 24×7 Access to our corporate Learning Management System as part of an ongoing drive to Learn and Develop your career. Access to corporate employee incentive & discount schemes. https://isl.com.mt/careers/systems-consultant-erp/ " """#TheMummichogblogOfMalta Amazon Top and Flash Deals(Affiliate Link - You will support our translations if you purchase through the following link) - https://amzn.to/3CqsdJH Compare all the top travel sites in just one search to find the best hotel deals at HotelsCombined - awarded world's best hotel price comparison site. (Affiliate Link - You will support our translations if you purchase through the following link) - https://www.hotelscombined.com/?a_aid=20558 https://t.me/themummichogblogdotcom https://twitter.com/Mummichogblogd1 https://www.facebook.com/profile.php?id=100086295703212 https://www.facebook.com/themummichogblogdotcom/ https://themummichogblogofmalta.blogspot.com/ https://www.tumblr.com/blog/themummichogblogofmalta https://open.spotify.com/show/6S7XwNge80YtcS1CcVH2nB https://www.youtube.com/channel/UCnnNPvuRZb9tjfE1Dw-aFUw"" "

Unofficial SAP on Azure podcast
#112 - The one with SAP on DB2 (Peter Kalan) | SAP on Azure Video Podcast

Unofficial SAP on Azure podcast

Play Episode Listen Later Sep 30, 2022 55:53


In episode 112 of our SAP on Azure video podcast we talk about new regions for Azure NetApp Files and cross-region replication, Hybrid work and the impact also to Viva, the Kusto Detective Agency, SAP TechEd and Single Sign-On and a new webinar series from DSAG and Microsoft. In previous episodes we already talked about running SAP on HANA, running SAP on Oracle and best practices. But obviously HANA and Oracle are not the only databases that customers can use running SAP on Azure. There is Microsoft SQL Server, ASE and of course DB2. So today we have the pleasure to have Peter Kalan joining us to talk about SAP on DB2 on Azure! Learn about High available and Disaster recovery, backup and restore with DB2 on Azure. https://www.saponazurepodcast.de/episode112 Reach out to us for any feedback / questions: * Robert Boban: https://www.linkedin.com/in/rboban/ * Goran Condric: https://www.linkedin.com/in/gorancondric/ * Holger Bruchelt: https://www.linkedin.com/in/holger-bruchelt/ #SAPonAzure

The Pure Report
Unplugged Vol. 8: SQL Server Special Guest, VMware Explore, and Why Code Paths Matter

The Pure Report

Play Episode Listen Later Sep 26, 2022 55:10


Unplugged returns with Volume 8 and an exciting special guest diving into cool stuff with Microsoft SQL Server including snapshot, backup and virtualization best practices. Join fabulous co-hosts Andrew Miller and JD Wallace as we recap the recent VMware Explore event in San Francisco and hear key insights from attendees and anecdotes from the show. Are in-person events coming back strong? And get the next in the series of 15 Decision - this time the crew covers Streamlined Code Paths and impacts on availability and reliability. We close with our Special Guest's tip of the week (hint: more SQL goodness). For more info on Pure and Microsoft SQL Server: https://www.purestorage.com/solutions/applications/microsoft/sql.html.

Modernize or Die ® Podcast - CFML News Edition
Modernize or Die® - CFML News Podcast for June 7th, 2022 - Episode 151

Modernize or Die ® Podcast - CFML News Edition

Play Episode Listen Later Jun 7, 2022 73:38


2022-06-07 Weekly News - Episode 151Watch the video version on YouTube at https://www.youtube.com/watch?v=CKnPCL8870Q&list=PLNE-ZbNnndB98oRT8THamdCUiyDQL1uEj&index=151 Hosts: Gavin Pickin - Senior Developer at Ortus Solutions Dan Card - Senior Developer at Ortus Solutions Thanks to our Sponsor - Ortus SolutionsThe makers of ColdBox, CommandBox, ForgeBox, TestBox and all your favorite box-es out there. A few ways  to say thanks back to Ortus Solutions: BUY SOME ITB TICKETS - COME TO THE CONFERENCE Like and subscribe to our videos on YouTube.  Help ORTUS reach for the Stars - Star and Fork our Repos Star all of your Github Box Dependencies from CommandBox with https://www.forgebox.io/view/commandbox-github  Subscribe to our Podcast on your Podcast Apps and leave us a review Sign up for a free or paid account on CFCasts, which is releasing new content every week BOXLife store: https://www.ortussolutions.com/about-us/shop Buy Ortus's Book - 102 ColdBox HMVC Quick Tips and Tricks on GumRoad (http://gum.co/coldbox-tips)  Patreon SupportGoal 1 - We have 37 patreons providing 100% of the funding for our Modernize or Die Podcasts via our Patreon site: https://www.patreon.com/ortussolutions. Goal 2 - We are 53% of the way to fully fund the hosting of ForgeBox.io PATREON SPONSORED JOB POSTING!Hagerty - MotorSportReg2 Job Opportunities for Senior Software Engineer, Motorsport - more in the job section.Ready to get in the driver's seat? Join us!https://bit.ly/3985J3U News and AnnouncementsLive Stream Series - Koding with the Kiwi + FriendsStarting this Friday, June 10th, at 1pm PDTGoal is for Weekly Streams - when possibleGavin will be hosting a live stream, for Patreon members only. This stream try to include special guests from the community, to get their viewpoints / advice on how Gavin should do something. We'll be pair programming / talking with Adam Cameron about TDD, Sam Knowlton on Quick/QB, and Wil De Bruin on API documentation and Validation, and others from the Ortus Team and Community too. This week's guest is a surprise, you'll have to tune in to find out.Patreon's check your email, there will be an email sent soon with the registration link for the zoom call.Blog Post with more details coming tomorrow.Not a patreon? Sign up today or wait for us to release the recording on CFCasts after the session.INTO THE BOX - UpdatesThis week we're going to be announcing some attendee perks, like CFCasts, as well as some more sponsors. Last week was full of announcements, and special code and the last workshop selected.Announcing - Into the Box 2022 Podcast SeriesThis podcast is a special podcast for attendees or undecided attendees, to get a view of what the conference has to offer, we'll be interviewing Ortus members organizing the conference, as well as workshop trainers, session speakers and sponsors as well. You'll get all of this information, in short sharp episodes, so you can decide if you want to Into the Box and WHEN you decide you are going, which workshop and sessions will you attend.https://www.intothebox.org/blog/announcing-into-the-box-2022-podcast-series Free Month of CFCasts for all ITB Attendees in Addition to ITB 2022 VideosEvery year, when you are an attendee of Into the Box, you get all of the recordings from the Into the Box Conference you attended made available for future viewing, or reviewing. We have always done this so you don't miss out on all of the amazing content in both tracks at the conference. In addition to that, this year, after Into the Box, we'll also be sending all of the attendees a coupon for 1 month free access to all of the content on CFCasts.http://www.intothebox.org/blog/free-month-of-cfcasts-for-all-itb-attendees-in-addition-to-itb-2022-videos Couchbase - Platinum Sponsor for Into the Box 2022We are excited to announce Couchbase as a Platinum Sponsor at Into the Box 2022. Ortus Solutions has built the Couchbase Extension for Lucee and has been using Couchbase for many years now, to provide lightning fast caching, vital in a clustered environment. Couchbase has continued to grow and expand features and benefits, and we are so happy they are sponsoring Into the Box 2022.http://www.intothebox.org/blog/couchbase-platinum-sponsor-for-into-the-box-2022 Top Secret - Big Announcement coming next week - fingers crossedICYMI - ColdBox BE ready for next release - testers neededHas major refactoring and improvements on wirebox - we have a need for speed!https://ortussolutions.atlassian.net/browse/COLDBOX-1113?jql=project%20%3D%20%22COLDBOX%22%20AND%20fixVersion%20%3D%20%22Current%22https://ortussolutions.atlassian.net/browse/COLDBOX-1107?jql=project%20%3D%20%22WIREBOX%22%20AND%20fixVersion%20%3D%20%22Current%22ICYMI - CBFS is going to be cut any day now - testers neededWe're looking for others to contribute other providers to make it even more powerful.https://www.forgebox.io/view/cbfsNew Releases and UpdatesICYMI - Hyper v3.5.0 is out with:- New `getStatusText()` and `getStatus()` methods- `getMemento()` methods for both `HyperRequest` and `HyperResponse`- And a better `throwOnError` experience showing much more information than `cfhttp` gives you out of the box.https://www.forgebox.io/view/hyper ICYMI - Minor Update to the Lucee Mongo DB Extensionfixes an issue where cache entries with a “last access” timeout would not properly be removed from the cache in a timely manner.fixes an issue where the hit count in the table was incremented twice on each “hit”minor code cleanup (typos in function names)https://dev.lucee.org/t/mongodb-extension-minor-update-3-12-8-132/10254 WEBINARS / MEETUPS AND WORKSHOPSTHIS WEEK - Online CF Meetup - "When Should I Use 3rd Party Libraries vs Roll My Own?", with Gavin PickinThere is always a trade-off between using a 3rd party library and rolling your version in software development. I often hear many of these points in discussions, but I wonder how many people know and consider them, so I wanted to share my pros and cons.This presentation will help convince you that libraries are not EVIL like so many haters believe. Choosing the right libraries will make you more productive and efficient, not lazy. We'll look at how to identify solid use-cases for using a 3rd party library in your application. It gives you a checklist of questions to help you identify the red flags of unsafe, unreliable, poorly supported, or ill-suited libraries.We'll look at some CF Landscape exampleshttps://www.meetup.com/coldfusionmeetup/events/286262739/ Ortus Webinar - June - Getting started with the Legacy Migration with Dan CardJune 24th 2022: Time 11:00 AM Central Time ( US and Canada )We will look at the process of converting legacy .cfm based sites into a more modern coding design which has less overall code, is easier to maintain and manage, mistakes and errors can more readily and speedily identified and fixed, and is easier to read.Registration Link: https://us02web.zoom.us/meeting/register/tZAvceqsqj4vGd2jojyCgn7cUnytPpBeWvV5 View all Webinars: https://www.ortussolutions.com/events/webinars June 2022 Seattle ColdFusion User Group MeetingWe are restarting our Seattle ColdFusion User Group meetings and are looking forward to meeting online with all of you.This month's meeting includes a presentation by Leon O'Daniel on sending SMS messages using ColdFusion and the Twilio API.https://www.meetup.com/Seattle-ColdFusion-User-Group/events/285974950/ Adobe WorkshopsJoin the Adobe ColdFusion Workshop to learn how you and your agency can leverage ColdFusion to create amazing web content. This one-day training will cover all facets of Adobe ColdFusion that developers need to build applications that can run across multiple cloud providers or on-premiseWEDNESDAY, JUNE 15, 20229:00 AM EDTAdobe ColdFusion WorkshopBrian Sappeyhttps://1-day-coldfusion-workshop.meetus.adobeevents.com/ WEDNESDAY, JUNE 22, 20229:00 AM CETAdobe ColdFusion WorkshopDamien Bruyndonckx (Brew-en-dohnx) https://adobe-cf-workshop.meetus.adobeevents.com/ FREE :)Full list - https://meetus.adobeevents.com/coldfusion/ Adobe and Carahsoft workshopsICYMI - Wednesday June 01, 2022Adobe ColdFusion Advanced Workshop CPE credit availableHosted By: Adobe & Carahsofthttps://www.carahsoft.com/learn/event/37899-Adobe-ColdFusion-Advanced-Workshop Tuesday, June 7, 2022Adobe ColdFusion WorkshopCPE credit availableHosted By: Adobe & Carahsofthttps://www.carahsoft.com/learn/event/37401-adobe-coldfusion-workshopCFCasts Content Updateshttps://www.cfcasts.comJust Released LogBox 101 https://cfcasts.com/series/logbox-101Installation and Getting Started - https://cfcasts.com/series/logbox-101/videos/installation-and-getting-started Publish your First ForgeBox Package - https://cfcasts.com/series/publish-your-first-forgebox-package ForgeBox Admin - Dashboard - https://cfcasts.com/series/publish-your-first-forgebox-package/videos/forgebox-admin---dashboard  2022 ForgeBox Module of the Week Series - 3 new Videoshttps://cfcasts.com/series/2022-forgebox-modules-of-the-week 2022 VS Code Hint tip and Trick of the Week Series - 3 new Videoshttps://cfcasts.com/series/2022-vs-code-hint-tip-and-trick-of-the-week  Coming Soon Last couple of videos for Gavin Pickin - Publish Your First ForgeBox Package LogBox 101 from Eric Peterson Box-ifying a 3rd Party Library from Gavin More ForgeBox and VS Code Podcast snippet videos Conferences and TrainingTHIS WEEK - US VueJS ConfFORT LAUDERDALE, FL • JUNE 8-10, 2022Beach. Code. Vue.Workshop day: June 8Main Conference: June 9-10https://us.vuejs.org/Speakers and Schedule Announced https://us.vuejs.org/schedule/ THIS WEEK - Apple WWDCJune 6 to 10https://developer.apple.com/wwdc22/Quasar ConfPlease let us know about you and what you'd like to speak about in all things Quasar or Vue!!!Conference Date: Saturday, July 9th, 2022 - 3 p.m. GMTDeadline for Proposals: June 9th, 2022Call for Proposals - https://docs.google.com/forms/d/e/1FAIpQLSecQfTFUM1BINAvpPl-Khbk7UYpLk2srIR0pLgMcVjpJwWMCA/viewform THAT ConferenceHowdy. We're a full-stack, tech-obsessed community of fun, code-loving humans who share and learn together.We geek-out in Texas and Wisconsin once a year but we host digital events all the time.WISCONSIN DELLS, WI / JULY 25TH - 28TH, 2022A four-day summer camp for developers passionate about learning all things mobile, web, cloud, and technology.https://that.us/events/wi/2022/ Our very own Daniel Garcia is speaking there https://that.us/activities/sb6dRP8ZNIBIKngxswIt Adobe Developer Week 2022July 18-22, 2022Online - Virtual - FreeThe Adobe ColdFusion Developer Week is back - bigger and better than ever! This year, our experts are gearing up to host a series of webinars on all things ColdFusion. This is your chance to learn with them, get your questions answered, and build cloud-native applications with ease.Note: Speakers listed are 2021 speakers currently - check back for updates - I heard speakers were being contacted, and info coming very soon!!! Wink wink nudge nudgehttps://adobe-coldfusion-devweek-2022.attendease.com/registration/form VueJS Forge After many requests - New Dates - July 13th-14thDue to many of you taking advantage of early summer vacations, we have decided to postpone the event to a date that will make sure as many of you as possible won't miss out on the opportunity to attend Vue.js Forge!Organized by Vue School_The largest hands-on Vue.js EventTeam up with 1000s of fellow Vue.js devs from around the globe to build a real-world application in just 2 days in this FREE hackathon-style event.Make connections. Build together. Learn together.Sign up as an Individual or signup as a companyCompany Deal - $2000 for a team of 5, includes VueSchool annual membership and guaranteed seat at the workshops at VueJS Forge as well… and you can pick your teamSneak Peek into the Project: If you've ever wanted to build your own SaaS app, then “the project” is definitely right up your alley! Work with Vue.js, VueUse, Vue Router, and Pinia on the front-end along with a dynamic back-end to create the main application. Also create a marketing site that's easily maintained by a non-technical marketing team, then deploy everything live to the world.https://vuejsforge.com/Into The Box 2022September 6, 7 and 8, 2022One day workshops before the two day conference!Super Early bird pricing ended May 31st, 2022 - Get the early bird price nowConference Website:https://intothebox.orgITB Blog has new updates almost every day!CF Summit - OfficialMirageOct 3rd & 4th - CFSummit ConferenceOct 5th - Adobe Certified Professional: Adobe ColdFusion Certification Classes & Testshttps://cfsummit.adobeevents.com/ Registrations are now open.For just $99!Grab your early-bird tickets before June 30.Call for Speakers is now OpenFrom Slack re Adobe Certified ProfessionalThe Adobe Certified Professional: Adobe ColdFusion cert is a totally different, MUCH more difficult and comprehensive certification than the CF Specialist previously offered. Mark Takata, Nolan and Dave F + the CF engineering team, Elishia and Kishore all spent a week together building the new one and it is HARD. I highly recommend it as a test of your skills, I guarantee everyone will learn something new.Yes, but there's also over 100 hours of video to go over before the 1 day lecture + cert. So you watch videos, sit in class, then take the exam there. It is no joke, definitely challenging, but super satisfying to pass.Plus you get access to those videos for a year, which is nice for going back and reviewing things down the line.Into the Box Latam 2022Dec 7thMore information is coming very soon.CFCampNo CFCAMP 2022, we're trying again for summer 2023TLDR is that it's just too hard and there's too much uncertainty right now.More conferencesNeed more conferences, this site has a huge list of conferences for almost any language/community.https://confs.tech/Blogs, Tweets, and Videos of the Week 6/7/22 - Ben Nadel - Disabling Async Attribute On CFMail For At-Least-Once Delivery In Lucee CFMLWhen I'm sending emails out in a ColdFusion application, not all emails are created equal. Much of the time, if an email is lost here-and-there, it's not the end of the world. For example, a "Forgot My Password" email can always be sent a second time. In critical ColdFusion workflows, however, when losing an email is unacceptable, I track the processing of pending emails in the database; and, I make sure to set the async (Lucee CFML) / spoolEnable (Adobe ColdFusion) attribute on the CFMail tag to false.https://www.bennadel.com/blog/4278-disabling-async-attribute-on-cfmail-for-at-least-once-delivery-in-lucee-cfml.htm 6/7/22 - Peter Amiri - CFWheels - Two New Repositories PublishedWe have published two new repositories named cfwheels/cfwheels-www and cfwheels/cfwheels-api which handle the CFWheels.org landing page site and the api.cfwheels.org API documentation site respectively.https://cfwheels.org/blog/two-new-repositories-published/ 6/6/22 - Peter Amiri - CFWheels - CFWheels DotEnvSettings Plugin publishedA new plugin was published to provide support for .env settings files in a production environment. This plugin is based on Eric Peterson's CommandBox module and allows the use of .env or similarly named files to store your application secrets so they can be kept out of source control.https://cfwheels.org/blog/cfwheels-dotenvsettings-plugin-published/ 6/6/22 - Wil De Bruin - ImageNew bug in LuceeSeveral months ago Eric Peterson published the totp module, a cfml implementation of Time-based One-time Password. I  decided to give the totp module a try. I immediately discovered a bug in the module: the bar codes where not generated correctly. I contacted the author on Slack, and we soon discovered, this was only a problem on Lucee, and apparently it was caused by the ImageNew() function. As I am developing API's most of the time, I never used this function before, and I guess it is not used by many other people.https://shiftinsert.nl/imagenew-bug-in-lucee/ 6/5/22 - Ben Nadel - Adding New Regular Expression Parsing To My JRegEx Project For ColdFusionAs part of the recent Regular Expression Day celebrations, I was working on some fun and exciting ways to parse strings and lists using RegEx patterns in ColdFusion. As a quick follow-up to those joyous outbursts, I've gone and added those new methods to my JRegEx ColdFusion component. In fact, I've added a new JRegExList.cfc component to this project for list-specific parsing - I didn't want to mix the two genres together.https://www.bennadel.com/blog/4277-adding-new-regular-expression-parsing-to-my-jregex-project-for-coldfusion.htm 6/3/22 - Mark Takata - Adobe - CLI Installation of ColdFusion for lower memory useOne of the key feature updates of CF2021 was the addition of modularity to the server. No longer were you limited to just installing the “whole kit and caboodle”, now you could pick and choose your connectors and packages, allowing you a leaner installation. You could, of course, use the GUI installer to get everything in place, then remove the things you didn't need. But the other way to get things in place is to use the Command Line Interface(CLI) to install ColdFusion, and then use the new Package Manager Command Line Interface (PMCLI) to install the packages you need, scan your code to see what packages you need, download packages locally, and much more!https://coldfusion.adobe.com/2022/06/cli-installation-of-coldfusion-for-lower-memory-use/ 6/3/22 - Ortus Solutions - Ortus Content Digest for week of June 3rdWhat has Ortus been publishing this week? We have the Podcast, some CFCasts and YouTube Videos. We have a lot more planned for next week as wellhttps://www.ortussolutions.com/blog/ortus-content-digest-for-week-of-june-3rd?utm_source=contentstudio.io&utm_medium=podcast 6/2/22 - Ortus Solutions - June 2022 Webinar - Getting started with the Legacy Migration with Dan CardWe are happy to announce the Ortus Webinar for June 2022 - Getting started with the Legacy Migration with Dan Cardhttps://www.ortussolutions.com/blog/june-2022-webinar-getting-started-with-the-legacy-migration-with-dan-card?utm_source=contentstudio.io&utm_medium=podcast    6/2/22 - Ben Nadel - Parsing Lists Using A RegEx Delimiter In Lucee CFML 5.3.8.201In honor of yesterday's Regular Expression Day 2022 celebration, I wanted to play around with parsing lists in ColdFusion using a RegEx (Regular Expression) delimiter. Lists are the unsung heroes of the CFML language; and, are usually delimited by a single character (or set of single characters). But, the beauty of a list is that it's just a String; and, you can make a list out of anything using any delimiter. And, sometimes, I'd like that delimiter to be something more flexible, more dynamic. To start exploring this concept, I'm going to create jreListFirst() and jreListRest() functions.https://www.bennadel.com/blog/4275-parsing-lists-using-a-regex-delimiter-in-lucee-cfml-5-3-8-201.htm 6/1/22 - Ben Nadel - The 15th Annual Regular Expression Day - June 1st 2022Happy Regular Expression Day! This is your annual reminder to learn you some Regular Expressions for great good! Pattern matching is a skill that comes with a massive return on investment (ROI). It is no exaggeration that I use ColdFusion and JavaScript Regular Expression (RegEx) functions every single day. Literally! Once you understand how patterns work, you see them everywhere! They are a game changer!https://www.bennadel.com/blog/4274-the-15th-annual-regular-expression-day-june-1st-2022.htm 6/1/22 - Gavin Pickin - Ortus - How to Make Windows Folders Case SensitiveIn the last blog post in this series, we discussed Case Sensitivity on Windows, what is it, why does it matter, and how it could mess up your developer day in ways you never thought of. In this blog post, we're going to show you how to enable case sensitivity in windows, for a given folder, all folders underneath it, and explain how that case sensitivity is inherited, and when it isn't.https://www.ortussolutions.com/blog/how-to-make-windows-folders-case-sensitive?utm_source=contentstudio.io&utm_medium=podcast 6/1/22 - Into the Box - Couchbase - Platinum Sponsor for Into the Box 2022We are excited to announce Couchbase as a Platinum Sponsor at Into the Box 2022.Ortus Solutions has built the Couchbase Extension for Lucee and has been using Couchbase for many years now, to provide lightning fast caching, vital in a clustered environment. Couchbase has continued to grow and expand features and benefits, and we are so happy they are sponsoring Into the Box 2022.https://www.intothebox.org/blog/couchbase-platinum-sponsor-for-into-the-box-2022/?utm_medium=referral&utm_source=podcast Tweet - Charlie Arehart - Good to see - Adobe - Sometimes it's the little things Good to see: Adobe today updated their downloads page with the latest Java versions 11.0.15.1 (vs 11.0.15 added last month) and 8u333 (over 8u331 last month), and also fixed sort order and how filenames are shown. Sometimes it's the little things. #coldfusion #luceehttps://twitter.com/carehart/status/1532021965212499979https://twitter.com/carehart Blog - Adam Tuttle - The Flywheel of TestingOn my continuing quest to get better at testing, I have spent quite a lot of time in the last couple of weeks reading about testing, watching tutorial videos, and practicing testing in my work. It has been a long, slow, difficult, slog. I'm not sure what made me think of it, but I was reminded of a flywheel.https://adamtuttle.codes/blog/2021/the-flywheel-of-testing/ CFML JobsSeveral positions available on https://www.getcfmljobs.com/Listing over 94 ColdFusion positions from 53 companies across 47 locations in 5 Countries.2 new jobs listedFull-Time - ColdFusion Dev at Kovilpatti, Tamil Nadu - India Jun 03https://www.getcfmljobs.com/jobs/index.cfm/india/ColdFusion-Dev-at-Kovilpatti-Tamil-Nadu/11481 Full-Time - Senior Coldfusion Developer WORK |LATAM| at Colon, PA - United States Jun 01https://www.getcfmljobs.com/jobs/index.cfm/united-states/Senior-Coldfusion-Developer-WORK-LATAM-at-Colon-PA/11480 PATREON SPONSORED JOB POSTING!Hagerty - MotorSportRegSenior Software Engineer, MotorsportWe are seeking a Senior Software Engineer to work primarily with Node/Vue.js, ColdFusion, and AWS to improve our platform and build greenfield experiences.We are a 25-person team supporting 1,600 organizations with our SaaS CRM, commerce and event management platform. With 8,000 events managed in our marketplace annually by our customers, our goal is to be the number one software platform for automotive and motorsport events.Ready to get in the driver's seat? Join us!https://bit.ly/3985J3U Other Job Links Ortus Solutionshttps://www.ortussolutions.com/about-us/careers  Clear Capital - Carol from Working Code Podhttps://jobs.jobvite.com/careers/clearcapital/search?j=o7OCjfwA&j=oWVlhfwd&j=oj7Vhfwm&j=oKzjifwE&j=oh43hfwp&j=ol9Jjfwg&j=oEhyjfww&j=oJgCjfwE&j=obZxgfwH&j=o19JjfwW&__jvst=employee&__jvsd=sporQiwR&__jvsc=Url&bid=nTn6s0wj  There is a jobs channel in the cfml slack team, and in the box team slack now too ForgeBox Module of the WeekCFWheels DotEnvSettings PluginThis module reads secrets contained in a .env file (or other file you specify) and loads the values into the CFWheels settings. Based on Eric Peterson's CommandBox Module.https://www.forgebox.io/view/cfwheels-dotenvsettings VS Code Hint Tips and Tricks of the WeekSQL Server Client(mssql)The Database Client makes your life easy. It supports databases MySQL/MariaDB, Microsoft SQL Server, PostgreSQL, SQLite, MongoDB, Redis, and ElasticSearch.https://marketplace.visualstudio.com/items?itemName=cweijan.vscode-myssql-client2 Thank you to all of our Patreon SupportersThese individuals are personally supporting our open source initiatives to ensure the great toolings like CommandBox, ForgeBox, ColdBox,  ContentBox, TestBox and all the other boxes keep getting the continuous development they need, and funds the cloud infrastructure at our community relies on like ForgeBox for our Package Management with CommandBox. You can support us on Patreon here https://www.patreon.com/ortussolutionsDon't forget, we have Annual Memberships, pay for the year and save 10% - great for businesses. Bronze Packages and up, now get a ForgeBox Pro and CFCasts subscriptions as a perk for their Patreon Subscription. All Patreon supporters have a Profile badge on the Community Website All Patreon supporters have their own Private Forum access on the Community Website https://community.ortussolutions.com/ PatreonsNEW PATREON - JORDAN CLARK John Wilson - Synaptrix Brian Ghidinelli - Hagerty MotorsportReg   Eric Hoffman Gary Knight Mario Rodrigues Giancarlo Gomez David Belanger Dan Card Jonathan Perret Jeffry McGee - Sunstar Media Dean Maunder Wil De Bruin Joseph Lamoree Don Bellamy Jan Jannek Laksma Tirtohadi Carl Von Stetten Jeremy Adams Didier Lesnicki Matthew Clemente Daniel Garcia Scott Steinbeck - Agri Tracking Systems Ben Nadel  Brett DeLine Kai Koenig Charlie Arehart Jonas Eriksson Jason Daiger Shawn Oden Matthew Darby Ross Phillips Edgardo Cabezas Patrick Flynn Stephany Monge John Whish Kevin Wright Peter Amiri You can see an up to date list of all sponsors on Ortus Solutions' Websitehttps://ortussolutions.com/about-us/sponsors ★ Support this podcast on Patreon ★

Virtually Speaking Podcast
Automated Deployment of Microsoft SQL Server on Linux

Virtually Speaking Podcast

Play Episode Listen Later Mar 4, 2022 37:37


This week on the Virtually Speaking Podcast we welcome Deji Akomolafe and Charles Lee to discuss a new way of automating the deployment of Clustered MS SQL Server on Linux.  Read more 

CPE Today
Turbo Charging Your Organizational Reporting with myDBR - Part 1

CPE Today

Play Episode Listen Later Feb 25, 2022 62:00


Reporting is often the last part of accounting or business projects. Unfortunately, most businesses overlook the complexity of their reporting needs and underestimate their requirements. This causes an issue when it comes time to pull a sales report or calculate taxes. Accountants are often stringing together multiple spreadsheets to back into the information they need. This results in frustration from manual procedures, clerical errors in preparation, and poor efficiency in the office. myDBR can resolve all these problems and provide outstanding reporting right out of the box!  myDBR turns data from MySQL, MariaDB, Microsoft SQL Server, and Sybase databases into usable actionable information. This tool can be used for personal reporting or scaled up to enterprise business intelligence systems. Reports can be accessed from applications, portals, and mobile devices. myDBR integrates easily with any environment and allows for monitoring of users and data. Data can even be directly edited from within myDBR reports. This application is packed with easy-to-use functionality. From accounting reporting to customer support tickets and more, this tool can do it all! Please join us on how you can eliminate all your organizational reporting headaches!  Lastly, don't forget to check out part two of this course where we talk with the folks behind myDBR. We will learn about their favorite features, functions, and capabilities. We will also get knowledge on where the application will be going in future releases. Don't miss this one!  Are you a CPA?? Are you a Financial Professional?? Earn CPE Credits for Today's Podcast. Check out https://cpe.cx/dbr1/. Take a quick 5 question quiz and get your certificate today. Super Easy!  Presented by Stephen M. Yoss, CPA, MS (https://yoss.io) Produced by Alicia Yoss & Alanna Regalbuto Graphics By Flaticon.com and iStock Music by Bensound.com Education and Compliance By K2 Enterprises (https://k2e.com) Copyright. All product names, logos, and brands are the property of their respective owners. All company, product, and service names used on this website are for identification purposes only. The use of these names, logos, and brands does not imply endorsement. Educational Use Only. The information presented in this presentation is for educational use only. The presenter will make specific recommendations, but the participant is highly recommended to do their own due diligence before making any investment decision.

Melbourne AWS User Group
What's new in October 2021

Melbourne AWS User Group

Play Episode Listen Later Jan 17, 2022 69:58


A lot of things happened in October, and we talked about them all in early November. In this episode Arjen, Guy, and JM discuss a whole bunch of cool things that were released and may be a bit harsh on everything Microsoft. News Finally in Sydney Amazon EC2 Mac instances are now available in seven additional AWS Regions Amazon MemoryDB for Redis is now available in 11 additional AWS Regions Serverless Lambda AWS Lambda now supports triggering Lambda functions from an Amazon SQS queue in a different account AWS Lambda now supports IAM authentication for Amazon MSK as an event source Step Functions Now — AWS Step Functions Supports 200 AWS Services To Enable Easier Workflow Automation | AWS News Blog AWS Batch adds console support for visualizing AWS Step Functions workflows Amplify Announcing General Availability of Amplify Geo for AWS Amplify AWS Amplify for JavaScript now supports resumable file uploads for Storage Other Accelerating serverless development with AWS SAM Accelerate | AWS Compute Blog Containers Amazon EKS Managed Node Groups adds native support for Bottlerocket AWS Fargate now supports Amazon ECS Windows containers Announcing the general availability of cdk8s and support for Go | Containers Monitoring clock accuracy on AWS Fargate with Amazon ECS Amazon ECS Anywhere now supports GPU-based workloads AWS Console Mobile Application adds support for Amazon Elastic Container Service AWS Load Balancer Controller version 2.3 now available with support for ALB IPv6 targets AWS App Mesh Metric Extension is now generally available EC2 & VPC New – Amazon EC2 C6i Instances Powered by the Latest Generation Intel Xeon Scalable Processors | AWS News Blog Amazon EC2 now supports sharing Amazon Machine Images across AWS Organizations and Organizational Units Amazon EC2 Hibernation adds support for Ubuntu 20.04 LTS Announcing Amazon EC2 Capacity Reservation Fleet a way to easily migrate Amazon EC2 Capacity Reservations across instance types Amazon EC2 Auto Scaling now supports describing Auto Scaling groups using tags Amazon EC2 now offers Microsoft SQL Server on Microsoft Windows Server 2022 AMIs AWS Elastic Beanstalk supports Database Decoupling in an Elastic Beanstalk Environment AWS FPGA developer kit now supports Jumbo frames in virtual ethernet frameworks for Amazon EC2 F1 instances Amazon VPC Flow Logs now supports Apache Parquet, Hive-compatible prefixes and Hourly partitioned files Network Load Balancer now supports TLS 1.3 New – Attribute-Based Instance Type Selection for EC2 Auto Scaling and EC2 Fleet | AWS News Blog Amazon Lightsail now supports AWS CloudFormation for instances, disks and databases Dev & Ops CLI AWS Cloud Control API, a Uniform API to Access AWS & Third-Party Services | AWS News Blog Now programmatically manage alternate contacts on AWS accounts CodeGuru Amazon CodeGuru now includes recommendations powered by Infer Amazon CodeGuru announces Security detectors for Python applications and security analysis powered by Bandit Amazon CodeGuru Reviewer adds detectors for AWS Java SDK v2's best practices and features IaC AWS CDK releases v1.121.0 - v1.125.0 with features for faster development cycles using hotswap deployments and rollback control AWS CloudFormation customers can now manage their applications in AWS Systems Manager Other NoSQL Workbench for Amazon DynamoDB now enables you to import and automatically populate sample data to help build and visualize your data models Amazon Corretto October Quarterly Updates Bulk Editing of OpsItems in AWS Systems Manager OpsCenter AWS Fault Injection Simulator now supports Spot Interruptions AWS Fault Injection Simulator now injects Spot Instance Interruptions Security Firewalls AWS Firewall Manager now supports centralized logging of AWS Network Firewall logs AWS Network Firewall Adds New Configuration Options for Rule Ordering and Default Drop Backups AWS Backup Audit Manager adds compliance reports AWS Backup adds an additional layer for backup protection with the availability of AWS Backup Vault Lock Other AWS Security Hub adds support for cross-Region aggregation of findings to simplify how you evaluate and improve your AWS security posture Amazon SES now supports 2048-bit DKIM keys AWS License Manager now supports Delegated Administrator for Managed entitlements Data Storage & Processing Goodbye Microsoft SQL Server, Hello Babelfish | AWS News Blog Announcing availability of the Babelfish for PostgreSQL open source project Announcing Amazon RDS Custom for Oracle AWS announces AWS Snowcone SSD Amazon RDS Proxy now supports Amazon RDS for MySQL Version 8.0 Amazon OpenSearch Service (successor to Amazon Elasticsearch Service) announces support for Cross-Cluster Replication Amazon OpenSearch Service (successor to Amazon Elasticsearch Service) now comes with an improved management console AWS Transfer Family customers can now use Amazon S3 Access Point aliases for granular and simplified data access controls Amazon EMR now supports Apache Spark SQL to insert data into and update Apache Hive metadata tables when Apache Ranger integration is enabled Amazon Neptune now supports Auto Scaling for Read Replicas AWS Glue Crawlers support Amazon S3 event notifications Amazon Keyspaces (for Apache Cassandra) now supports automatic data expiration by using Time to Live (TTL) settings New – AWS Data Exchange for Amazon Redshift | AWS News Blog AI & ML SageMaker Announcing Fast File Mode for Amazon SageMaker Amazon SageMaker Projects now supports Image Building CI/CD templates Amazon SageMaker Data Wrangler now supports Amazon Athena Workgroups, feature correlation, and customer managed keys Other Amazon Kendra launches support for 34 additional languages Amazon Fraud Detector now supports event datasets AWS announces a price reduction of up to 56% for Amazon Fraud Detector machine learning fraud predictions Amazon Fraud Detector launches new ML model for online transaction fraud detection Amazon Transcribe now supports custom language models for streaming transcription Amazon Textract launches TIFF support and adds asynchronous support for receipts and invoices processing Announcing Amazon EC2 DL1 instances for cost efficient training of deep learning models Other Cool Stuff AWS IoT Core now makes it optional for customers to send the entire trust chain when provisioning devices using Just-in-Time Provisioning and Just-in-Time Registration AWS IoT SiteWise announces support for using the same asset models across different hierarchies VMware Cloud on AWS Outposts Brings VMware SDDC as a Fully Managed Service on Premises | AWS News Blog AWS Outposts adds new CloudWatch dimension for capacity monitoring Amazon Monitron launches iOS app Amazon Braket offers D-Wave's Advantage 4.1 system for quantum annealing Amazon QuickSight adds support for Pixel-Perfect dashboards Amazon WorkMail adds Mobile Device Access Override API and MDM integration capabilities Announcing Amazon WorkSpaces API to create new updated images with latest AWS drivers Computer Vision at the Edge with AWS Panorama | AWS News Blog Amazon Connect launches API to configure hours of operation programmatically New region availability and Graviton2 support now available for Amazon GameLift Sponsors CMD Solutions Silver Sponsors Cevo Versent

The Cloud Pod
147: Goodbye 2021, A log4j kinda year

The Cloud Pod

Play Episode Listen Later Dec 31, 2021 77:19


EDITORIAL NOTE: Your Cloud Pod hosts are on vacation until early January!! Enjoy our 2021 wrapup and look ahead to 2022 and we'll be back in your Podcast feed mid January!  Justin, Jonathan, and Ryan are minus Peter in this episode as they review the year in cloud computing. A big thanks to this week's sponsors: Foghorn Consulting, which provides full-stack cloud solutions with a focus on strategy, planning, and execution for enterprises seeking to take advantage of the transformative capabilities of AWS, Google Cloud, and Azure. This week's highlights

Screaming in the Cloud
Building Distributed Cognition into Your Business with Sam Ramji

Screaming in the Cloud

Play Episode Listen Later Dec 9, 2021 39:56


About SamA 25-year veteran of the Silicon Valley and Seattle technology scenes, Sam Ramji led Kubernetes and DevOps product management for Google Cloud, founded the Cloud Foundry foundation, has helped build two multi-billion dollar markets (API Management at Apigee and Enterprise Service Bus at BEA Systems) and redefined Microsoft's open source and Linux strategy from “extinguish” to “embrace”.He is nerdy about open source, platform economics, middleware, and cloud computing with emphasis on developer experience and enterprise software. He is an advisor to multiple companies including Dell Technologies, Accenture, Observable, Fletch, Orbit, OSS Capital, and the Linux Foundation.Sam received his B.S. in Cognitive Science from UC San Diego, the home of transdisciplinary innovation, in 1994 and is still excited about artificial intelligence, neuroscience, and cognitive psychology.Links: DataStax: https://www.datastax.com Sam Ramji Twitter: https://twitter.com/sramji Open||Source||Data: https://www.datastax.com/resources/podcast/open-source-data Screaming in the Cloud Episode 243 with Craig McLuckie: https://www.lastweekinaws.com/podcast/screaming-in-the-cloud/innovating-in-the-cloud-with-craig-mcluckie/ Screaming in the Cloud Episode 261 with Jason Warner: https://www.lastweekinaws.com/podcast/screaming-in-the-cloud/what-github-can-give-to-microsoft-with-jason-warner/ TranscriptAnnouncer: Hello, and welcome to Screaming in the Cloud with your host, Chief Cloud Economist at The Duckbill Group, Corey Quinn. This weekly show features conversations with people doing interesting work in the world of cloud, thoughtful commentary on the state of the technical world, and ridiculous titles for which Corey refuses to apologize. This is Screaming in the Cloud.Corey: This episode is sponsored in part by our friends at Redis, the company behind the incredibly popular open source database that is not the bind DNS server. If you're tired of managing open source Redis on your own, or you're using one of the vanilla cloud caching services, these folks have you covered with the go to manage Redis service for global caching and primary database capabilities; Redis Enterprise. Set up a meeting with a Redis expert during re:Invent, and you'll not only learn how you can become a Redis hero, but also have a chance to win some fun and exciting prizes. To learn more and deploy not only a cache but a single operational data platform for one Redis experience, visit redis.com/hero. Thats r-e-d-i-s.com/hero. And my thanks to my friends at Redis for sponsoring my ridiculous non-sense.  Corey: Are you building cloud applications with a distributed team? Check out Teleport, an open source identity-aware access proxy for cloud resources. Teleport provides secure access to anything running somewhere behind NAT: SSH servers, Kubernetes clusters, internal web apps and databases. Teleport gives engineers superpowers! Get access to everything via single sign-on with multi-factor. List and see all SSH servers, kubernetes clusters or databases available to you. Get instant access to them all using tools you already have. Teleport ensures best security practices like role-based access, preventing data exfiltration, providing visibility and ensuring compliance. And best of all, Teleport is open source and a pleasure to use.Download Teleport at https://goteleport.com. That's goteleport.com.Corey: Welcome to Screaming in the Cloud, I'm Cloud Economist Corey Quinn, and recurring effort that this show goes to is to showcase people in their best light. Today's guest has done an awful lot: he led Kubernetes and DevOps Product Management for Google Cloud; he founded the Cloud Foundry Foundation; he set open-source strategy for Microsoft in the naughts; he advises companies including Dell, Accenture, the Linux Foundation; and tying all of that together, it's hard to present a lot of that in a great light because given my own proclivities, that sounds an awful lot like a personal attack. Sam Ramji is the Chief Strategy Officer at DataStax. Sam, thank you for joining me, and it's weird when your resume starts to read like, “Oh, I hate all of these things.”Sam: [laugh]. It's weird, but it's true. And it's the only life I could have lived apparently because here I am. Corey, it's a thrill to meet you. I've been an admirer of your public speaking, and public tweeting, and your writing for a long time.Corey: Well, thank you. The hard part is getting over the voice saying don't do it because it turns out that there's no real other side of public shutting up, which is something that I was never good at anyway, so I figured I'd lean into it. And again, I mean, that the sense of where you have been historically in terms of your career not, “Look what you've done,” which is a subtext that I could be accused of throwing in sometimes.Sam: I used to hear that a lot from my parents, actually.Corey: Oh, yeah. That was my name growing up. But you've done a lot of things, and you've transitioned from notable company making significant impact on the industry, to the next one, to the next one. And you've been in high-flying roles, doing lots of really interesting stuff. What's the common thread between all those things?Sam: I'm an intensely curious person, and the thing that I'm most curious about is distributed cognition. And that might not be obvious from what you see is kind of the… Lego blocks of my career, but I studied cognitive science in college when that was not really something that was super well known. So, I graduated from UC San Diego in '94 doing neuroscience, artificial intelligence, and psychology. And because I just couldn't stop thinking about thinking; I was just fascinated with how it worked.So, then I wanted to build software systems that would help people learn. And then I wanted to build distributed software systems. And then I wanted to learn how to work with people who were thinking about building the distributed software systems. So, you end up kind of going up this curve of, like, complexity about how do we think? How do we think alone? How do we learn to think? How do we think together?And that's the directed path through my software engineering career, into management, into middleware at BEA, into open-source at Microsoft because that's an amazing demonstration of distributed cognition, how, you know, at the time in 2007, I think, Sourceforge had 100,000 open-source projects, which was, like, mind boggling. Some of them even worked together, but all of them represented these groups of people, flung around the world, collaborating on something that was just fundamentally useful, that they were curious about. Kind of did the same thing into APIs because APIs are an even better way to reuse for some cases than having the source code—at Apigee. And kept growing up through that into, how are we building larger-scale thinking systems like Cloud Foundry, which took me into Google and Kubernetes, and then some applications of that in Autodesk and now DataStax. So, I love building companies. I love helping people build companies because I think business is distributed cognition. So, those businesses that build distributed systems, for me, are the most fascinating.Corey: You were basically handed a heck of a challenge as far as, “Well, help set open-source strategy,” back at Microsoft, in the days where that was a punchline. And credit where due, I have to look at Microsoft of today, and it's not a joke, you can have your arguments about them, but again in those days, a lot of us built our entire personality on hating Microsoft. Some folks never quite evolved beyond that, but it's a new ballgame and it's very clear that the Microsoft of yesteryear and the Microsoft of today are not completely congruent. What was it like at that point understanding that as you're working with open-source communities, you're doing that from a place of employment with a company that was widely reviled in the space.Sam: It was not lost on me. The irony, of course, was that—Corey: Well, thank God because otherwise the question where you would have been, “What do you mean they didn't like us?”Sam: [laugh].Corey: Which, on some levels, like, yeah, that's about the level of awareness I would have expected in that era, but contrary to popular opinion, execs at these companies are not generally oblivious.Sam: Yeah, well, if I'd been clever as a creative humorist, I would have given you that answer instead of my serious answer, but for some reason, my role in life is always to be the straight guy. I used to have Slashdot as my homepage, right? I love when I'd see some conspiracy theory about, you know, Bill Gates dressed up as the Borg, taking over the world. My first startup, actually in '97, was crushed by Microsoft. They copied our product, copied the marketing, and bundled it into Office, so I had lots of reasons to dislike Microsoft.But in 2004, I was recruited into their venture capital team, which I couldn't believe. It was really a place that they were like, “Hey, we could do better at helping startups succeed, so we're going to evangelize their success—if they're building with Microsoft technologies—to VCs, to enterprises, we'll help you get your first big enterprise deal.” I was like, “Man, if I had this a few years ago, I might not be working.” So, let's go try to pay it forward.I ended up in open-source by accident. I started going to these conferences on Software as a Service. This is back in 2005 when people were just starting to light up, like, Silicon Valley Forum with, you know, the CEO of Demandware would talk, right? We'd hear all these different ways of building a new business, and they all kept talking about their tech stack was Linux, Apache, MySQL, and PHP. I went to one eight-hour conference, and Microsoft technologies were mentioned for about 12 seconds in two separate chunks. So, six seconds, he was like, “Oh, and also we really like Microsoft SQL Server for our data layer.”Corey: Oh, Microsoft SQL Server was fantastic. And I know that's a weird thing for people to hear me say, just because I've been renowned recently for using Route 53 as the primary data store for everything that I can. But there was nothing quite like that as far as having multiple write nodes, being able to handle sharding effectively. It was expensive, and you would take a bath on the price come audit time, but people were not rolling it out unaware of those things. This was a trade off that they were making.Oracle has a similar story with databases. It's yeah, people love to talk smack about Oracle and its business practices for a variety of excellent reasons, at least in the database space that hasn't quite made it to cloud yet—knock on wood—but people weren't deploying it because they thought Oracle was warm and cuddly as a vendor; they did it because they can tolerate the rest of it because their stuff works.Sam: That's so well said, and people don't give them the credit that's due. Like, when they built hypergrowth in their business, like… they had a great product; it really worked. They made it expensive, and they made a lot of money on it, and I think that was why you saw MySQL so successful and why, if you were looking for a spec that worked, that you could talk through through an open driver like ODBC or JDBC or whatever, you could swap to Microsoft SQL Server. But I walked out of that and came back to the VC team and said, “Microsoft has a huge problem. This is a massive market wave that's coming. We're not doing anything in it. They use a little bit of SQL Server, but there's nothing else in your tech stack that they want, or like, or can afford because they don't know if their businesses are going to succeed or not. And they're going to go out of business trying to figure out how much licensing costs they would pay to you in order to consider using your software. They can't even start there. They have to start with open-source. So, if you're going to deal with SaaS, you're going to have to have open-source, and get it right.”So, I worked with some folks in the industry, wrote a ten-page paper, sent it up to Bill Gates for Think Week. Didn't hear much back. Bought a new strategy to the head of developer platform evangelism, Sanjay Parthasarathy who suggested that the idea of discounting software to zero for startups, with the hope that they would end up doing really well with it in the future as a Software as a Service company; it was dead on arrival. Dumb idea; bring it back; that actually became BizSpark, the most popular program in Microsoft partner history.And then about three months later, I got a call from this guy, Bill Hilf. And he said, “Hey, this is Bill Hilf. I do open-source at Microsoft. I work with Bill Gates. He sent me your paper. I really like it. Would you consider coming up and having conversation with me because I want you to think about running open-source technology strategy for the company.” And at this time I'm, like, 33 or 34. And I'm like, “Who me? You've got to be joking.” And he goes, “Oh, and also, you'll be responsible for doing quarterly deep technical briefings with Bill… Gates.” I was like, “You must be kidding.” And so of course I had to check it out. One thing led to another and all of a sudden, with not a lot of history in the open-source community but coming in it with a strategist's eye and with a technologist's eye, saying, “This is a problem we got to solve. How do we get after this pragmatically?” And the rest is history, as they say.Corey: I have to say that you are the Chief Strategy Officer at DataStax, and I pull up your website quickly here and a lot of what I tell earlier stage companies is effectively more or less what you have already done. You haven't named yourself after the open-source project that underlies the bones of what you have built so you're not going to wind up in the same glorious challenges that, for example, Elastic or MongoDB have in some ways. You have a pricing page that speaks both to the reality of, “It's two in the morning. I'm trying to get something up and running and I want you the hell out of my way. Just give me something that I can work with a reasonable free tier and don't make me talk to a salesperson.” But also, your enterprise tier is, “Click here to talk to a human being,” which is speaking enterprise slash procurement slash, oh, there will be contract negotiation on these things.It's being able to serve different ends of your market depending upon who it is that encounters you without being off-putting to any of those. And it's deceptively challenging for companies to pull off or get right. So clearly, you've learned lessons by doing this. That was the big problem with Microsoft for the longest time. It's, if I want to use some Microsoft stuff, once you were able to download things from the internet, it changed slightly, but even then it was one of those, “What exactly am I committing to here as far as signing up for this? And am I giving them audit rights into my environment? Is the BSA about to come out of nowhere and hit me with a surprise audit and find out that various folks throughout the company have installed this somewhere and now I owe more than the company's worth?” That was always the haunting fear that companies had back then.These days, I like the approach that companies are taking with the SaaS offering: you pay for usage. On some level, I'd prefer it slightly differently in a pay-per-seat model because at least then you can predict the pricing, but no one is getting surprise submarined with this type of thing on an audit basis, and then they owe damages and payment in arrears and someone has them over a barrel. It's just, “Oh. The bill this month was higher than we expected.” I like that model I think the industry does, too.Sam: I think that's super well said. As I used to joke at BEA Systems, nothing says ‘I love you' to a customer like an audit, right? That's kind of a one-time use strategy. If you're going to go audit licenses to get your revenue in place, you might be inducing some churn there. It's a huge fix for the structural problem in pricing that I think package software had, right?When we looked at Microsoft software versus open-source software, and particularly Windows versus Linux, you would have a structure where sales reps were really compensated to sell as much as possible upfront so they could get the best possible commission on what might be used perpetually. But then if you think about it, like, the boxes in a curve, right, if you do that calculus approximation of a smooth curve, a perpetual software license is a huge box and there's an enormous amount of waste in there. And customers figured out so as soon as you can go to a pay-per-use or pay-as-you-go, you start to smooth that curve, and now what you get is what you deserve, right, as opposed to getting filled with way more cost than you expect. So, I think this model is really super well understood now. Kind of the long run the high point of open-source meets, cloud, meets Software as a Service, you look at what companies like MongoDB, and Confluent, and Elastic, and Databricks are doing. And they've really established a very good path through the jungle of how to succeed as a software company. So, it's still difficult to implement, but there are really world-class guides right now.Corey: Moving beyond where Microsoft was back in the naughts, you were then hired as a VP over at Google. And in that era, the fact that you were hired as a VP at Google is fascinating. They preferred to grow those internally, generally from engineering. So, first question, when you were being hired as a VP in the product org, did they make you solve algorithms on a whiteboard to get there?Sam: [laugh]. They did not. I did have somewhat of an advantage [because they 00:13:36] could see me working pretty closely as the CEO of the Cloud Foundry Foundation. I'd worked closely with Craig McLuckie who notably brought Kubernetes to the world along with Joe Beda, and with Eric Brewer, and a number of others.And he was my champion at Google. He was like, “Look, you know, we need him doing Kubernetes. Let's bring Sam in to do that.” So, that was helpful. I also wrote a [laugh] 2000-word strategy document, just to get some thoughts out of my head. And I said, “Hey, if you like this, great. If you don't throw it away.” So, the interviews were actually very much not solving problems in a whiteboard. There were super collaborative, really excellent conversations. It was slow—Corey: Let's be clear, Craig McLuckie's most notable achievement was being a guest on this podcast back in Episode 243. But I'll say that this is a close second.Sam: [laugh]. You're not wrong. And of course now with Heptio and their acquisition by VMware.Corey: Ehh, they're making money beyond the wildest dreams of avarice, that's all well and good, but an invite to this podcast, that's where it's at.Sam: Well, he should really come on again, he can double down and beat everybody. That can be his landmark achievement, a two-timer on Screaming in [the] Cloud.Corey: You were at Google; you were at Microsoft. These are the big titans of their era, in some respect—not to imply that there has beens; they're bigger than ever—but it's also a more crowded field in some ways. I guess completing the trifecta would be Amazon, but you've had the good judgment never to work there, directly of course. Now they're clearly in your market. You're at DataStax, which is among other things, built on Apache Cassandra, and they launched their own Cassandra service named Keyspaces because no one really knows why or how they name things.And of course, looking under the hood at the pricing model, it's pretty clear that it really is just DynamoDB wearing some Groucho Marx classes with a slight upcharge for API level compatibility. Great. So, I don't see it a lot in the real world and that's fine, but I'm curious as to your take on looking at all three of those companies at different eras. There was always the threat in the open-source world that they are going to come in and crush you. You said earlier that Microsoft crushed your first startup.Google is an interesting competitor in some respects; people don't really have that concern about them. And your job as a Chief Strategy Officer at Amazon is taken over by a Post-it Note that simply says ‘yes' on it because there's nothing they're not going to do, or try, and experiment with. So, from your perspective, if you look at the titans, who is it that you see as the largest competitive threat these days, if that's even a thing?Sam: If you think about Sun Tzu and the Art of War, right—a lot of strategy comes from what we've learned from military environments—fighting a symmetric war, right, using the same weapons and the same army against a symmetric opponent, but having 1/100th of the personnel and 1/100th of the money is not a good plan.Corey: “We're going to lose money, going to be outcompeted; we'll make it up in volume. Oh, by the way, we're also slower than they are.”Sam: [laugh]. So, you know, trying to come after AWS, or Microsoft, or Google as an independent software company, pound-for-pound, face-to-face, right, full-frontal assault is psychotic. What you have to do, I think, at this point is to understand that these are each companies that are much like we thought about Linux, and you know, Macintosh, and Windows as operating systems. They're now the operating systems of the planet. So, that creates some economies of scale, some efficiencies for them. And for us. Look at how cheap object storage is now, right? So, there's never been a better time in human history to create a database company because we can take the storage out of the database and hand it over to Amazon, or Google, or Microsoft to handle it with 13 nines of durability on a constantly falling cost basis.So, that's super interesting. So, you have to prosecute the structure of the world as it is, based on where the giants are and where they'll be in the future. Then you have to turn around and say, like, “What can they never sell?”So, Amazon can never sell something that is standalone, right? They're a parts factory and if you buy into the Amazon-first strategy of cloud computing—which we did at Autodesk when I was VP of cloud platform there—everything is a primitive that works inside Amazon, but they're not going to build things that don't work outside of the Amazon primitives. So, your company has to be built on the idea that there's a set of people who value something that is purpose-built for a particular use case that you can start to broaden out, it's really helpful if they would like it to be something that can help them escape a really valuable asset away from the center of gravity that is a cloud. And that's why data is super interesting. Nobody wakes up in the morning and says, “Boy, I had such a great conversation with Oracle over the last 20 years beating me up on licensing. Let me go find a cloud vendor and dump all of my data in that so they can beat me up for the next 20 years.” Nobody says that.Corey: It's the idea of data portability that drives decision-making, which makes people, of course, feel better about not actually moving in anywhere. But the fact that they're not locked in strategically, in a way that requires a full software re-architecture and data model rewrite is compelling. I'm a big believer in convincing people to make decisions that look a lot like that.Sam: Right. And so that's the key, right? So, when I was at Autodesk, we went from our 100 million dollar, you know, committed spend with 19% discount on the big three services to, like—we started realize when we're going to burn through that, we were spending $60 million or so a year on 20% annual growth as the cloud part of the business grew. Thought, “Okay, let's renegotiate. Let's go and do a $250 million deal. I'm sure they'll give us a much better discount than 19%.” Short story is they came back and said, “You know, we're going to take you from an already generous 19% to an outstanding 22%.” We thought, “Wait a minute, we already talked to Intuit. They're getting a 40% discount on a $400 million spend.”So, you know, math is hard, but, like, 40% minus 22% is 18% times $250 million is a lot of money. So, we thought, “What is going on here?” And we realized we just had no credible threat of leaving, and Intuit did because they had built a cross-cloud capable architecture. And we had not. So, now stepping back into the kind of the world that we're living in 2021, if you're an independent software company, especially if you have the unreasonable advantage of being an open-source software company, you have got to be doing your customers good by giving them cross-cloud capability. It could be simply like the Amdahl coffee cup that Amdahl reps used to put as landmines for the IBM reps, later—I can tell you that story if you want—even if it's only a way to save money for your customer by using your software, when it gets up to tens and hundreds of million dollars, that's a really big deal.But they also know that data is super important, so the option value of being able to move if they have to, that they have to be able to pull that stick, instead of saying, “Nice doggy,” we have to be on their side, right? So, there's almost a detente that we have to create now, as cloud vendors, working in a world that's invented and operated by the giants.Corey: This episode is sponsored by our friends at Oracle HeatWave is a new high-performance accelerator for the Oracle MySQL Database Service. Although I insist on calling it “my squirrel.” While MySQL has long been the worlds most popular open source database, shifting from transacting to analytics required way too much overhead and, ya know, work. With HeatWave you can run your OLTP and OLAP, don't ask me to ever say those acronyms again, workloads directly from your MySQL database and eliminate the time consuming data movement and integration work, while also performing 1100X faster than Amazon Aurora, and 2.5X faster than Amazon Redshift, at a third of the cost. My thanks again to Oracle Cloud for sponsoring this ridiculous nonsense.Corey: When we look across the, I guess, the ecosystem as it's currently unfolding, a recurring challenge that I have to the existing incumbent cloud providers is they're great at offering the bricks that you can use to build things, but if I'm starting a company today, I'm not going to look at building it myself out of, “Ooh, I'm going to take a bunch of EC2 instances, or Lambda functions, or popsicles and string and turn it into this thing.” I'm going to want to tie together things that are way higher level. In my own case, now I wind up paying for Retool, which is, effectively, yeah, it runs on some containers somewhere, presumably, I think in Azure, but don't quote me on that. And that's great. Could I build my own thing like that?Absolutely not. I would rather pay someone to tie it together. Same story. Instead of building my own CRM by running some open-source software on an EC2 instance, I wind up paying for Salesforce or Pipedrive or something in that space. And so on, and so forth.And a lot of these companies that I'm doing business with aren't themselves running on top of AWS. But for web hosting, for example; if I look at the reference architecture for a WordPress site, AWS's diagram looks like a punchline. It is incredibly overcomplicated. And I say this as someone who ran large WordPress installations at Media Temple many years ago. Now, I have the good sense to pay WP Engine. And on a monthly basis, I give them money and they make the website work.Sure, under the hood, it's running on top of GCP or AWS somewhere. But I don't have to think about it; I don't have to build this stuff together and think about the backups and the failover strategy and the rest. The website just works. And that is increasingly the direction that business is going; things commoditize over time. And AWS in particular has done a terrible job, in my experience, of differentiating what it is they're doing in the language that their customers speak.They're great at selling things to existing infrastructure engineers, but folks who are building something from scratch aren't usually in that cohort. It's a longer story with time and, “Well, we're great at being able to sell EC2 instances by the gallon.” Great. Are you capable of going to a small doctor's office somewhere in the American Midwest and offering them an end-to-end solution for managing patient data? Of course not. You can offer them a bunch of things they can tie together to something that will suffice if they all happen to be software engineers, but that's not the opportunity.So instead, other companies are building those solutions on top of AWS, capturing the margin. And if there's one thing guaranteed to keep Amazon execs awake at night, it's the idea of someone who isn't them making money somehow somewhere, so I know that's got to rankle them, but they do not speak that language. At all. Longer-term, I only see that as a more and more significant crutch. A long enough timeframe here, we're talking about them becoming the Centurylinks of the world, the tier one backbone provider that everyone uses, but no one really thinks about because they're not a household name.Sam: That is a really thoughtful perspective. I think the diseconomies of scale that you're pointing to start to creep in, right? Because when you have to sell compute units by the gallon, right, you can't care if it's a gallon of milk, [laugh] or a gallon of oil, or you know, a gallon of poison. You just have to keep moving it through. So, the shift that I think they're going to end up having to make pragmatically, and you start to see some signs of it, like, you know, they hired but could not retain Matt [Acey 00:23:48]. He did an amazing job of bringing them to some pragmatic realization that they need to partner with open-source, but more broadly, when I think about Microsoft in the 2000s as they were starting to learn their open-source lessons, we were also being able to pull on Microsoft's deep competency and partners. So, most people didn't do the math on this. I was part of the field governance council so I understood exactly how the Microsoft business worked to the level that I was capable. When they had $65 billion in revenue, they produced $24 billion in profit through an ecosystem that generated $450 billion in revenue. So, for every dollar Microsoft made, it was $8 to partners. It was a fundamentally platform-shaped business, and that was how they're able to get into doctors offices in the Midwest, and kind of fit the curve that you're describing of all of those longtail opportunities that require so much care and that are complex to prosecute. These solved for their diseconomies of scale by having 1.2 million partner companies. So, will Amazon figure that out and will they hire, right, enough people who've done this before from Microsoft to become world-class in partnering, that's kind of an exercise left to the [laugh] reader, right? Where will that go over time? But I don't see another better mathematical model for dealing with the diseconomies of scale you have when you're one of the very largest providers on the planet.Corey: The hardest problem as I look at this is, at some point, you hit a point of scale where smaller things look a lot less interesting. I get that all the time when people say, “Oh, you fix AWS bills, aren't you missing out by not targeting Google bills and Azure bills as well?” And it's, yeah. I'm not VC-backed. It turns out that if I limit the customer base that I can effectively service to only AWS customers, yeah turns out, I'm not going to starve anytime soon. Who knew? I don't need to conquer the world and that feels increasingly antiquated, at least going by the stories everyone loves to tell.Sam: Yeah, it's interesting to see how cloud makes strange bedfellows, right? We started seeing this in, like, 2014, 2015, weird partnerships that you're like, “There's no way this would happen.” But the cloud economics which go back to utilization, rather than what it used to be, which was software lock-in, just changed who people were willing to hang out with. And now you see companies like Databricks going, you know, we do an amazing amount of business, effectively competing with Amazon, selling Spark services on top of predominantly Amazon infrastructure, and everybody seems happy with it. So, there's some hint of a new sensibility of what the future of partnering will be. We used to call it coopetition a long time ago, which is kind of a terrible word, but at least it shows that there's some nuance in you can't compete with everybody because it's just too hard.Corey: I wish there were better ways of articulating these things because it seems from the all the outside world, you have companies like Amazon and Microsoft and Google who go and build out partner networks because they need that external accessibility into various customer profiles that they can't speak to super well themselves, but they're also coming out with things that wind up competing directly or indirectly, with all of those partners at the same time. And I don't get it. I wish that there were smarter ways to do it.Sam: It is hard to even talk about it, right? One of the things that I think we've learned from philosophy is if we don't have a word for it, we can't be intelligent about it. So, there's a missing semantics here for being able to describe the complexity of where are you partnering? Where are you competing? Where are you differentiating? In an ecosystem, which is moving and changing.I tend to look at the tools of game theory for this, which is to look at things as either, you know, nonzero-sum games or zero-sum games. And if it's a nonzero-sum game, which I think are the most interesting ones, can you make it a positive sum game? And who can you play positive-sum games with? An organization as big as Amazon, or as big as Microsoft, or even as big as Google isn't ever completely coherent with itself. So, thinking about this as an independent software company, it doesn't matter if part of one of these hyperscalers has a part of their business that competes with your entire business because your business probably drives utilization of a completely different resource in their company that you can partner within them against them, effectively. Right?For example, Cassandra is an amazingly powerful but demanding workload on Kubernetes. So, there's a lot of Cassandra on EKS. You grow a lot of workload, and EKS business does super well. Does that prevent us from working with Amazon because they have Dynamo or because they have Keyspaces? Absolutely not, right?So, this is when those companies get so big that they are almost their own forest, right, of complexity, you can kind of get in, hang out, do well, and pretty much never see the competitive product, unless you're explicitly looking for it, which I think is a huge danger for us as independent software companies. And I would say this to anybody doing strategy for an organization like this, which is, don't obsess over the tiny part of their business that competes with yours, and do not pay attention to any of the marketing that they put out that looks competitive with what you have. Because if you can't figure out how to make a better product and sell it better to your customers as a single purpose corporation, you have bigger problems.Corey: I want to change gears slightly to something that's probably a fair bit more insulting, but that's okay. We're going to roll with it. That seems to be the theme of this episode. You have been, in effect, a CIO a number of times at different companies. And if we take a look at the typical CIO tenure, industry-wide, it's not long; it approaches the territory from an executive perspective of, “Be sure not to buy green bananas. You might not be here by the time they ripen.” And I'm wondering what it is that drives that and how you make a mark in a relatively short time frame when you're providing inputs and deciding on strategy, and those decisions may not bear fruit for years.Sam: CIO used to—we used say it stood for ‘Career Is Over' because the tenure is so short. I think there's a couple of reasons why it's so short. And I think there's a way I believe you can have impact in a short amount of time. I think the reason that it's been short is because people aren't sure what they want the CIO role to be.Do they want it to be a glorified finance person who's got a lot of data processing experience, but now really has got, you know, maybe even an MBA in finance, but is not focusing on value creation? Do they want it to be somebody who's all-singing, all-dancing Chief Data Officer with a CTO background who did something amazing and solved a really hard problem? The definition of success is difficult. Often CIOs now also have security under them, which is literally a job I would never ever want to have. Do security for a public corporation? Good Lord, that's a way to lose most of your life. You're the only executive other than the CEO that the board wants to hear from. Every sing—Corey: You don't sleep; you wait, in those scenarios. And oh, yeah, people joke about ablative CSOs in those scenarios. Yeah, after SolarWinds, you try and get an ablative intern instead, but those don't work as well. It's a matter of waiting for an inevitability. One of the things I think is misunderstood about management broadly, is that you are delegating work, but not the responsibility. The responsibility rests with you.So, when companies have these statements blaming some third-party contractor, it's no, no, no. I'm dealing with you. You were the one that gave my data to some sketchy randos. It is your responsibility that data has now been compromised. And people don't want to hear that, but it's true.Sam: I think that's absolutely right. So, you have this high risk, medium reward, very fungible job definition, right? If you ask all of the CIO's peers what their job is, they'll probably all tell you something different that represents their wish list. The thing that I learned at Autodesk, I was only there for 15 months, but we established a fundamental transformation of the work of how cloud platform is done at the company that's still in place a couple years later.You have to realize that you're a change agent, right? You're actually being hired to bring in the bulk of all the different biases and experiences you have to solve a problem that is not working, right? So, when I got to Autodesk, they didn't even know what their uptime was. It took three months to teach the team how to measure the uptime. Turned out the uptime was 97.7% for the cloud, for the world's largest engineering software company.That is 200 hours a year of unplanned downtime, right? That is not good. So, a complete overhaul [laugh] was needed. Understanding that as a change agent, your half-life is 12 to 18 months, you have to measure success not on tenure, but on your ability to take good care of the patient, right? It's going to be a lot of pain, you're going to work super hard, you're going to have to build trust with everyone, and then people are still going to hate you at the end. That is something you just have to kind of take on.As a friend of mine, Jason Warner joined Redpoint Ventures recently, he said this when he was the CTO of GitHub: “No one is a villain in their own story.” So, you realize, going into a big organization, people are going to make you a villain, but you still have to do incredibly thoughtful, careful work, that's going to take care of them for a long time to come. And those are the kinds of CIOs that I can relate to very well.Corey: Jason is great. You're name-dropping all the guests we've had. My God, keep going. It's a hard thing to rationalize and wrap heads around. It's one of those areas where you will not be measured during your tenure in the role, in some respects. And, of course, that leads to the cynical perspective as well, where well, someone's not going to be here long and if they say, “Yeah, we're just going to keep being stewards of the change that's already underway,” well, that doesn't look great, so quick, time to do a cloud migration, or a cloud repatriation, or time to roll something else out. A bit of a different story.Sam: One of the biggest challenges is how do you get the hearts and the minds of the people who are in the organization when they are no fools, and their expectation is like, “Hey, this company's been around for decades, and we go through cloud leaders or CIOs, like Wendy's goes through hamburgers.” They could just cloud-wash, right, or change-wash all their language. They could use the new language to describe the old thing because all they have to do is get through the performance review and outwait you. So, there's always going to be a level of defection because it's hard to change; it's hard to think about new things.So, the most important thing is how do you get into people's hearts and minds and enable them to believe that the best thing they could do for their career is to come along with the change? And I think that was what we ended up getting right in the Autodesk cloud transformation. And that requires endless optimism, and there's no room for cynicism because the cynicism is going to creep in around the edges. So, what I found on the job is, you just have to get up every morning and believe everything is possible and transmit that belief to everybody.So, if it seems naive or ingenuous, I think that doesn't matter as long as you can move people's hearts in each conversation towards, like, “Oh, this person cares about me. They care about a good outcome from me. I should listen a little bit more and maybe make a 1% change in what I'm doing.” Because 1% compounded daily for a year, you can actually get something done in the lifetime of a CIO.Corey: And I think that's probably a great place to leave it. If people want to learn more about what you're up to, how you think about these things, how you view the world, where can they find you?Sam: You can find me on Twitter, I'm @sramji, S-R-A-M-J-I, and I have a podcast that I host called Open||Source||Datawhere I invite innovators, data nerds, computational networking nerds to hang out and explain to me, a software programmer, what is the big world of open-source data all about, what's happening with machine learning, and what would it be like if you could put data in a container, just like you could put code in a container, and how might the world change? So, that's Open||Source||Data podcast.Corey: And we'll of course include links to that in the [show notes 00:35:58]. Thanks so much for your time. I appreciate it.Sam: Corey, it's been a privilege. Thank you so much for having me.Corey: Likewise. Sam Ramji, Chief Strategy Officer at DataStax. I'm Cloud Economist Corey Quinn, and this is Screaming in the Cloud. If you've enjoyed this podcast, please leave a five-star review on your podcast platform of choice, whereas if you've hated this podcast, please leave a five-star review on your podcast platform of choice, along with a comment telling me exactly which item in Sam's background that I made fun of is the place that you work at.Corey: If your AWS bill keeps rising and your blood pressure is doing the same, then you need The Duckbill Group. We help companies fix their AWS bill by making it smaller and less horrifying. The Duckbill Group works for you, not AWS. We tailor recommendations to your business and we get to the point. Visit duckbillgroup.com to get started.Announcer: This has been a HumblePod production. Stay humble.

Streaming Audio: a Confluent podcast about Apache Kafka
Powering Event-Driven Architectures on Microsoft Azure with Confluent

Streaming Audio: a Confluent podcast about Apache Kafka

Play Episode Listen Later Oct 14, 2021 38:42 Transcription Available


When you order a pizza, what if you knew every step of the process from the moment it goes in the oven to being delivered to your doorstep? Event-Driven Architecture is a modern, data-driven approach that describes “events” (i.e., something that just happened). A real-time data infrastructure enables you to provide such event-driven data insights in real time. Israel Ekpo (Principal Cloud Solutions Architect, Microsoft Global Partner Solutions, Microsoft) and Alicia Moniz (Cloud Partner Solutions Architect, Confluent) discuss use cases on leveraging Confluent Cloud and Microsoft Azure to power real-time, event-driven architectures. As an Apache Kafka® community stalwart, Israel focuses on helping customers and independent software vendor (ISV) partners build solutions for the cloud and use open source databases and architecture solutions like Kafka, Kubernetes, Apache Flink, MySQL, and PostgreSQL on Microsoft Azure. He's worked with retailers and those in the IoT space to help them adopt processes for inventory management with Confluent. Having a cloud-native, real-time architecture that can keep an accurate record of supply and demand is important in keeping up with the inventory and customer satisfaction. Israel has also worked with customers that use Confluent to integrate with Cosmos DB, Microsoft SQL Server, Azure Cognitive Search, and other integrations within the Azure ecosystem. Another important use case is enabling real-time data accessibility in the public sector and healthcare while ensuring data security and regulatory compliance like HIPAA. Alicia has a background in AI, and she expresses the importance of moving away from the monolithic, centralized data warehouse to a more flexible and scalable architecture like Kafka. Building a data pipeline leveraging Kafka helps ensure data security and consistency with minimized risk.The Confluent and Azure integration enables quick Kafka deployment with out-of-the-box solutions within the Kafka ecosystem. Confluent Schema Registry captures event streams with a consistent data structure, ksqlDB enables the development of real-time ETL pipelines, and Kafka Connect enables the streaming of data to multiple Azure services.EPISODE LINKSMicrosoft Azure at Kafka Summit AmericasIzzyAcademy Kafka on Azure Learning Series by Alicia MonizWatch the video version of this podcastJoin the Confluent CommunityLearn more with Kafka tutorials, resources, and guides at Confluent DeveloperLive demo: Intro to Event-Driven Microservices with ConfluentUse PODCAST100 to get an additional $100 of free Confluent Cloud usage (details)

Azure DevOps Podcast
Bob Ward on SQL Edge to Cloud - Episode 162

Azure DevOps Podcast

Play Episode Listen Later Oct 11, 2021 39:44


This week, Jeffrey is joined by Bob Ward, a Principal Architect for the Microsoft Azure Data team. Bob has worked for Microsoft for 27+ years on every version of SQL Server shipped from OS/2 1.1 to SQL Server 2019, including Azure SQL. He is a well-known speaker on SQL Server and Azure SQL; often presenting talks on new releases, internals, and specialized topics. Additionally, he has a popular web series online, called “Azure SQL 4 Beginners.”   In this episode, Bob speaks about SQL Edge to Cloud; from the overall vision to recent developments, and what to look forward to in the coming years. He touches on Azure Arc, SQL in the Linux space, the main components of the SQL platform, the latest and greatest for deploying changes, synchronization tools, testing frameworks, and what Azure SQL version he recommends (depending on what you're trying to accomplish as a developer).   Topics of Discussion: [:39] About The Azure DevOps Podcast, Clear Measure; the new video podcast Architect Tips; and Jeffrey's offer to speak at virtual user groups. [1:11] About today's episode with Bob Ward! [2:15] Jeffrey welcomes Bob to the podcast. [2:43] About Bob's upcoming talk at the 2021 DEVintersection Conference. [3:26] What is the overall vision for SQL with Edge to Cloud? [5:40] Bob's insights on the NoSQL movement. [6:56] Bob reflects on SQL entering the Linux space and the doors it opened up. [8:44] The main components of the SQL platform. [10:20] Where Azure Arc fits into the picture. [12:50] How does SQL Server get installed on devices that are not Windows operating systems? [15:00] Are the containers all Linux? Or are some Windows? [17:55] Bob shares about the replication technology that keeps things “in sync” with SQL Server and how syncing technology has evolved over the years. [20:35] A word from The Azure DevOps Podcast's sponsor: Clear Measure. [21:06] Does Raspberry Pi support this new synchronization with Azure SQL? [22:31] Is it part of the SQL Edge vision to be able to replicate a single, small table? [23:36] About Bob's upcoming keynote at the 2021 DEVintersection Conference, “Microsoft SQL Server and Azure SQL Futures.” [25:11] What is the latest and greatest method for deploying changes? [27:28] is there a particular test framework that the SQL team uses? [29:34] All about one of Bob's favorite tools: Ostress and some of the other internal benchmark testing that they use. [32:57] What version of Azure SQL would Bob recommend to developers that are looking to create a brand-new 100% in-the-Cloud application? [33:40] The difference between Azure SQL Database and Azure SQL Managed Instance. [37:00] Bob highlights an important resource that developers should take a look at if they're interested in learning more about Azure SQL completely for free. [38:20] Jeffrey thanks Bob Ward for joining the podcast!   Mentioned in this Episode: Architect Tips — New video podcast! Azure DevOps Clear Measure (Sponsor) .NET DevOps for Azure: A Developer's Guide to DevOps Architecture the Right Way, by Jeffrey Palermo — Available on Amazon! bit.ly/dotnetdevopsebook — Click here to download the .NET DevOps for Azure ebook! Jeffrey Palermo's YouTube Jeffrey Palermo's Twitter — Follow to stay informed about future events! DEVintersection Conference — Dec. 7th‒9th in Las Vegas, Nevada Bob Ward's LinkedIn Azure SQL 4 Beginners TPC Benchmarks Ostress Blazor WebAssembly Azure Arc Linux Kubernetes Raspberry Pi Azure SQL Database Azure SQL Managed Instance Azure SQL Fundamentals   Want to Learn More? Visit AzureDevOps.Show for show notes and additional episodes.

Melbourne AWS User Group
What‘s New in July and August 2021

Melbourne AWS User Group

Play Episode Listen Later Oct 3, 2021 62:20


July and August were very boring months for announcements, so Arjen, JM, and Guy decided to discuss them both in a single episode. They also decided to record before the month actually ended, which doesn't really behoove them as they missed out on a couple of actually interesting announcements. So those will be discussed in our September episode. News Finally in Sydney Amazon ml.Inf1 instances are now available on Amazon SageMaker in 4 additional AWS Regions Amazon RDS Cross-Region Automated Backups Regional Expansion AWS Directory Service now supports smart card authentication with AD Connector for Amazon WorkSpaces in 5 additional AWS Regions Serverless Lambda AWS Lambda adds support for Python 3.9 AWS Lambda now supports Amazon MQ for RabbitMQ as an event source Amplify AWS Amplify launches new full-stack CI/CD capabilities Complete guide to full-stack CI/CD workflows with AWS Amplify | Front-End Web & Mobile AWS Amplify CLI adds support for storing environment variables and secrets accessed by AWS Lambda functions AWS Amplify allows you to mix and match authorization modes in DataStore AWS Amplify now supports Sign in with Apple Announcing Amplify Geo (Developer Preview) for AWS Amplify Other Amazon API Gateway now supports mutual TLS with certificates from third-party CAs and ACM Private CA Simplify CI/CD configuration for serverless applications and your favorite CI/CD system — Public Preview AWS AppSync now supports custom authorization with AWS Lambda for GraphQL APIs Containers Amazon EKS and EKS Distro now support Kubernetes version 1.21 Amazon EKS now supports Kubernetes 1.21 | Containers Amazon EKS managed node groups now supports parallel node upgrades Amazon EKS now supports Multus Amazon ECS supports additional configurations for scheduled and event-driven tasks AWS Cloud Map supports configuring negative caching for DNS queries AWS App Mesh Constructs for AWS CDK are now generally available AWS Private Certificate Authority introduces integration with Kubernetes Amazon VPC CNI plugin increases pods per node limits EC2 & VPC Instances Introducing new Amazon EC2 G4ad instance sizes New – Amazon EC2 M6i Instances Powered by the Latest-Generation Intel Xeon Scalable Processors | AWS News Blog Amazon EC2 customers can now use ED25519 keys for authentication during instance connectivity operations Amazon EC2 Hibernation adds support for C5d, M5d, and R5d Instances Amazon Virtual Private Cloud (VPC) customers can now assign IP prefixes to their EC2 instances Assigning prefixes to Amazon EC2 network interfaces - Amazon Elastic Compute Cloud Amazon EC2 now supports custom time windows for Scheduled Events Auto Scaling Amazon EC2 Auto Scaling enhances Instance Refresh with configuration checks, Launch Template validation, and Amazon EventBridge notifications Amazon EC2 Auto Scaling now lets you control which instances to terminate on scale-in Other Amazon EC2 adds Resource Identifiers and Tags for VPC Security Group Rules Amazon CloudFront announces new APIs to locate and move alternate domain names (CNAMEs) AWS Elastic Beanstalk supports Capacity Rebalancing for Amazon EC2 Spot Instances AWS lowers data processing charges for AWS PrivateLink AWS IoT Core for LoRaWAN now supports VPC endpoints AWS IoT Core now supports VPC Endpoints Dev & Ops Dev Tooling EC2 Image Builder now supports parameters in components for creating custom images AWS Cloud9 introduces new features to browse CloudWatch Logs, S3, and use EC2 instance profiles Introducing AWS App Runner integration in the AWS Toolkit for VS Code Amazon CodeGuru Profiler adds recommendation support for Python applications Amazon CodeGuru Profiler extends visualizations capability with a new compare option for application profile Amazon CodeGuru Profiler announces new automated onboarding process for AWS Lambda functions CodeBuild Supports Publicly Viewable Build Results AWS AppConfig now enables customers to compare two application configuration versions AWS App2Container now supports containerization of complex multi-tier Windows applications CDK/CloudFormation Announcing CDK Pipelines GA, CI/CD for CDK Apps AWS CDK releases v1.111.0 - v1.116.0 with updates for unit testing and CDK Pipelines support AWS CloudFormation now supports more stacks per AWS account You can now import your AWS CloudFormation stacks into a CloudFormation stack set Systems Manager AWS Systems Manager Application Manager now supports full lifecycle management of AWS CloudFormation templates and stacks Now view inventory and patch compliance of stopped instances using AWS Systems Manager AWS Systems Manager Automation now supports upgrade of SQL Server 2012 AWS Systems Manager OpsCenter launches operational insights to identify duplicate items and event sources with unusual activity Now enable auto-approval of change requests and expedite changes with AWS Systems Manager Change Manager AWS Systems Manager Change Manager now supports AWS IAM roles as approvers AWS Systems Manager Fleet Manager now offers report generation for Managed Instances Other AWS Control Tower announces improvements to guardrail naming and descriptions Announcing Amazon CloudWatch cross account alarms Amazon CloudWatch Synthetics supports visual monitoring Amazon CloudWatch Logs now supports Usage Metrics Security AWS Firewall Manager now supports central monitoring of VPC routes for AWS Network Firewall AWS Shield Advanced no longer requires AWS WAF logging for web-application layer event response AWS Certificate Manager provides expanded usage of imported ECDSA and RSA Certificates Amazon QLDB supports customer managed KMS keys AWS Control Tower now provides support for KMS Encryption AWS Security Hub adds 10 new controls to its Foundational Security Best Practices standard for enhanced cloud security posture monitoring AWS License Manager now supports Delegated Administrator AWS WAF now offers managed rule group versioning AWS Security Hub adds 18 new controls to its Foundational Security Best Practices standard and 8 new partners for enhanced cloud security posture monitoring Data Storage & Processing AWS DataSync can now copy system access control lists (SACLs) to Amazon FSx for Windows File Server Amazon Lightsail now offers object storage for storing static content Amazon Data Lifecycle Manager launches new console experience Announcing availability of Red Hat Enterprise Linux with Microsoft SQL Server for Amazon EC2 Amazon Neptune now supports the openCypher query language Amazon RDS Proxy can now be created in a shared Virtual Private Cloud (VPC) Amazon RDS for SQL Server now supports Automatic Minor Version Upgrades Introducing Amazon MemoryDB for Redis – A Redis-Compatible, Durable, In-Memory Database Service | AWS News Blog AWS Transfer Family expands compatibility for FTPS/FTP clients and increases limit for number of servers Amazon ElastiCache for Redis now supports auto scaling EBS AWS Announces General Availability of Amazon EBS io2 Block Express Volumes Amazon Elastic Block Store now supports idempotent volume creation AWS CloudTrail now supports logging of data events for Amazon EBS direct APIs Athena Amazon Athena adds parameterized queries to improve reusability and security Amazon Athena announces data source connector for Power BI S3 AWS Storage Gateway adds support for AWS Privatelink for Amazon S3 and Amazon S3 Access Points Amazon S3 Access Points aliases allow any application that requires an S3 bucket name to easily use an access point Amazon S3 on Outposts supports direct access for applications running outside the Outposts VPC Amazon S3 on Outposts now supports sharing across multiple accounts Amazon EMR now supports Amazon S3 Access Points to simplify access control Redshift Amazon Redshift simplifies the use of JDBC/ODBC with authentication profile Cross-Account Data Sharing for Amazon Redshift | AWS News Blog Redshift spatial performance enhancements and new spatial functions Glue AWS Glue Studio now provides data previews during visual job authoring AWS Glue DataBrew now supports writing prepared data directly into JDBC-supported destinations AWS Glue DataBrew adds the ability to specify which data quality statistics are generated for your datasets AWS Glue DataBrew now supports numerical format transformations AWS Glue DataBrew now supports writing prepared data into AWS Lake Formation-based AWS Glue Data Catalog S3 tables Snow Family AWS Snowball Edge Storage Optimized devices now supports high performance NFS data transfer AWS Snow Family now enables you to remotely monitor and operate your connected Snowcone devices AWS Snowball now supports multicast streams and routing by providing instances with direct access to external networks AWS Snowcone now supports multicast streams and routing by providing instances with direct access to external networks AI & ML Amazon Textract announces improvements to detection of handwritten text, digits, dates, and phone numbers Amazon Textract announces specialized support for automated processing of invoices and receipts Announcing Model Variable Importance for Amazon Fraud Detector AWS customers can now view all the labels supported by Amazon Rekognition Amazon Neptune ML is now generally available with support for edge predictions, automation, and more Amazon EC2 Inf1 instances now supports TensorFlow 2 SageMaker Amazon announces new AWS Deep Learning Containers to deploy Hugging Face models faster on Amazon SageMaker Amazon SageMaker Pipeline introduces a automatic hyperparameter tuning step Amazon SageMaker Autopilot and Automatic Model Tuning now support more refined access control using Condition Key Policies Amazon SageMaker now supports M5d, R5, P3dn, and G4dn instances for SageMaker Notebook Instances Amazon SageMaker Pipelines now supports invoking AWS Lambda Functions Amazon SageMaker notebook instance now supports Amazon Linux 2 Introducing Amazon SageMaker Asynchronous Inference, a new inference option for workloads with large payload sizes and long inference processing times Kendra Announcing Amazon Kendra Smaller Units and Price Drop Amazon Kendra releases Web Crawler to enable web site search Amazon Kendra releases Principal Store for secure search Amazon Kendra releases WorkDocs Connector Other Cool Stuff IoT AWS IoT SiteWise is expanding its transforms and formula expressions capabilities AWS IoT SiteWise Edge now generally available AWS SiteWise now supports custom time intervals for metric aggregations Announcing support for new Timestamp function, PreTrigger function and ability to write nested expressions within aggregation functions (SiteWise) Announcing support for exporting data from AWS IoT SiteWise to Amazon S3 The rest The Amazon Chime SDK adds media capture pipelines to enable capture of meeting video, audio, and content streams Amazon AppStream 2.0 adds support for real-time audio-video using a web browser AWS Now Allows Customers To Pay For Their Usage in Advance AWS Organizations increases quotas for tag policies AWS DeepRacer announces DeepRacer LIVE races Amazon HealthLake is now Generally Available Introducing AWS for Health Introducing Amazon Route 53 Application Recovery Controller | AWS News Blog CloudFormation templates for Amazon Route 53 Application Recovery Controller (ARC) - GitHub Amazon CloudWatch adds support for trimmed mean statistics Amazon WorkSpaces now offers web access with WorkSpaces Streaming Protocol (WSP) Amazon WorkSpaces Renews Windows Desktop Experience with Windows Server 2019 bundles and 64-bit Microsoft Office 2019 Fully customizable action space now available in AWS DeepRacer Console Sponsors CMD Solutions Silver Sponsors Cevo Versent

Screaming in the Cloud
Cranking Up the Heatwave with Nipun Agarwal

Screaming in the Cloud

Play Episode Listen Later Sep 23, 2021 34:45


About NipunNipun Agarwal is Vice President, MySQL HeatWave and Advanced Development, Oracle. His interests include distributed data processing, machine learning, cloud technologies and security. Nipun was part of the Oracle Database team where he introduced a number of new features. He has been awarded over 170 patents.Links:HeatWave: https://oracle.com/heatwave TranscriptAnnouncer: Hello, and welcome to Screaming in the Cloud with your host, Chief Cloud Economist at The Duckbill Group, Corey Quinn. This weekly show features conversations with people doing interesting work in the world of cloud, thoughtful commentary on the state of the technical world, and ridiculous titles for which Corey refuses to apologize. This is Screaming in the Cloud.Corey: You could build you go ahead and build your own coding and mapping notification system, but it takes time, and it sucks! Alternately, consider Courier, who is sponsoring this episode. They make it easy. You can call a single send API for all of your notifications and channels. You can control the complexity around routing, retries, and deliverability and simplify your notification sequences with automation rules. Visit courier.com today and get started for free. If you wind up talking to them, tell them I sent you and watch them wince—because everyone does when you bring up my name. Thats the glorious part of being me. Once again, you could build your own notification system but why on god's flat earth would you do that?Corey: This episode is sponsored in part by our friends at VMware. Let's be honest—the past year has been far from easy. Due to, well, everything. It caused us to rush cloud migrations and digital transformation, which of course means long hours refactoring your apps, surprises on your cloud bill, misconfigurations and headache for everyone trying manage disparate and fractured cloud environments. VMware has an answer for this. With VMware multi-cloud solutions, organizations have the choice, speed, and control to migrate and optimizeapplications seamlessly without recoding, take the fastest path to modern infrastructure, and operate consistently across the data center, the edge, and any cloud. I urge to take a look at vmware.com/go/multicloud. You know my opinions on multi cloud by now, but there's a lot of stuff in here that works on any cloud. But don't take it from me thats: VMware.com/go/multicloud and my thanks to them again for sponsoring my ridiculous nonsense.Corey: Welcome to Screaming in the Cloud. I'm Corey Quinn. Today's promoted episode is slightly off the beaten track. Normally in tech, we tend to find folks that have somewhere between an 18 to 36-month average tenure at companies. And that's great, however, let's do the exact opposite of that today. My guest is Nipun Agarwal, who's the VP of MySQL HeatWave and Advanced Development at Oracle, where you've been an employee for 27 years, is it?Nipun: That's absolutely right. 27 years and that was my first job out of school. So, [laugh] yes.Corey: First, thank you for joining me. It is always great to talk to people who have focused on an area that I only make fun of from a distance, in this case, databases which, you know, DNS works well enough for most use cases, but occasionally customers have other constraints. You are clearly at or damn near at the top of your field. In my pre-show research, I was able to unearth that you have—what is it now, 170, 180 filed patents that have been issued?Nipun: That's right. 180 issued patents. [laugh].Corey: You clearly know what you're doing when it comes to databases.Nipun: Thank you for the opportunity. Yes, thank you.Corey: So, being a VP at Oracle, but starting off as your first job as almost a mailroom to the executive suite style story, we don't see those anymore. In most companies, it very much feels like the path to advance is to change jobs to other companies. It's still interesting seeing that that's not always the path forward, for some folks. I think that the folks who have been in companies for a long time need more examples and role models to look at in that sense, just because it is such an uncommon narrative these days. You're not bouncing around between four companies.Nipun: Yeah. I've been lucky enough to have joined Oracle, and although I had been at Oracle, I've been on multiple teams at Oracle and there has been a great opportunity of talent, colleagues, and projects, where even to this day, I feel that I have a lot more to learn. And there are opportunities within the company to learn and to grow. So no, I've had an awesome ride.Corey: Let's dive in a little bit to something that's been making the rounds recently, specifically you've released something called HeatWave, which has been boasting some, frankly, borderline unbelievable performance benchmarks, and of course, everyone loves to take a crack at Oracle for a variety of reasons, so Twitter is very angry. But I've learned at some point, through the course of my career, to disambiguate Twitter's reactions from what's actually happening out there. So, let's start at the beginning. What is HeatWave?Nipun: HeatWave is an in-memory query accelerator for MySQL. It accelerates complex, long-running, analytic queries. The interesting thing about HeatWave is, with HeatWave we now have a single MySQL database which can run all your applications, whether they're OLTP, whether they're mixed workloads, or whether they're analytics, without having to move the data out of MySQL. Because in the past, people would need to move the data from MySQL to some other database running analytics, so people would end up with two different databases. With this single database, no need for moving the data, and all existing tools and applications which worked with MySQL continue to work, except they will be much faster. That's what HeatWave is.Corey: The benchmarks that you are publishing are fairly interesting to me, specifically, the ones that I've seen are, you've classified HeatWave as six-and-a-half times faster than Amazon Redshift, seven times faster than Snowflake, nine times faster than BigQuery, and a number of other things, and fourteen hundred times faster than Amazon Aurora. And what's interesting to me about the things that you're naming is they're not all data-warehouse style stuff. Aurora, for example, is Amazon's interpretation of an in-house developed managed database service named after a Disney Princess. And it tends to be aimed at things that are not necessarily massive scale. What is the sweet spot, I guess, of HeatWaves data sizes when it comes to really being able to shine?Nipun: So, there are two aspects where our customers are going to benefit from HeatWave. One characteristics is the data size, but the other characteristics is the complexity of the queries. So, let's first do the comparison with Aurora—and that's a very good question—the 1400 times comparison we have shown, yes, if you take the TPC-H queries on a four terabyte workload and if you run them, that's what you're going to see. Now, the interesting thing is this: not only is it 1400 times faster it's also at half the price because for most of these systems, if you throw more gear, if you throw more hardware, the performance would vary. So, it's very important to go with how much of performance and at what price.So, for pure analytics—say, for four terabytes—is 1400 times faster at half the price. So, if it provides truly 800 times better price performance compared to Aurora for pure analytics. Now, let's take the other extreme. 100 gigabytes—which is a much smaller, your bread and butter database—and this is for mixed workloads. So, something like a CH-benCHmark, which has a combination of say, some TPC-C transactions, and then some added IPP-CH queries, which—the CH benCHmark.Here we have 42 times advantage price performance over Aurora because we are 42% of the cost, less than half the cost of Aurora and for the complex queries, we are about 18 times faster, and for pure OLTP, we are at par. So, the aggregate comes out to be about 42 times better. So, the mileage varies depending upon the data size and depending upon the complexity of the queries. So, in the case of Aurora, it will be anywhere from 42 times better price performance all the way to 2800.Corey: Does this have an upper bound, for example? Like, if we take a look at something like Redshift or something like Snowflake, where they're targeting petabyte-scale workloads at some point, that becomes a very different story for a lot of companies out there. Is that something that this can scale to, or is there a general reasonable upper bound of, okay, once you're above X number of terabytes, it's probably good to start looking at tiering data out or looking at a different solution?Nipun: We designed HeatWave primarily for those customers who had to move the data out of MySQL database into some other database for running analytics. The upper bound for the data in the MySQL database is 64 terabytes. Based on the demand and such we are seeing, we support 32 terabytes processing in HeatWave at any given point in time. You can still have 64 terabytes in the MySQL database, but the amount of data you can load into the HeatWave cluster at any given point in time is 32 terabytes.Corey: Which is completely reasonable. I would agree with you from not having much database exposure myself in the traditional sense, but from a cloud economics standpoint alone, anytime you have to move data to a different database for a different workload, you're instantly jacking costs through the roof. Even if it's just the raw data volumes, you now have to store it in two different places instead of one. Plus, in many cases, the vaguearities of data transfer pricing in many places wind up meaning that you're paying money to move things out, there's a replication story, there's a sync factor, and then it just becomes a management overhead problem. If there's a capacity to start using the data where it is in more intelligent ways, that alone has a massive economic wind, just from a time it takes your team to not have to focus on changing infrastructure and just going ahead to run the queries. If you want to start getting into the weeds of all the different ways something like this is an economic win, there's a lot of angles to look at it from.Nipun: That's an excellent point and I'm very glad you brought it up. So, now let's take the other set of benchmarks we were talking about: Snowflake. So, HeatWave is seven times faster and one-fifth the cost; it's about 35 times better price performance. Compared to let's say Redshift AQUA, six-and-a-half times faster at half the cost, so 13 times better price performance. And it goes on and on.Now, these numbers I was quoting is for 10 terabytes TPC-H queries. And the point which you said is very, very valid. When we are talking about the cost for these other systems, it's only the cost for analytics without including the cost of the source database or without including the cost of moving the data or managing to different databases. Whereas when you're talking about the cost of HeatWave, this is the cost which includes the cost of both transaction processing as well as the analytics. So, it's a single database; all the cost is included, whereas, for these other vendors, it's only the cost of the analytic database. So, the actual cost to a user is probably going to be much higher with these other databases. So, the price performance advantage with HeatWave will perhaps be even higher.Corey: Tell me a little bit about how it works. I mean, it's easy to sit here and say, “Oh, it's way faster and it's better in a bunch of benchmark stuff,” and we will get into that in a little bit, but it's described primarily as an in-memory query accelerator. Naively, I think, “Oh, it's just faster because instead of having data that lives on disk, it winds up having some of it live in RAM. Well, that seems simple and straightforward.” Like, oh, yeah, I'm going to go on a limb and assume that there aren't 160 patents tied to the idea that RAM is faster than disk. There's clearly a lot more going on. How does this work? What is it foundationally?Nipun: So, the thing to realize is HeatWave has been built from the ground up for the cloud and it is optimized for the Oracle Cloud. So, let's take these things one at a time. When I say designed from the ground up for the cloud, we have actually invented and implemented new algorithms for distributed query processing, which is what gives us such a good advantage in terms of operations like joint processing, window functions, aggregations. So, we have come up—invented, implemented new algorithms for distributed query processing. Secondly, we have designed it for the cloud.And by that what I mean is, A, we have a lot of emphasis on scalability, that it scales to thousands of cores with a very, very good scale factor, which is very important for the cloud. The next angle about the cloud is that not only have we optimized it for the cloud, but we have gone with commodity cloud services, meaning, for instance, when you're looking at the storage, we are looking at the least expensive price. So, for instance, we use object store; you don't use, for instance, locally attached SSDs because that will be expensive. Similarly, for compute: instead of using Intel, we use AMD chips because they are less expensive. Similarly, networking: standard networking.And all of this has been optimized for the specific Oracle Cloud infrastructure shapes we have, for the specific VMs we use, for the specific networking bandwidth we get, for the object store bandwidth and such; so that's the third piece, optimized for OCI. And the last bit is pervasive use of machine learning in the service. So, a combination of these four things: designed for the cloud, using commodity cloud services, optimized for the quality cloud infrastructure, and finally the pervasive use of machine learning is what gives us very good performance, very good scale, at a very inexpensive price.Corey: I want to dig into the idea of the pervasive use of machine learning. In many cases, machine learning is the answer to how do I wind up bilking a bunch of VCs out of money? And Oracle is not a venture-backed company at this stage of its existence, it is a very large, publicly-traded entity; you have no need to do that. And I would also further accept that this is one of those bounded problem spaces where something that looks machine-learning-like could do very well. Is that based upon what it observes and learns from data access patterns? Is it something that it learns based from a specific workload in question? What is the gathering, and is it specific to individual workloads that a given customer has, or is it holistically across all of the database workloads that you see in Oracle Cloud?Nipun: So, there are multiple parts to this question. The first thing is—and I think as you're noting—that with the cloud, we have a lot more opportunity for automation because we know exactly what is the hardware stack, we know the software stack, we know the configuration parameters.Corey: Oh yes, hell is other people's data centers, for sure.Nipun: [laugh]. And the approach we have taken for automation is machine-learning-based automation because one of the big advantages is that we can have a model which is tailored to a specific instance and as you run more queries, as you run more workloads, the system gets more intelligent. And we can talk about that maybe later about, like, specific things which make it very, very compelling. The third thing, I think, which you were alluding to, is that there are two aspects in machine learning: data, and the models or the algorithms. So, the first thing is, we have made a lot of enhancements, both to the MySQL engine as well as HeatWave, to collect new kinds of data.And by new kinds of data, I mean, that not only do we collect statistics of data, but we collect statistics of, say, the queries: what was the compilation time? What was the execution time? And then, based on this data which we're collecting, we have then come up with very advanced algorithms—machine learning algorithms—which are, again, a lot of them, there is, like, you know, patterns or [IP 00:14:13] which we have built on top of the existing state of art. So, for instance, taking these statistics and extrapolating them on larger data sizes. That's completely an innovation which we did in-house.How do we sample a very small percentage of the data and still be accurate? And finally, how do we come up with these machine learning models which are accurate without hiring an army of engineers? That's because we invented our AutoML, which is very efficient. So, that's basically the ecosystem of the machine learning which we have, which has been used to provide this.Corey: It's easy for folks to sit there and have a bunch of problems with Oracle for a variety of reasons, some of which are no longer germane, some of which are, I'm not here to judge. But I think it's undeniable—though it sometimes gets eclipsed by people's knee-jerk reactions—the reason that Oracle is in so many companies that it is in is because it works. You folks have been pioneers in the database space for a very long time and that's undeniable. If it didn't deliver performance that was untouchable for a long time, it would not have gotten to the point where you now are, where it is the database of record for an awful lot of shops. And I know it's somehow trendy, sometimes, for the startup set to think, “Oh, big companies are slow and awful. All innovation comes out of small, scrappy startups here.”But your customers are not fools. They made intelligent decisions based upon constraints that they're working within and problems that they need to solve. And you still have an awful lot of customers that are not getting off of Oracle anytime soon because it works. It's one of those things that I think is nuanced and often missed. But I do feel the need to ask about the lock-in story. Today, HeatWave is available only on the managed MySQL service in Oracle Cloud, correct?Nipun: Correct.Corey: Is there any licensing story tied to that? In other words, “Well, if I'm going to be using this, I need to wind up making a multi-year commitment. I need to get certain support things, as well,” the traditional on-premises Oracle story. Or is this an actual cloud service, in that you pay for what you use while you use it, and when you turn it off, you're done? In theory. In practice, we know in cloud economics, no one ever turns anything off until the company goes out of business.Nipun: So, it's exactly the letter what you said that this is a managed service. It's pay as you go, you pay only for what you consume, and if you decide to move on, there's absolutely no license or anything that is holding you back. The second thing—and I'm glad you brought it up—about the vendor lock-in. One of the very important things to realize about HeatWave is, A, it's just an accelerator for MySQL, but in the process of doing so, we have not introduced any proprietary syntax. So, if customers have the MySQL application running on some other cloud, they can very easily migrate to OCI and try MySQL HeatWave.But for whatever reason, if they don't like it, and they want to move out, there is absolutely nothing which is holding them back. So, the ease of which they can come in with the same ease they can walk out because we don't have any vendor lock-in. There is absolutely no proprietary extensions to HeatWave.Corey: There is the counter-argument as far as lock-in goes, and we see this sometimes with companies we talk to that were considering Google Cloud Spanner, as an example. It's great, and you can use it in a whole bunch of different places and effectively get ACID-compliance-like behavior across multiple regions, and you don't have to change any of the syntax of what it is you're using except the lock-in there is one of a strategic or software architecture lock-in because there's nothing else quite like that in the universe, which means that if you're going to migrate off of the single cloud where that's involved, you have to re-architect a lot, and that leads to a story of lock-in. I'm curious as to whether you're finding that customers are considering that as far as the performance that you're giving for MySQL querying is apparently unparalleled in the rest of the industry; that leads to a sort of lock-in itself when people get used to that kind of responsiveness and build applications that expect that kind of tolerances. At some point, if there's nothing else in the industry like it, does that means that they find themselves de-facto locked in?Nipun: If you were to talk about some functionality which we are offering which no one else is offering, perhaps you could, kind of, make that case. But that's not the case for performance because when we are so much faster—so suppose I said, okay, we are so much faster; we are six-and-a-half times faster than Redshift at half the cost. Well, if someone wanted the same performance, they can absolutely do it Redshift on a much larger cluster, and pay a lot more. So, if they want the best performance at the best price, they can come to Oracle Cloud; if they want the same performance but they will have to pay more, they can go anywhere else. So, I don't think that's a vendor lock-in at all.That's a value which we are bringing in that for the same performance, we are much cheaper. Or you can have that kind of a balance that we are faster and cheaper. So, there is no lock-in. So, it's not to say that, okay, we have made some extensions to MySQL which are only available in our cloud. That is not at all the case.Now, for some other vendors and for some other applications—you brought up Spanner; that's one. But we have had multiple customers of MySQL who, when they were trying Google BigQuery, they mentioned this aspect that, okay, Google BigQuery had these proprietary extensions and they feel locked in. That is not the case at all with HeatWave.Corey: This episode is sponsored by our friends at Oracle HeatWave is a new high-performance accelerator for the Oracle MySQL Database Service. Although I insist on calling it “my squirrel.” While MySQL has long been the worlds most popular open source database, shifting from transacting to analytics required way too much overhead and, ya know, work. With HeatWave you can run your OLTP and OLAP, don't ask me to ever say those acronyms again, workloads directly from your MySQL database and eliminate the time consuming data movement and integration work, while also performing 1100X faster than Amazon Aurora, and 2.5X faster than Amazon Redshift, at a third of the cost. My thanks again to Oracle Cloud for sponsoring this ridiculous nonsense.Corey: I do want to call out, just because it seems like there's a lies, damned lies, and database benchmarks story here where, for example, Azure for a while was doing a campaign where they were five times less expensive for database workloads than AWS until you scratched beneath the surface and realize it's because they're playing ridiculous games with licensing, making it very expensive to run a Microsoft SQL Server on anything that wasn't Azure. Customers are not necessarily as credulous as they once were when it comes to benchmarking. And Oracle for a long time hasn't really done benchmarking, and in fact, has actively discouraged it. For HeatWave, you've not only published benchmarks, which okay, vendors can say anything they want, and I'm going to wait until I see independent returns, but you put not just the benchmarks, but data sets, and your entire methodology onto GitHub as well. What led to that change? That seems like the least Oracle-like thing I could possibly imagine.Nipun: I couldn't take credit for the idea. The idea actually was from our Chief Marketing Officer, that was really his idea. But here is the reason why it makes a lot more sense for us to do it for MySQL HeatWave. MySQL is pervasive; pretty much any cloud vendor you can think about has a MySQL-based managed service. And obviously, MySQL runs on premise, like a lot of customers and applications do it.Corey: That's one of the baseline building blocks of any environment. I don't even need to be in the cloud; I can get MySQL working somewhere. Everyone has it, and if not, why don't you? And I can build it in a VM myself in 20 minutes.Nipun: That's right.Corey: It is a de-facto standard.Nipun: That's right. So, given that is the case and many other cloud vendors are innovating on top of it—which is great—how do you compare the innovation or the value proposition of Cloud Vendor A with us? So, for that, what we felt was that it is very important and very fair that we publish our scripts so that people can run those same scripts with a HeatWave, as well as with other cloud offerings, and make a determination for themselves. So, given the popularity of MySQL and given that pretty much all cloud vendors provide an offering of MySQL, and many of them have enhanced it, in order for customers to have an apples-to-apples comparison, it is imperative that we do this.Corey: I haven't run benchmarks myself just yet, just because it turns out, there's a lot of demands on my time and also, as mentioned, I'm not a deep database expert, unless it comes to DNS. And we keep waiting for people to come back with, “Aha. Here's why you're completely comprised of liars.” And I haven't heard any of that. I've heard edges and things here about, “Well, if you add an index over here, it might speed things up a bit,” but nothing that leads me to believe that it is just a marketing story.It is a great marketing story, but things like this fall apart super quickly in the event that it doesn't stand up to engineering scrutiny. And it's been out long enough that I would have fully expected to have heard about it. Lord knows if anyone is listening and has thoughts on this, I will be getting some letters after this episode, I expect. But I've come to expect those; please feel free to reach out. I'm always thrilled to do follow-up episodes and address things like this.When does it make sense from your perspective for someone to choose HeatWave on top of the Oracle Cloud MySQL service instead of using some of the other things we've talked about: Aurora, Redshift, Snowflake, et cetera? When does that become something that a customer should actively consider? Is it for net-new workloads? Should they consider it for migration stories? Should they run their database workloads in Oracle Cloud and keep other stuff elsewhere? What is the adoption path that you see that tends to lead to success?Nipun: All customers of MySQL, or all customers of any open-source database, those would be absolutely people who should consider MySQL HeatWave. For the very simple reason: first, regardless of the workload, whether it is OLTP only, or mixed workloads, or analytics, the cost is going to be significantly lower. I'll say at least it's going to be half the cost. In most of the cases, it's probably going to be less than half the cost. So, right off the bat, customers save half the cost by moving to MySQL HeatWave.And then depending upon the workload you have, as you have more complex queries, the performance advantage starts increasing. So, if you were just running only OLTP, if you only had transactions and you didn't have any complex queries—which is very unlikely for real-world applications, but even if that was the case, you're going to save 60% by going to MySQL HeatWave. But as you have more complex queries you will start finding that the net advantage you're going to get with performance is going to keep increasing and will go anywhere from 10 times aggregate to as much as 1400 times. So, all open-source, MySQL-based applications, they should consider moving. Then you mentioned about Snowflake, Redshift, and such; for all of them, it depends on what the source database is and what is it that they're trying to do.If they are moving data from, say, some open-source databases, if they are ETL-ing from MySQL, not only will MySQL HeatWave be much faster and much cheaper, but there's going to be a tremendous value proposition to the application because they don't need to have two different applications for two different databases. They can come back to MySQL, they can have a single database on which they can run all their applications. And then again, you have many of these cloud-native applications are born in the cloud where people may be looking for a simple database which does the job, and this is a great story—both in terms of cost as well as in terms of performance—and it's a single database for all your applications, significantly reduces the complexity for users.Corey: To turn the question around a little bit, what sort of workloads is MySQL HeatWave not a fit for? What sort of workloads are going to lead to a poor customer experience? Where, yeah, this is not a fit for that workload?Nipun: None, except in terms of the data size. So, if you have data sizes which are more than 64 terabytes, then yes, MySQL HeatWave is not a good fit. But if your data size is under 64 terabytes, you're going to win in all the cases by moving to MySQL HeatWave, given the functionality and capabilities of MySQL.Corey: I'd also like to point out that recently, HeatWave gained the MySQL Autopilot capability, which I believe is a lot of the machine learning technologies that you were speaking about a few minutes ago. Are there plans to continue to expand what HeatWave does and offer additional functionality? And—if you can talk about any of that. I know that roadmap is always something that is difficult to ask about, but it's clear that you're investing in this. Is your area of investment looking more like it's adding additional features? Is it continuing to improve existing performance? Something else entirely? And of course, we also accept you can't tell me any of [laugh] that has a valid answer.Nipun: Well, we just got started, so we just had our first [GF 00:27:03] HeatWave in December, and you saw that earlier this week we had our second major release of HeatWave. We are just getting started, so absolutely we are investing a lot in this area. But we are pretty much going to attempt all the things that you said. We have feedback from existing customers which is very high up on the priority list. And some of these are just one, say, class of enhancements which [unintelligible 00:27:25], can HeatWave handle larger sizes of data? Absolutely, we have done that; we will continue doing that.Second is, can HeatWave accelerate more constructs or more queries? Absolutely, we will do that. And then you have other kinds of capabilities which customers are asking which you can think of are, like you know, bigger features, which for instance, we announced the support for scale-out data storage which improves recovery time. Well, you're going to improve the recovery time or you're going to improve the time it takes to restart the database. And when I say improve, we are talking about not an improvement of 2X or 3X, but it's 100 times improvement for, let's say, a 10 terabyte data size.And then we have a very good roadmap which, I mean, it's a little far out that I can't say too much about it, but we will be adding a lot of very good new capabilities which will differentiate HeatWave even more, compared to the competitive services.Corey: You have very clearly forgotten more about databases than most of us are ever going to know. As you've been talking to folks about HeatWave, what do you find is the most common misunderstanding that folks like me tend to come away with when we're discussing the technology? What is it that is, I guess, a nuance that is often being missed in the industry's perspective as they evaluate the new technology?Nipun: One aspect is that many times, people just think about a service to be here some open-source code or some on-premise code which is being hosted as a managed service. Sure, there's a lot of value to having a managed service, don't get me wrong, but when you have innovations, particularly when you have spent years in years or decades of innovation for something which is optimized for the cloud, you have an architectural advantage which is going to pay dividends to customers for years and years to come. So, there is no substitute for that; if you have designed something for the cloud, it is going to do much better whether it's in terms of performance, whether it's in terms of scalability, whether it's in terms of cost. So, that's what people have to realize that it takes time, it takes investment, but when we start getting the payoff, it's going to be fairly big. And people have to think that okay, how many technologies or services are out there which have made this kind of investment?So, what I'm really excited about is, MySQL is the most popular database amongst developers in the world; we spend a lot of time, a lot of person-years investing over the last, you know, decade, and now we are starting to see the dividends. And from what we have seen so far, the response has been terrific. I mean, it's been really, really good response, and we are very excited about it.Corey: I want to thank you for taking so much time to speak with me today. If people want to learn more, where can they go?Nipun: Thank you very much for the opportunity. If they would like to know more, they can go to oracle.com/heatwavewhere we have a lot of details, including a technical brief, including all the details of the performance numbers we talked about, including a link to the GitHub where they can download the scripts. And we encourage them to download the scripts, see that they're able to reproduce the results we said, and then try their workloads. And they can find information as to how they can get free credits to try the service for free on their own and make up their mind themselves.Corey: [laugh]. Kicking the tires on something is a good way to form an opinion about it, very often. Thank you so much for being so generous with your time. I appreciate it.Nipun: Thank you.Corey: Nipun Agarwal, Vice President of MySQL HeatWave and Advanced Development at Oracle. I'm Cloud Economist Corey Quinn and this is Screaming in the Cloud. If you've enjoyed this podcast, please leave a five-star review on your podcast platform of choice, whereas if you've hated this podcast, please leave a five-star review on your podcast platform of choice along with an insulting comment formatted as a valid SQL query.Corey: If your AWS bill keeps rising and your blood pressure is doing the same, then you need The Duckbill Group. We help companies fix their AWS bill by making it smaller and less horrifying. The Duckbill Group works for you, not AWS. We tailor recommendations to your business and we get to the point. Visit duckbillgroup.com to get started.Announcer: This has been a HumblePod production. Stay humble.

Podcast AWS LATAM
EP65: Babelfish: La capa de traducción de Microsoft SQL Server a Aurora PostgreSQL

Podcast AWS LATAM

Play Episode Listen Later Sep 20, 2021 13:00


Diálogo sobre esta nueva característica llamada “Babelfish” de nuestro servicio administrado Aurora Postgres, en qué consiste, de donde vino la idea y como puede acelerar dramáticamente migraciones de SQL Server a Aurora Postgres. Material Adicional: https://aws.amazon.com/rds/aurora/babelfish/

Modernize or Die ® Podcast - CFML News Edition
Modernize or Die® - CFML News for September 7th, 2021 - Episode 118

Modernize or Die ® Podcast - CFML News Edition

Play Episode Listen Later Sep 7, 2021 48:56


2021-09-07 Weekly News - Episode 118Watch the video version on YouTube at https://youtu.be/pzKWPhzBpqI Hosts:  Eric Peterson - Senior Developer for Ortus Solutions Brad Wood - Software Consultant for Ortus Solutions Thanks to our Sponsor - Ortus SolutionsThe makers of ColdBox, CommandBox, ForgeBox, TestBox and almost every other Box out there. A few ways  to say thanks back to Ortus Solutions: Like and subscribe to our videos on YouTube.  Sign up for a free or paid account on CFCasts, which is releasing new content every week Become an ITB Sponsor - https://www.intothebox.org/#sponsors-2021  Buy Ortus's new Book - 102 ColdBox HMVC Quick Tips and Tricks on GumRoad (http://gum.co/coldbox-tips) Patreon SupportWe have 39 patreons providing 100% of the funding for our Modernize or Die Podcasts via our Patreon site: https://www.patreon.com/ortussolutions. We are now 41% of the way to our next goal, fully funding the ForgeBox.io site.Now offering Annual Memberships, pay for the year and save 10% - great for businesses.News and EventsAdobe ColdFusion Summit 2021Dec 7-8, 2021 - VirtualRegister now for this year's ColdFusion Summit!https://cfsummit.vconfex.com/site/adobe-cold-fusion-summit-2021/1290Special Into the Box Announcement coming on Thursday, September 9th, 2021Adobe 1 Day Workshop - Adobe ColdFusion Workshop with Damien BruyndonckxWed, September 22, 202109:00 - 17:00 CEST EUROPEANJoin the Adobe ColdFusion Workshop to learn how you and your agency can leverage ColdFusion to create amazing web content. This one-day training will cover all facets of Adobe ColdFusion that developers need to build applications that can run across multiple cloud providers or on-premise.https://coldfusion-workshop.meetus.adobeevents.com/ Adobe Webinar for September - Head in the clouds: Installing ColdFusion on Azure and AWS with Mark TakataWed, September 22, 202109:00 - 10:00 PDTIf you've been thinking about getting your CF instance moved into the cloud but don't know where to start, this webinar will get you rolling. We will explore how to install, configure and update CF2021 installs in both Amazon AWS and Microsoft Azure and give you tips and tricks on how to get things off the ground.https://installing-coldfusion-on-azure-and-aws.meetus.adobeevents.com/ CFCasts Content Updateshttps://www.cfcasts.com Just ReleasedUp and Running with Quick The N+1 Problem and Eager Loading Step 7 Exercise Scopes Coming this weekMore Up and Running with QuickSend your suggestions at https://cfcasts.com/supportConferences and TrainingInto the Box 2021 - live in Person in Texas.September 23rd and 24th.No workshops this year.Speakers and Schedule Released!!https://intothebox.orghttps://itb2021.eventbrite.comAdobe ColdFusion Summit 2021December 7th and 8thVirtualhttps://cfsummit.vconfex.com/site/adobe-cold-fusion-summit-2021/1290ITB Latam 2021 - live in personDecember 2nd or 3rd 2021 (confirming dates asap)More conferencesNeed more conferences, this site has a huge list of conferences for almost any language/community.https://confs.tech/Blogs, Tweets and Videos of the WeekBlog - Mark Takata - An introduction to the ColdFusion CLIYou might have heard that ColdFusion has a command line interface (well… actually we have a couple!), but what can it do? Turns out, quite a lot! Let's get you introduced to the CF CLI!https://coldfusion.adobe.com/2021/08/introduction-coldfusion-cli/Blog - Ben Nadel - Using Relative File Paths To Configure Application Mappings In Lucee CFML 5.3.8.201Lucee CFML has a lot of really nice developer ergonomics; one of which is its attitude towards relative file paths. In general, relative file paths "just work". They work when performing file I/O; and, as we now know, they work when configuring ColdFusion application mappings.https://www.bennadel.com/blog/4106-using-relative-file-paths-to-configure-application-mappings-in-lucee-cfml-5-3-8-201.htmBlog - Ben Nadel - Maintaining Route Information During SPA (Single-Page Application) Authentication In Lucee CFMLThe InVision platform is composed of a series of SPAs - Single-Page Applications - that are rendered with AngularJS on the front-end and powered by Lucee CFML on the back-end. Within each SPA, the current route is stored in the URL fragment (aka, the hash), which allowed client-side routing to work in older browsers such as IE6. The biggest challenge presented by fragment-based routing is that the fragment is never sent to the server during navigation. This makes it hard to maintain proper routing during external login events such as Single Sign-On (SSO). To get around this, I've started to use URL query-string parameters when defining routes in the transactional emails sent out from our Lucee CFML application.https://www.bennadel.com/blog/4108-maintaining-route-information-during-spa-single-page-application-authentication-in-lucee-cfml.htmBlog - Ben Nadel - I Wish My Relational Database Tables Were NarrowerNaming things is one of the hardest parts of computer science. Which I believe is a big part of why data modeling is so hard: it's challenging to see how one concept can be decomposed into multiple concepts when you don't know what those smaller concepts are called. This is why my relational database tables tend to get wider over time (ie, gain additional columns). But, after many years of building data-driven application using SQL and ColdFusion, I've come to appreciate how powerful it can be to keep database tables narrower.https://www.bennadel.com/blog/4107-i-wish-my-relational-database-tables-were-narrower.htmCFML JobsSeveral positions available on https://www.getcfmljobs.com/Listing over 180 ColdFusion positions from 85 companies across 111 locations in 5 Countries.2 new jobs listedFull-Time - Senior Coldfusion Developer at Remote - United States Posted Sept 4 https://www.getcfmljobs.com/jobs/index.cfm/united-states/Senior-Coldfusion-Developer-LATAM-at-Colon-PA/11327Full-Time Contract - ColdFusion Software Developer - Mid to Senior Level at Remote - United States Posted Sept 4https://www.getcfmljobs.com/jobs/index.cfm/united-states/ColdFusion-Software-Developer-Mid-to-Senior-Level-Remote-Position-at-Denver-CO/11328ForgeBox Module of the WeekCBSecurity by Ortus SolutionsNow with Refresh Token support!Refresh token endpoint /cbsecurity/refreshToken for secure refresh token generationManual refresh token method on the JwtService : refreshToken( token )Auto refresh token header interceptions for JWT validatorshttps://forgebox.io/view/cbsecurityhttps://coldbox-security.ortusbooks.com/VS Code Hint Tips and Tricks of the WeekSQL ServerMicrosoft - 924,675 downloads - 5 starsWelcome to mssql for Visual Studio Code! An extension for developing Microsoft SQL Server, Azure SQL Database and SQL Data Warehouse everywhere with a rich set of functionalities, including: Connect to Microsoft SQL Server, Azure SQL Database and SQL Data Warehouses. Create and manage connection profiles and most recently used connections. Write T-SQL script with IntelliSense, Go to Definition, T-SQL snippets, syntax colorizations, T-SQL error validations and GO batch separator. Execute your scripts and view results in a simple to use grid. Save the result to json or csv file format and view in the editor. Customizable extension options including command shortcuts and more. https://marketplace.visualstudio.com/items?itemName=ms-mssql.mssqlhttps://docs.microsoft.com/en-us/sql/tools/visual-studio-code/sql-server-develop-use-vscode?view=sql-server-ver15Thank you to all of our Patreon SupportersThese individuals are personally supporting our open source initiatives to ensure the great toolings like CommandBox, ForgeBox, ColdBox,  ContentBox, TestBox and all the other boxes keep getting the continuous development they need, and funds the cloud infrastructure at our community relies on like ForgeBox for our Package Management with CommandBox. You can support us on Patreon here https://www.patreon.com/ortussolutionsNow offering Annual Memberships, pay for the year and save 10% - great for businesses. Bronze Packages and up, now get a ForgeBox Pro and CFCasts subscriptions as a perk for their Patreon Subscription. All Patreon supporters have a Profile badge on the Community Website All Patreon supporters have their own Private Forum access on the Community Website Patreons John Wilson - Synaptrix  Don Bellamy Eric Hoffman David Belanger Dean Maunder Gary Knight Giancarlo Gomez Jonathan Perret Mario Rodrigues Jeffry McGee - Sunstar Media Yogesh Mathur Joseph Lamoree Ben Nadel Brett DeLine Carl Von Stetten Charlie Arehart Dan Card Daniel Garcia Didier Lesnicki Edgardo Cabezas Jan Jannek Jason Daiger Jeff McClain Jeremy Adams Jonas Eriksson Jordan Clark Kai Koenig Laksma Tirtohadi Leon Seremelis Matthew Darby Matthew Clemente Mingo Hagen Patrick Flynn Ross Phillips Scott Steinbeck Shawn Oden Stephany Monge Steven Klotz You can see an up to date list of all sponsors on Ortus Solutions' Websitehttps://ortussolutions.com/about-us/sponsors ★ Support this podcast on Patreon ★

IGeometry
Should you go with an Optimistic or Pessimistic Concurrency Control Database?

IGeometry

Play Episode Listen Later Jul 1, 2021 21:46


MongoDB, Postgres, Microsoft SQL Server, or MySQL, or any other database manages concurrency control differently. There are two methods, pessimistic and optimistic, both have their pros and cons. Let explore how different databases implement this and what is the effect on performance/scalability. This is often known as Optimistic vs pessimistic locking. Although I don't really like to use locking with this because it confuses the story. 0:00 Intro 2:20 What is Concurrency Control 6:00 Pessimistic Concurrency Control 14:50 Optimistic Concurrency Control Resources https://www.postgresql.org/docs/13/mvcc.html http://source.wiredtiger.com/develop/architecture.html https://docs.microsoft.com/en-us/troubleshoot/sql/performance/resolve-blocking-problems-caused-lock-escalation Become a Member on YouTube https://www.youtube.com/channel/UC_ML5xP23TOWKUcc-oAE_Eg/join

Channel 9
Disaster Recovery Options for Azure SQL Databases | Data Exposed

Channel 9

Play Episode Listen Later May 25, 2021 16:54


Planning a proper disaster recovery solution is a critical piece of any infrastructure design, even when working in the cloud solutions like Azure SQL Database. Thankfully, the Azure architecture provides a solution that with only clicks of the mouse a DR plan can be implemented. In this episode with MVP John Morehouse, we'll take a look at how easy it is to set up and configure a disaster recovery solution for Azure SQL Database. [00:37] About John Morehouse[01:27] Demo: Backups[04:42] Demo: Active geo-replication [10:39] Demo: Failover groups[15:20] Getting startedResources:BackupsActive Geo-replicationAuto Failover groups About John Morehouse:John Morehouse is currently a Consultant with Denny Cherry & Associates living in Louisville, Kentucky. With over 2 decades of technical experience in various industries, John now focuses on the Microsoft Data platform and specializes in Microsoft SQL Server. He is honored to be a Microsoft Data Platform MVP, VMWare vExpert, 2016 Idera Ace, Friend of Red Gate, Sentry One PAC member & Community Ambassador. John has a passion around speaking, teaching technical topics and giving back to the technical community as much as possible. He is a user group leader, SQL Saturday organizer, and former PASS regional mentor. He is also a blogger, avid tweeter, and a frequent speaker at SQL Saturday's as well as other conferences. If you want to find John, you can find him on Twitter (@sqlrus) or on his blog, https://sqlrus.com.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram.

Data Exposed  - Channel 9
Disaster Recovery Options for Azure SQL Databases

Data Exposed - Channel 9

Play Episode Listen Later May 25, 2021 16:54


Planning a proper disaster recovery solution is a critical piece of any infrastructure design, even when working in the cloud solutions like Azure SQL Database. Thankfully, the Azure architecture provides a solution that with only clicks of the mouse a DR plan can be implemented. In this episode with MVP John Morehouse, we'll take a look at how easy it is to set up and configure a disaster recovery solution for Azure SQL Database. [00:37] About John Morehouse[01:27] Demo: Backups[04:42] Demo: Active geo-replication [10:39] Demo: Failover groups[15:20] Getting startedResources:BackupsActive Geo-replicationAuto Failover groups About John Morehouse:John Morehouse is currently a Consultant with Denny Cherry & Associates living in Louisville, Kentucky. With over 2 decades of technical experience in various industries, John now focuses on the Microsoft Data platform and specializes in Microsoft SQL Server. He is honored to be a Microsoft Data Platform MVP, VMWare vExpert, 2016 Idera Ace, Friend of Red Gate, Sentry One PAC member & Community Ambassador. John has a passion around speaking, teaching technical topics and giving back to the technical community as much as possible. He is a user group leader, SQL Saturday organizer, and former PASS regional mentor. He is also a blogger, avid tweeter, and a frequent speaker at SQL Saturday's as well as other conferences. If you want to find John, you can find him on Twitter (@sqlrus) or on his blog, https://sqlrus.com.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram.

Around the Storage Block podcast -
#8 Running Microsoft SQL Server with HPE Storage

Around the Storage Block podcast -

Play Episode Listen Later May 24, 2021


In this second of three podcasts talking about application workloads, Mike Harding, Solution Product Manager for HPE Storage joined me to talk about Microsoft SQL Server and what he is seeing both from an industry standpoint and specifically with workload testing that HPE has done with HPE Alletra, the new data infrastructure that was announced on May 4th.

Bad For Education - Coding Tips For The Junior Developer & Beyond
Databases, Wireframes, Schema, and Dummy Data, Oh My!

Bad For Education - Coding Tips For The Junior Developer & Beyond

Play Episode Listen Later Mar 18, 2021 25:14


Today's episode we discuss databases! A topic a full-stack developer should know. The two most popular database types we'll cover are relational vs. non-relational.  Relational databasesA relational database works by linking information from multiple tables through the use of “keys.” A key is a unique identifier which can be assigned to a row of data contained within a table. This unique identifier, called a “primary key,” can then be included in a record located in another table when that record has a relationship to the primary record in the main table. When this unique primary key is added to a record in another table, it is called a “foreign key” in the associated table. The connection between the primary and foreign key then creates the “relationship” between records contained across multiple tables. Historically, the most popular relational databases have been Microsoft SQL Server, Oracle Database, MySQL and IBM DB2.  Non-relational databasesThe non-relational database, or NoSQL database, stores data. However, unlike the relational database, there are no tables, rows, primary keys or foreign keys.  Instead, the non-relational database uses a storage model optimized for specific requirements of the type of data being stored.Some of the more popular NoSQL databases are MongoDB, Apache Cassandra, Redis, Couchbase and Apache HBase.Within computer programming, the acronym CRUD stands for create, read, update and delete. These are the four basic functions of persistent storage. Also, each letter in the acronym can refer to all functions executed in relational database applications and mapped to a standard HTTP method, SQL statement or DDS operation.Dummy data is benign information that does not contain any useful data, but serves to reserve space where real data is nominally present. Dummy data can be used as a placeholder for both testing and operational purposes.A wireframe is a schematic or blueprint that is useful for helping you, your programmers and designers think and communicate about the structure of the software or website you're building.References:Relation vs Non-relational databasesConnect With Us!Instagram: @badforeducationpodcastTwitter: @badforedupodEmail: badforeducationpodcast@gmail.comSend us questions! Or say hello to  us via email!Want a free $20 Amazon gift card and to start your own podcast with Buzzsprout?It's as simple as one click in our link below. Get started today, and have access to their extensive network and assistance. Podcasting isn't hard when you have the right partners!Click our link here

QAGroup
Small talk about QA (інтерв'ю)

QAGroup

Play Episode Listen Later Jan 28, 2021 113:54


Наше інтерв'ю для Вас, якщо Ви: - хочете розвиватися в ІТ; - вже намагалися опанувати професію тестувальника ПЗ самостійно, але не все зрозуміло; - хочете стати QA Engineer, але не знаєте, з чого почати.

Estructura de Datos
Reglas de Integridad en Base de Datos

Estructura de Datos

Play Episode Listen Later Dec 18, 2020 17:43


Explicar y demostrar el concepto de integridad y las reglas de integridad en las bases de datos usando Microsoft SQL Server 2019 como Sistema Gestor de Bases de Datos.

Scaling Postgres
Episode 143 Microsoft SQL Server Compatible | Time Series Performance | Feature Casualties | BLOB Cleanup

Scaling Postgres

Play Episode Listen Later Dec 7, 2020 18:43


In this episode of Scaling Postgres, we discuss Microsoft SQL server compatibility, the performance of time series DBs, DB feature casualties and how to clean up BLOBs. Subscribe at https://www.scalingpostgres.com to get notified of new episodes. Links for this episode: https://www.ongres.com/blog/aws_announces_open_source_postgres_with_sql_server_compatibility/ https://aws.amazon.com/blogs/opensource/want-more-postgresql-you-just-might-like-babelfish/ https://blog.timescale.com/blog/timescaledb-vs-amazon-timestream-6000x-higher-inserts-175x-faster-queries-220x-cheaper/ https://brandur.org/large-database-casualties https://www.cybertec-postgresql.com/en/blob-cleanup-in-postgresql/ https://www.enterprisedb.com/blog/infographic-5-things-include-your-postgresql-security-checklist https://www.revenuecat.com/blog/pgbouncer-on-aws-ecs https://www.percona.com/blog/2020/12/01/how-pgbackrest-is-addressing-slow-postgresql-wal-archiving-using-asynchronous-feature/ https://info.crunchydata.com/blog/replacing-lines-of-code-with-2-little-regexs-in-postgresql https://b-peng.blogspot.com/2020/11/gpool2-on-k8s.html https://erthalion.info/2020/11/28/evolution-of-btree-index-am/ https://blog.rustprooflabs.com/2020/11/postgis-trajectory-intro https://www.highgo.ca/2020/12/04/2020-pg-asia-conference-ended-successfully-at-an-unprecedented-scale/ https://postgresql.life/post/stephane_schildknecht/

IGeometry
Will AWS Babelfish Succeed Moving Developers Away from SQL Server to Postgres?

IGeometry

Play Episode Listen Later Dec 3, 2020 21:17


In AWS re-invent, Amazon announced open sourcing Babelfish for PostgreSQL, a SQL Server-compatible end-point for PostgreSQL to make PostgreSQL fluent in understanding communication from apps written for SQL Server. Let us discuss what is this technology and whether if its gonna really move developers away form Microsoft SQL Server to Postgres Resources https://aws.amazon.com/blogs/opensource/want-more-postgresql-you-just-might-like-babelfish/ Chapters 0:00 Intro 1:30 Postgres vs SQLServer 5:20 What is Babelfish? 9:40 Why Babelfish May not Work 10:06 Will Babelfish Includes everything? 11:46 BabelFish is an Extra Layer 13:35 What REALLY is Babelfish? 15:00 Performance --- Send in a voice message: https://anchor.fm/hnasr/message

Data Exposed  - Channel 9
Azure SQL Database: Improving Performance Tuning with Automatic Tuning

Data Exposed - Channel 9

Play Episode Listen Later Nov 24, 2020 8:19


One of the performance benefits of using Azure SQL Database is the ability for Azure SQL Database to automatically add and remove indexes from the database, based on the workload that is running against the database. Join Denny Cherry as he shows you how to enable automatic tuning and when it won't help you as much as you think that it will.[01:25] Automatic tuning features[03:08] Indexes[03:40] Automatic tuning demo[04:40] When to use this feature[06:30] What indexes should be madeResources:Enable automatic tuning in the Azure portalEmail notifications for automatic tuningFind and apply performance recommendationsAbout Denny Cherry:Denny Cherry is the owner and principal consultant for Denny Cherry & Associates Consulting and has over a decade of experience working with platforms such as Microsoft Azure, Amazon AWS, Microsoft SQL Server, Hyper-V, vSphere, and Enterprise Storage solutions. Denny's areas of technical expertise include system architecture, performance tuning, security, replication, and troubleshooting. Denny currently holds several Microsoft Certifications related to SQL Server 2000 through 2019, including being a Microsoft Certified Master, Microsoft MVP and VMware vExpert Award.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Python Bytes
#207 FastAPI as a web platform (not just APIs)

Python Bytes

Play Episode Listen Later Nov 13, 2020 33:27


Sponsored by us! Support our work through: Our courses at Talk Python Training Test & Code Podcast Patreon Supporters Michael #1: fastapi-chameleon (and fastapi-jinja) Chameleon via Michael, Jinja via Marc Brooks Convert a FastAPI API app to a proper web app Then just decorate the FastAPI view methods (works on sync and async methods): @router.post('/') @fastapi_chameleon.template('home/index.pt') async def home_post(request: Request): form = await request.form() vm = PersonViewModel(**form) return vm.dict() # {'first':'Michael', 'last':'Kennedy', ...} The view method should return a dict to be passed as variables/values to the template. If a fastapi.Response is returned, the template is skipped and the response along with status_code and other values is directly passed through. This is common for redirects and error responses not meant for this page template. Brian #2: Django REST API in a single file, without using DRF Adam Johnson He’s been on Test & Code a couple times, 128 & 135 Not sure if you should do this, but it is possible. Example Django app that is a REST API that gives you information about characters from Rick & Morty. Specifically, just Rick and Morty. / - redirects to /characters/ /characters/ - returns a JSON list /characters - redirects to /characters/ /characters/1 - returns JSON info about Rick /characters/2 - same, but for Morty Shows off how with Django off the shelf, can do redirects and JSON output. Shows data using dataclasses. Hardcoded here, but easy to see how you could get this data from a database or other part of your system. Michael #3: 2020 StackOverflow survey results Most Popular Technologies Languages: JavaScript (68%), Python (44%), Java(40%) Web frameworks: Just broken, jQuery? Seriously!?! Databases: MySQL (56%), PostgreSQL (36%), Microsoft SQL Server (33%), MongoDB (26%) Platforms: Windows (46%), macOS (28%), Linux(27%) Most loved languages: Rust, TypeScript, Python Most wanted languages: Python, JavaScript, Go Most dreaded language: VBA & ObjectiveC Most loved DBs: Redis (67%), PostgreSQL (64%), Elasticsearch (59%), MongoDB (56%) Most wanted DBs: MongoDB (19%), PostgreSQL (16%) Most dreaded DB: DB2 Brian #4: A Visual Guide to Regular Expression Amit Chaudhary Gentle introduction to regex by building up correct mental models using visual highlighting. Goes through different patterns: specific character white space (any whitespace s, tab t, newline n) single-digit number d word characters w : lowercase, uppercase, digits, underscore this sometimes throws me, since w seems like it might somehow be related to whitespace. It’s not. dot . : anything except newline pattern negations: d is digits, D is anything that is not a digit s whitespace, S not whitespace w word characters, W everything else character sets with square brackets [], and optionally dash - for range anchors ^ beginning of line $ end of line escaping patterns with repetition with {}, *, +, ? Using Python re module findall match and match.group search Michael #5: Taking credit by Tim Nolet Oh @awscloud I really do love you! But next time you fork my OS project https://github.com/checkly/headless-recorder and present it as your new service, give the maintainers a short "nice job, kids" or something. Not necessary as per the APLv2 license, but still, ya know? Amazon CloudWatch Synthetics launches Recorder to generate user flow scripts for canaries A Chrome browser extension, to help you create canaries more easily. Brian #6: Raspberry Pi 400 “complete personal computer, built into a compact keyboard” by itself, or as a kit with mouse and power adapter and cables and such, for $100 4 core, 64-bit processor, 4 GB RAM, wifi & LAN, can drive 2 displays, 4K video 40-pin GPIO header, so you can still play with hardware and such. There’s an adafruit video with Limor Fried where she describes this as something as close as we get today to an Apple IIe from my youth. For me, IIe was at school, at home I had a TRS80 plugged into an old TV and using my sisters tape deck for disk storage. This seems great for education use, but also as a second computer in your house, or a kids computer. Comes with a Beginner’s Guide that includes getting started with Python Extras: Brian: vim-adventures.com - with a dash. Practice vim key bindings while playing an adventure game. Super cool. Michael: TIOBE Index for November 2020 via Tyler Pedersen Joke: You built it, you run it.

The Founder's Playbook
015: Quentin Clark (CTO, Dropbox & MD @ General Catalyst) | Leadership & Building Iconic Companies

The Founder's Playbook

Play Episode Listen Later Oct 30, 2020 43:22


Quentin was CTO of Dropbox, a company that's brought millions of consumers, teams, and business onto the cloud. As CTO, he was integral to taking the company public, leading the engineering, product, design, and growth teams throughout the process. Quentin also helped broaden the company's portfolio with the HelloSign acquisition and the recent launch of their new team-oriented collaboration product, Dropbox Spaces. Prior to Dropbox, Quentin spent nearly two decades with Microsoft, starting as a software engineer, then product manager, and eventually leading the entire family of data products — from Microsoft SQL Server, the BI products, no-SQL, and ML capabilities on-prem and in Azure. After Microsoft, Quentin joined SAP and helped to build the company's growth strategy, first as their CTO, then leading strategy, corpdev, M&A and strategic partnerships. As a part of that role, he helped SAP spin-up an emerging business unit with a venture mindset for working directly with the startup community. On This Episode: Learn how crucial a clear vision is to your career path. Discover the importance of becoming. self-aware of your own limitations. Hear the key philosophies to building high-performing teams. Get a few helpful interview questions to ask potential team members. Quentin shares how he chooses what founders he makes bets on. Key Takeaways To be a full-stack leader you must possess the following qualities: Vision Strategy Leadership Management Technical Accuity Business Accuity Tweetable Quotes: It's very easy to mask people dysfunction with short-term success.

Data Exposed  - Channel 9
Hybrid Disaster Recovery Scenarios for SQL Server

Data Exposed - Channel 9

Play Episode Listen Later Sep 22, 2020 16:19


In the conclusion to this two-part series with Allan Hirt, learn how Azure can be used to create disaster recovery solutions for your on premises Microsoft SQL Server instances and databases through the use of built-in availability features of SQL Server. For an introduction to Microsoft Hybrid SQL Server Solutions, watch part one. [01:22] Built in hybrid disaster recovery options overview[02:22] Hybrid Log Shipping[04:27] Hybrid "Normal" Availability Group[07:34] Hybrid Distributed Availability Group[11:55] Hybrid Failover Cluster Instance Resources:Log ShippingDistributed Availability GroupsStorage ReplicaAbout Allan Hirt:Consultant, trainer, author, business continuity expert, and SQLHA, LLC founder Allan Hirt has been working with both SQL Server since 1992 when it was still a Sybase product as well as clustering in Windows Server since the late 1990s when it was called Wolfpack. Currently a dual Microsoft MVP (Data Platform; Cloud and Datacenter Management) as well as a VMware vExpert, Allan works with customers of all sizes around the world to deliver mission-critical projects whether they are on premises, in the cloud, or hybrid. You can follow him on Twitter at @SQLHA, read his latest blog posts and see upcoming speaking engagements and classes at https://www.sqlha.com, and get his free video content on the SQLHA YouTube Channel.About MVPs: Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Data Exposed  - Channel 9
An Introduction to Microsoft Hybrid SQL Server Solutions

Data Exposed - Channel 9

Play Episode Listen Later Sep 15, 2020 14:27


In the first episode of this two-part series with Allan Hirt, learn how to leverage on premises infrastructure for Microsoft SQL Server deployments while also taking advantage of the benefits of Azure at the same time. Using cloud-based resources does not have to be an all or nothing proposition. [01:22] Why people go hybrid[02:10] High-level look at deployments[03:37] Key understandings of hybrid[06:19] Networking will make or break you[08:34] Hybrid scenarios for SQL Server[13:10] Top tips Resources:SQL Server data files in Microsoft AzureBackup to URLAzure File ShareAzure Arc enabled SQL ServerAbout Allan Hirt:Consultant, trainer, author, business continuity expert, and SQLHA, LLC founder Allan Hirt has been working with both SQL Server since 1992 when it was still a Sybase product as well as clustering in Windows Server since the late 1990s when it was called Wolfpack. Currently a dual Microsoft MVP (Data Platform; Cloud and Datacenter Management) as well as a VMware vExpert, Allan works with customers of all sizes around the world to deliver mission-critical projects whether they are on premises, in the cloud, or hybrid. You can follow him on Twitter at @SQLHA, read his latest blog posts and see upcoming speaking engagements and classes at https://www.sqlha.com, and get his free video content on the SQLHA YouTube Channel.About MVPs: Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real-world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

Storage Unpacked Podcast
#172 – Tintri SQL Integrated Storage

Storage Unpacked Podcast

Play Episode Listen Later Sep 4, 2020 34:03


This week, Chris and Martin talk to Shawn Meyers, Field CTO at Tintri about SQL Integrated Storage. The Tintri VMstore platform originally provided the ability to apply policy-based management to virtual machines on shared storage. This capability has now been extended to databases, in particular Microsoft SQL Server. SQL Integrated Storage (or SIS) works by […] The post #172 – Tintri SQL Integrated Storage appeared first on Storage Unpacked Podcast.

Data Exposed  - Channel 9
How Resumable Indexes in SQL Server 2019 Makes Your Job Easier

Data Exposed - Channel 9

Play Episode Listen Later Aug 4, 2020 15:16


Microsoft continues to push the envelope on feature capabilities with every release of SQL Server. One of the more prominent features that was released with Microsoft SQL Server 2019, is the ability to resume or throttle certain index operations. Have you ever wanted to just stop and then resume an index operation picking up where it left off? Now you can! This feature alone magnifies the data professionals' ability to have deeper granular control on how index operations affect their ecosystem as well as their work-life balance. In this episode, John Morehouse gives a high-level look at how this feature works and how it can be applied seamlessly to your environment. Resources:Guidelines for online index operationsDenny Cherry & AssociatesAbout John Morehouse:John Morehouse is currently a Consultant with Denny Cherry & Associates living in Louisville, Kentucky. With over 2 decades of technical experience in various industries, John now focuses on the Microsoft Data platform and specializes in Microsoft SQL Server. He is honored to be a Microsoft Data Platform MVP, VMWare vExpert, 2016 Idera Ace, Friend of Red Gate, Sentry One PAC member & Community Ambassador. John has a passion around speaking, teaching technical topics and giving back to the technical community as much as possible. He is a user group leader, SQL Saturday organizer, and former PASS regional mentor. He is also a blogger, avid tweeter, and a frequent speaker at SQL Saturday's as well as other conferences. If you want to find John, you can find him on Twitter (@sqlrus) or on his blog.About MVPs:Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies. They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart. Learn more: https://aka.ms/mvpprogram

The Pure Report
Into the Mind of a Data Engineer

The Pure Report

Play Episode Listen Later Jun 1, 2020 22:01


Find out what motivates a data engineer directly from a DBA that has been living it for years. Melody Zacharias. Microsoft Solution Manager, joins the Pure Report to share her experiences working with data and how DBAs and data architects are contending with new challenges brought on by the rise of as-a-service offerings and containers. She also shares details of strategic areas Pure is investing around integrations for Microsoft SQL Server and other emerging data management solutions like Big Data Clusters. For more info on Pure and Microsoft solutions: https://www.purestorage.com/solutions/applications/microsoft.html

The 6 Figure Developer Podcast
Episode 144 – Database Stuff with Brent Ozar

The 6 Figure Developer Podcast

Play Episode Listen Later May 18, 2020 37:16


  This week the guys get some free Database Consulting from Brent Ozar. Brent makes Microsoft SQL Server go faster. He got his start in the late 1990s – first as a developer and systems administrator, then as a full time DBA. He's managed performance and reliability for truly tough servers: tens of terabytes, thousands of databases, and thousands of queries per second.   Links https://twitter.com/BrentO https://www.brentozar.com/ https://www.linkedin.com/in/brentozar/ https://www.twitch.tv/brentozar https://github.com/BrentOzarULTD   Resources SQLPerformance.com SQL Server Simple Talk SQL Server Central Stairways SQLBits.com The Secrets of Consulting   "Tempting Time" by Animals As Leaders used with permissions - All Rights Reserved   × Subscribe now! Never miss a post, subscribe to The 6 Figure Developer Podcast! Are you interested in being a guest on The 6 Figure Developer Podcast? Click here to check availability!  

AWS TechChat
Episode 70 - March / April Tech Round-up

AWS TechChat

Play Episode Listen Later May 4, 2020 46:45


In this Episode of AWS TechChat, Shane and Pete embark on a different style of the show and share with you a lot of updates - over 30 updates and we tackle it like speed dating. We start the show with some updates, there are now an additional 2 AWS regions, Milan in Italy and Cape Town in South Africa. This brings the region count to 24 Regions and 76 Availability Zones. Amazon Guard Duty has a price reduction for the customers who are consuming it on the upper end of the scale, VPC flow log scanning is now 40% cheaper when your logs are more than 10,000GB. Lots of Database engine updates: • Database engine version updates across almost all engines. Microsoft SSAS (SQL Server Analysis Studio) is now available on Amazon Relational Database Service (Amazon RDS) for SQL Server now. • If you are currently running SSAS on Amazon Elastic Compute Cloud (Amazon EC2), you can now save costs by running SSAS directly on the same Amazon RDS DB instance as your SQL Server database. SSAS is currently available on Amazon RDS for SQL Server 2016 and SQL Server 2017 in the single-AZ configuration on both the Standard and Enterprise edition. • NoSQL Workbench for Amazon DynamoDB is now is now generally available. NoSQL Workbench is a client-side application, available for Windows and macOS that helps developers build scalable, high-performance data models, and simplifies query development and testing. • Apache Kafka is an option for AWS Database Migration Service and Amazon Managed Apache Cassandra Service is now available in public preview. Microsoft SQL Server on RDS now supports Read Replicas. Storage updates: • More nitro based Amazon EC2 systems receive IO performance updates. • Amazon FSx for Windows File Server is now has a Magnetic HDD option which brings storage down to 1.3cents per GB. • Amazon Elastic File System (Amazon EFS) announces 400% increase in read operations for General Purpose mode file systems. On Development front: • AWS Lambda@Edge now supports Node 12.x and Python 3.8. • Amplify CLI add support for additional AWS Lambda runtimes (Java, Go, .NET and Python) and Lambda cron jobs. • AWS Lambda now supports .NET Core 3.1. • Receive notifications for AWS CodeBuild, AWS CodeCommit, AWS CodeDeploy, and AWS CodePipeline in Slack, no need to use Amazon Simple Notification Service (SNS) and AWS Glue. • Amazon MSK adds support for Apache Kafka version 2.4.1 • Updates to AWS Deep Learning Containers for PyTorch 1.4.0 and MXNet 1.6.0 Containers updates: • AWS Fargate launches platform version 1.4 which brings a raft of improvements. • Amazon Elastic Kubernetes Service (Amazon EKS) updates service level agreement to 99.95%. • Amazon EKS now supports service-linked roles. • Amazon EKS adds envelope encryption for secrets with AWS Key Management Service (KMS). • Amazon EKS now supports Kubernetes version 1.15 • Amazon ECS supports in preview updating placement strategy and constraints for existing Amazon ECS Services without recreating the service. Connect your managed call centre in the cloud: • Introducing Voicemail for Amazon Connect. • Amazon Connect adds custom terminating keypress for DTMF. Other updates: • New versions of Elastic Search available for Amazon Elastic Search. • AWS DeepComposer is now shipping from Amazon.com Speakers: Shane Baldacchino - Solutions Architect, ANZ, AWS Peter Stanski - Head of Solution Architecture, AWS AWS Events: AWS Summit Online https://aws.amazon.com/events/summits/online/ AWSome Day Online Conference https://aws.amazon.com/events/awsome-day/awsome-day-online/ AWS Innovate AIML Edition on-demand https://aws.amazon.com/events/aws-innovate/machine-learning/ AWS Events and Webinars https://aws.amazon.com/events/

60 Minute Digital Marketing
SQL Inner Join

60 Minute Digital Marketing

Play Episode Listen Later Apr 24, 2020 13:13


In this podcast, you are going to learn how to you inner join in Microsoft SQL Server. #sqlserver #innerjoin

Transformación Digital
E47 Software Microsoft mas usado en Colombia por las Pymes, en 9 minutos

Transformación Digital

Play Episode Listen Later Feb 11, 2020 9:29


En Colombia las Pymes son un segmento de gran importancia, son empresas pequeñas o medianas en cuanto a volumen de ingresos, valor del patrimonio y número e trabajadores y se caracterizan por tener unas necesidades en software específicas que deben ser cubiertas protegiendo presupuestos y ajustando la inversión únicamente a lo que estrictamente se requiere. En este episodio Ricardo Villegas nos habla de las necesidades mas comunes que deben ser satisfechas en lo que concierne a software de Microsoft. Hablamos acerca de herramientas como Microsoft Office, licencias de Sistema Operativo Windows y para empresas de mayor tamaño Microsoft Windows Server y Microsoft SQL Server. Conducen: Ricardo Villegas Londoño: email: r_villegas@hotmail.com Alejandro Peláez Rodríguez: email: alejandropelaezr@gmail.com Producido por: Alejandro Pelaez Rodriguez Web site: https://www.apelaez.com/podcasts/transformacion-digitalBlog: https://www.apelaez.com/blogemail: alejandropelaezr@gmail.com Redes SocialesInstagram: https://www.instagram.com/alejandropelaezrYouTube: https://www.youtube.com/user/alejandropelaezrTwitter: https://twitter.com/apelaezFacebook: https://www.facebook.com/alejandropelaezr CreditosMusic by: Fontanez / Doug Maxwell - Urban LullabyFotografia: Juan Jose Alvarez Calle https://www.kreafoto.com

Transformación Digital
E20 Licenciamiento de Microsoft SQL Server

Transformación Digital

Play Episode Listen Later Aug 24, 2019 32:45


En este episodio contamos de nuevo con la participación de Ricardo Villegas quien nos explica el licienciamiento del segundo producto de software mas popular de Microsoft en ambientes empresariales, se trata del motor de base de datos Microsoft SQL Server. Hablamos del licenciamiento del motor de base de datos en: Servidores físicos Servidores virtuales Servidores en la nube Comparte este podcast, deja tus comentarios y escríbenos que temas quisieras escuchar en este espacio de Transformación Digital. Invitado: Ricardo Villegas Londoño email: r_villegas@hotmail.com Producido por: Alejandro Pelaez Rodriguez Web site: https://www.apelaez.com/podcasts/transformacion-digitalBlog: https://www.apelaez.com/blogemail: alejandropelaezr@gmail.com Redes SocialesInstagram: https://www.instagram.com/alejandropelaezrYouTube: https://www.youtube.com/user/alejandropelaezrTwitter: https://twitter.com/apelaezFacebook: https://www.facebook.com/alejandropelaezr CreditosMusic by: Fontanez / Doug Maxwell - Urban LullabyFotografia: Juan Jose Alvarez Calle https://www.kreafoto.com

WIRED Business – Spoken Edition
Microsoft's Old-School Database Was the Surprise Software Hit of the Year

WIRED Business – Spoken Edition

Play Episode Listen Later Jan 5, 2017 3:06


Don't call it a comeback, but Microsoft's database software may be seeing a resurgence. According to research conducted by the Austrian consulting company Solid IT, Microsoft SQL Server's popularity grew faster than any other database product the company tracked on its DB-Engines site during 2016. That's good news for Microsoft because, despite holding tight to the number three spot in the rankings for the past few years, SQL Server's popularity had been waning.

The New Disruptors
Backerkit to the Future with Maxwell Salzberg

The New Disruptors

Play Episode Listen Later Jan 30, 2014 71:11


Maxwell Salzberg of BackerKit knows what it's like to have a lot of people giving him money who want something in return: he and three colleagues credited the Diaspora project, one of Kickstarter's early blockbusters. He co-founded BackerKit with Rosanna Yau to help people with the problem of managing crowdfunding backers' responses and expectations. This episode is sponsored by Media Temple: Web hosting for artists, designers, and Web developers since 1998. Media Temple hosts beautiful websites and great ideas. Sign up with coupon code "tnd" to get 25% off your first month of hosting. We're also sponsored by Born SQL, who can help small- and medium-sized businesses who use Microsoft SQL Server without a dedicated database administrator. New Disruptors' listeners can get a Cdn$750 discount on Born SQL's analysis report, which examines your instances and provides extensive, implementable recommendations about making improvements.