POPULARITY
This is a recap of the top 10 posts on Hacker News on July 23rd, 2024.This podcast was generated by wondercraft.ai(00:34): Open source AI is the path forwardOriginal post: https://news.ycombinator.com/item?id=41046773&utm_source=wondercraft_ai(01:48): Llama 3.1Original post: https://news.ycombinator.com/item?id=41046540&utm_source=wondercraft_ai(02:55): Intent to end OCSP serviceOriginal post: https://news.ycombinator.com/item?id=41046956&utm_source=wondercraft_ai(04:08): Database Design for Google Calendar: A TutorialOriginal post: https://news.ycombinator.com/item?id=41043371&utm_source=wondercraft_ai(05:30): You can opt out of airport face scansOriginal post: https://news.ycombinator.com/item?id=41051327&utm_source=wondercraft_ai(06:47): The Unix Pipe Card GameOriginal post: https://news.ycombinator.com/item?id=41047110&utm_source=wondercraft_ai(07:54): A free tool to quickly detect counterfeit flash (2017)Original post: https://news.ycombinator.com/item?id=41046397&utm_source=wondercraft_ai(09:08): The Linux audio stack demystified (and more)Original post: https://news.ycombinator.com/item?id=41042753&utm_source=wondercraft_ai(10:37): Types as InterfacesOriginal post: https://news.ycombinator.com/item?id=41043568&utm_source=wondercraft_ai(11:51): How Olympics officials try to catch “motor doping”Original post: https://news.ycombinator.com/item?id=41049399&utm_source=wondercraft_aiThis is a third-party project, independent from HN and YC. Text and audio generated using AI, by wondercraft.ai. Create your own studio quality podcast with text as the only input in seconds at app.wondercraft.ai. Issues or feedback? We'd love to hear from you: team@wondercraft.ai
One of the interesting things that I see at Redgate Software is how idealistic our developers and engineers can be. They often build our database DevOps products with the idea that customers will use well-designed databases. The systems will have primary keys, foreign keys, defaults, constraints, indexes, and more. Developers will use coding standards, and naming conventions, and will understand what data is stored in tables. Not in every case, but often. After all, that's how we build software, as teams, sharing information, publishing documentation for others, and following best practices. Read the rest of Poor Database Design Realities
In Elixir Wizards Office Hours Episode 2, "Discovery Discoveries," SmartLogic's Project Manager Alicia Brindisi and VP of Delivery Bri LaVorgna join Elixir Wizards Sundi Myint and Owen Bickford on an exploratory journey through the discovery phase of the software development lifecycle. This episode highlights how collaboration and communication transform the client-project team dynamic into a customized expedition. The goal of discovery is to reveal clear business goals, understand the end user, pinpoint key project objectives, and meticulously document the path forward in a Product Requirements Document (PRD). The discussion emphasizes the importance of fostering transparency, trust, and open communication. Through a mutual exchange of ideas, we are able to create the most tailored, efficient solutions that meet the client's current goals and their vision for the future. Key topics discussed in this episode: Mastering the art of tailored, collaborative discovery Navigating business landscapes and user experiences with empathy Sculpting project objectives and architectural blueprints Continuously capturing discoveries and refining documentation Striking the perfect balance between flexibility and structured processes Steering clear of scope creep while managing expectations Tapping into collective wisdom for ongoing discovery Building and sustaining a foundation of trust and transparency Links mentioned in this episode: https://smartlogic.io/ Follow SmartLogic on social media: https://twitter.com/smartlogic Contact Bri: bri@smartlogic.io What is a PRD? https://en.wikipedia.org/wiki/Productrequirementsdocument Special Guests: Alicia Brindisi and Bri LaVorgna.
Today, we have Eric Daimler, the CEO and co-founder of Conexus AI. Conexus AI serves as a hybrid generative AI platform, facilitating reliable and rapid digital modernization, empowering enterprises to seamlessly migrate, integrate, and transform their IT systems. In this episode, we delve into the utilization of category algebra to implement a domain-driven approach to interoperability. This approach focuses on computing the optimal data model rather than relying on manual design. Additionally, we explore the common issue of architects misunderstanding the practical structure of databases, leading to the failure of IT programs, as opposed to adhering to their originally intended structures. Key Discussion Points: What key concepts, such as data mesh and strategies, should companies consider when building the right architecture to effectively leverage their data assets? How does Conexus AI help companies facing decentralized data challenges? What does the before-and-after scenario look like in terms of data usage and outcomes? To learn more about our guest, you can find him at: Website: https://conexus.com/ LinkedIn: https://www.linkedin.com/in/ericdaimler/
Welcome to 'FileMaker 2023 Unveiled: Revolutionizing Database Design and Beyond!' - your go-to source for everything FileMaker 2023. Join us as we dive into the exciting new features of this game-changing release with the experts at Portage Bay Solutions. Get an insider's perspective through exclusive interviews with Rick Kalman, Director of Project Management at Claris, and Ronnie Rios, Product Owner for Claris Connect. Together, they'll unveil the innovative enhancements and breakthrough integrations that make FileMaker 2023 a truly transformative tool for businesses and individuals alike. Don't miss this opportunity to learn from the minds behind the software that's redefining database management and collaboration. Tune in, and stay ahead of the curve with FileMaker 2023!
Meet Dr. Derashay Zorn, a remarkable woman who overcame incredible odds to achieve her dreams. At just 22 years old, she was a single mother of three young children with only an 8th-grade education. Despite the challenges she faced, she refused to let her circumstances define her.Determined to create a better life for herself and her children, she made the decision to pursue her GED. She took it one class at a time, juggling her studies with the demands of motherhood and working multiple jobs to make ends meet. But she never gave up.Over time, Dr. Zorn continued to push herself to new heights. She earned her associate's degree, then her bachelor's, and eventually her master's. And that wasn't enough for her - she went on to earn her PhD, becoming an expert in her field.But her journey didn't end there. Dr. Zorn went on to start several thriving businesses, using her knowledge and expertise to make a positive impact in her community and beyond. She is a shining example of what's possible when you have the courage to dream big and the determination to make those dreams a reality.Today, Dr. Zorn is an inspiration to many - not just for what she's accomplished, but for the way she's accomplished it. She never let her circumstances hold her back, and she never lost sight of what was important to her. Her story is a testament to the power of resilience, hard work, and perseverance.https://www.derashayzorn.com/ Go check out all of our episodes on our website: https://womeninthearena.net/If you are ready to tell your story or want to refer someone, please email me at audra@womeninthearena.net ***Last thing- I'd love to interview the following women: Joan Jett Dolly Parton Viola Davis Ina Garten Maybe you can help me get there****Thank you all for supporting this show and all of the Women in the Arena!!
Want to prepare high school students for the App Economy? In this week's episode, we are highlighting a past webinar we held for Month of Swift. We were privileged to learn from Virginia educator, Alex Leonard. Alex holds a bachelor's degree in Computer Science and a Master's Degree in School Law and Policy Studies, and has been an educator of computer science courses for over 16 years. He's taught postsecondary and secondary dual enrollment courses in Programming, Game Design, Database Design and Sciences, Cybersecurity, Networking and Web Development and Design. Additionally, he's taught middle school STEAM courses which lead into the computer science and engineering courses available in his school district. Currently, he's coaching a FIRST Lego League (FLL), FIRST Tech Challenge (FTC) robotics, and PUNCH autonomous drone teams for Carroll County Middle and High Schools. Alex believes that education is more than just content, education is building life-long skills that are the foundation of successful individuals. The teacher's role should be that of a coach, guiding students to learn the content. As industry and culture change, so should teaching methods. Alex embraces change and adapts his teaching to suit the needs of his individual students. Alex shares his perspective of the App Development with Swift program. He talked about how he gets his students excited and engaged with app development, how he showcases his students work, and his advice for fellow coding teachers. Get more ideas on our blog: https://certiport.pearsonvue.com/Blog/2021/September/Getting-Your-Students-Excited-about-Coding. You can also learn more about the App Development with Swift program here: https://certiport.pearsonvue.com/Blog/2021/August/Prepare-Students-for-the-App-Economy-with-Swift Podcast is edited and managed by Haili Murch LLC. If you are interested in starting a podcast or you are currently a podcaster needing help managing or relaunching your podcast, you may email Haili Murch at hello@hailimurch.com or you can click here to book a call: https://calendly.com/hailimurch/podcast-discovery-call
William H. Inmon (born 1945) is an American computer scientist, recognized by many as the father of the data warehouse. Inmon wrote the first book, held the first conference (with Arnie Barnett), wrote the first column in a magazine and was the first to offer classes in data warehousing. Inmon created the accepted definition of what a data warehouse is - a subject-oriented, nonvolatile, integrated, time-variant collection of data in support of management's decisions. Compared with the approach of the other pioneering architect of data warehousing, Ralph Kimball, Inmon's approach is often characterized as a top-down approach. 00:00 Intro 01:17 From failed Golf Career to a Computing one 03:06 Originality, Patterns & Database Design 04:37 Punch Cards, Magnetic Tapes, Fortran, Cobalt & Bits in IBM 1401s 11:16 First Book with Arnie Barnett, First Conference & Peer Pressure from Vendors 14:26 Winning over Marketing & Sales People vs IT Departments 18:15 Rise & Fall of IBM, Arrogance, Rudeness & Apathetic Company 20:04 Prism Solutions & Early Days of Data Warehousing, Dormant Data & Textual ETL 30:20 Corporate Information Factory, DataMarts & ETL 32:00 Inmon vs Kimball Approach of Data Architecture, Good, Bad & the Worse 36:15 Data Reliability with Data Marts vs Centralised Data Warehouse 39:00 Staging Area in Kimball System vs Vetting the Data 41:00 Metadata, Beethoven & Importance of Metadata, 45:00 Prolific Writing, Family of Writers & Edgar Allan Poe. Hated Writing in College 48:51 Writing Course at Stanford, Fiction & Technical Communication 51:16 Fiction Published Work & Posthumous Publishing 57:03 ELT vs ETL, Data Needs Work. Computing Power and Data Transformation 01:01:31 Big Data, Data Creation Speed & Future of Data Warehousing 01:04:06 Textual ETL, MIT Symposium & Text Data Utilisation Algorithms, Medical Research & COVID 19 01:13:45 Transformers, NLP, Graph Learning & Unfair Criticism & Animosity 01:23:56 Dotcom Bubble, Gartner's Hype Curve, Theranos and Deception 01:29:45 Venture Capitalists are not Smart People, they are Rich People. 01:35:31 Cloud Computing vs Local DWHs 01:38:06 Databricks vs Snowflake 01:42:03 Not a Book Reader, Carving your Own Path 01:45:56 Travelling to 59 Countries, Experiencing Culture & Interesting Interactions 01:50:00 From California to Colorado, Nature in the Rockies & Life Follow us: Full Episodes Playlist link: https://bit.ly/3p2oWJA Clips Playlist link: https://bit.ly/3p0Qmzs Apple Podcasts: https://apple.co/3v0YZxV Google: https://bit.ly/3s5vDwc Spotify: https://spoti.fi/3H6jqf0 Who is Minhaaj? Minhaaj Rehman is CEO & Chief Data Scientist of Psyda Solutions, an AI-enabled academic and industrial research agency focused on psychographic profiling and value generation through machine learning and deep learning. CONNECT WITH Minhaaj ✩ Website - https://bit.ly/3LMvwgT ✩ Minhaaj Podcast - https://bit.ly/3H8MK4G ✩ Twitter - https://bit.ly/3v3t1RJ ✩ Facebook - https://bit.ly/3sV0XgE ✩ ResearchGate - https://bit.ly/3I6BvLu ✩ Linkedin - https://bit.ly/3v3FswQ ✩ Buy Me a Coffee (I love it!) - https://bit.ly/3JCMAnO --- Send in a voice message: https://anchor.fm/minhaaj/message
10/12/11 - Something clicked with Normal Form with Database Design today. 10/13/11 - Setting up the new Cluster Printers on Macs. 10/14/11 - Some stuff on card counting (from the movie Holy Rollers) Holy Rollers (2010) (with Eisenberg) | Holy Rollers: The True Story of Card Counting Christians (2011) (IMDB) | RottenTomatoes| 11th Annual NH Film Festival 10/15/11 - The old LoL installer/patcher will still update to the latest version. That, and some Windows 8 stuff. Video comparison of old/new League launcher | Microsoft's strange, passive-aggressive "Mojave Experiment." | Microsoft to switch internal focus to Windows 8 in July 2010| Microsoft starts to talk Windows 8, all but confirms App Store| Hands-on with Windows 8: A PC operating system for the tablet age 10/17/11 - About the Kenny Barron Jazz Trio Kenny Barron Jazz Trio – Gretna Music | Kenny Barron Bio| Kenny Barron Trio concert on YouTube 10/19/11 - "Bleach is mostly water, and we are mostly water, therefore, we are Bleach"—Metalocalypse Metalocalypse – Trick the Doctor | DethHealth 10/21/11 - Xsan upgrade process for Lion upgrade. Apple Lion Press Release | Xsan 2.3 Guide | Lion Server – MacUpdate 10/22/11 - What "Edward Fortyhands" is. Time Well Managed Means Excluding Edward Forty-Hands| EDWARD FORTYHANDS (ft. Mamrie Hart) Extra Topic: Madison Who's Who Scam Extra Topic: Haunted Overload This episode's music comes from archive.org, YouTube, and the Free Music Archive Tracks featured in this episode include: -Kevin MacLeod - Babylon [ Kevin MacLeod (incompetech.com) | Licensed under Creative Commons: By Attribution 3.0 | http://creativecommons.org/licenses/by/3.0/ ] -Kevin MacLeod - Backed Vibes Clean -Kevin MacLeod - Bicycle -Doctor Turtle - Flush Your Rolex -Kevin MacLeod - Soporific -TrackTribe - A Brand New Start -Kevin MacLeod - Eastminster -Kevin MacLeod - AcidJazz Doctor Turtle - Which That Is This (Long Version)
Ben Nichols is the Head of Product at IMS, Inc. Based in Liverpool, New York, IMS, Inc. is a fully integrated service provider of Conversational AI, Robotic Process Automation (RPA), Payments, Print, Electronic, and Mobile Communications. Ben is also an Adjunct Professor of Data Science at Syracuse University, where he conducts lectures on Natural Language Processing, Database Design, and Scripting for Data Science. Prior to that, Ben was Senior Director of Customer Insights at CB4, an AI tool that helps retailers uncover and fix the costliest in-store issues. At CB4, Ben led a team of insights managers, sales solution architects, and data engineers who were responsible for multi-million dollar customer retention, customer upsells, and fulfilling new revenue goals. Before CB4, Ben worked in multiple data intelligence and business analytics roles at organizations like IBM and Morgan Stanley. In this exclusive episode, Ben Nichols shares with us the following aspects of his life and career: Talking from his past experience, he shares with us his views on the differences between working at a large organization vs working at a startup. What are the current capabilities of Natural Language Processing (NLP) and chatbots How cross-channel integration can be fostered using NLP for enhanced customer experience. What are the avenues of NLP Beyond chatbots? Ben Nichols https://www.linkedin.com/in/ben-nichols/ The Data Standard is a community of data scientists, architects, engineers, and enthusiasts. In addition to regular podcasts, we host monthly events, publish through leadership pieces, and offer a stimulating ecosystem for networking and collaboration. https://datastandard.io https://www.linkedin.com/company/the-data-standard https://www.youtube.com/channel/UCTuolowXD05RY9DkIWqRT6Q
Ben Nichols is the Head of Product at IMS, Inc. Based in Liverpool, New York, IMS, Inc. is a fully integrated service provider of Conversational AI, Robotic Process Automation (RPA), Payments, Print, Electronic, and Mobile Communications. Ben is also an Adjunct Professor of Data Science at Syracuse University, where he conducts lectures on Natural Language Processing, Database Design, and Scripting for Data Science. Prior to that, Ben was Senior Director of Customer Insights at CB4, an AI tool that helps retailers uncover and fix the costliest in-store issues. At CB4, Ben led a team of insights managers, sales solution architects, and data engineers who were responsible for multi-million dollar customer retention, customer upsells, and fulfilling new revenue goals. Before CB4, Ben worked in multiple data intelligence and business analytics roles at organizations like IBM and Morgan Stanley. In this exclusive episode, Ben Nichols shares with us the following aspects of his life and career:Talking from his past experience, he shares with us his views on the differences between working at a large organization vs working at a startup.What are the current capabilities of Natural Language Processing (NLP) and chatbotsHow cross-channel integration can be fostered using NLP for enhanced customer experience.What are the avenues of NLP Beyond chatbots?Ben Nicholshttps://www.linkedin.com/in/ben-nichols/ The Data Standard is a community of data scientists, architects, engineers, and enthusiasts. In addition to regular podcasts, we host monthly events, publish through leadership pieces, and offer a stimulating ecosystem for networking and collaboration. https://datastandard.iohttps://www.linkedin.com/company/the-data-standardhttps://www.youtube.com/channel/UCTuolowXD05RY9DkIWqRT6Q
Barbara VanKirk is the CEO and founder of IQ Inc. She has spent the last 28 years creating company value by providing the vision, leadership, strategy, and general management skills necessary to grow IQ Inc into a dominant player in Pittsburgh's tech ecosystem. IQ Inc helps its clients with expert consulting, staffing, project management and software development services. They serve clients across financial services, transportation, and medical device with Software Design & Development, Software Q/A Testing, Product Development, System Integration, Technical Writing, and Database Design. In this episode, Barbara and Aaron discuss how she bootstrapped the company, how to hire tech talent, and why her company has stood the test of time. Sign up for a Weekly Email that will Expand Your Mind. Barbara VanKirk's Challenge; Learn something new, Give back, Seek feedback, Stay hungry Connect with Barbara VanKirk Linkedin IQ-Inc Website If you liked this interview, check out episode 438 with Ben Wilson where we discuss building a computer software consultancy. Text Me What You Think of This Episode 412-278-7680 Underwritten by Piper Creative Piper Creative makes creating podcasts, vlogs, and videos easy. How? Click here and Learn more. We work with Fortune 500s, medium-sized companies, and entrepreneurs. Follow Piper as we grow YouTube Instagram Subscribe on iTunes | Stitcher | Overcast | Spotify
Ben Nichols is the Head of Product at IMS, Inc. Based in Liverpool, New York, IMS, Inc. is a fully integrated service provider of Conversational AI, Robotic Process Automation (RPA), Payments, Print, Electronic, and Mobile Communications. Ben is also an Adjunct Professor of Data Science at Syracuse University, where he conducts lectures on Natural Language Processing, Database Design, and Scripting for Data Science. Prior to that, Ben was Senior Director of Customer Insights at CB4, an AI tool that helps retailers uncover and fix the costliest in-store issues. At CB4, Ben led a team of insights managers, sales solution architects, and data engineers who were responsible for multi-million dollar customer retention, customer upsells, and fulfilling new revenue goals. Before CB4, Ben worked in multiple data intelligence and business analytics roles at organisations like IBM and Morgan Stanley. In this exclusive episode, Ben Nichols shares with us the following aspects of his life and career: Talking from his past experience, he shares with us his views on the differences between working at a large organization vs working at a startup. He also explains a few pros and cons for each scenario. The state of the sync between academia and the industry in terms of developing data talents. What are the challenges that academia faces in this regard? How conversational AI and hyper-automation technologies are being used in the financial sector. What are the real-life benefits the credit unions and community banks are getting from this technology? How other industries can also use and benefit from these same tools and technology. Ben also shares his philosophy on product development and management and why we always need to see the bigger picture. What are the current capabilities of Natural Language Processing (NLP) and chatbots How cross-channel integration can be fostered using NLP for enhanced customer experience. What are the avenues of NLP Beyond chatbots? If you are a senior executive working on utilizing NLP technologies for enhancing your customer experience, or if you are an engineer working in analytics product development and management, this is the episode you should not miss! More links about the guest LinkedIn: https://www.linkedin.com/in/ben-nichols/ What is one book that he would gift to his younger self: How to Read a Book: The Classic Guide to Intelligent Reading by Mortimer J. Adler and Charles Van Doren https://www.goodreads.com/book/show/567610.How_to_Read_a_Book Organisation: https://imsdirect.com/ BusinessAnalytics, CustomerExperience, DataScience, NaturalLanguageProcessing(NLP), ProductDevelopment, ArtificialIntelligence(AI), MachineLearning(ML), DataAnalytics --- Send in a voice message: https://anchor.fm/analyticsshow/message
Pramod Sadalage co-authored the book Refactoring Databases 15 years ago. The concepts remain hugely relevant today for those exploring microservices. We caught up with Pramod and Martin Fowler to hear about the genesis of the book and explore how the principles of refactoring work in a world of NoSQL databases.
Guest Mr Juan Miguel de Guia of YoungCTO Rafi Quisumbing HP-UX Administration Software Development Project Management Information Technology Infrastructure Library LINKEDIN: https://www.linkedin.com/in/juan-migu... TWITCH: http://www.twitch.tv/CrowKuchiki TECHNICAL SKILLS Programming and Web Development: Assembly Programming, C++, C# Computer Hardware Troubleshooting Database Management: Microsoft SQL Server Multimedia and Office Applications: Adobe Photoshop and Dreamweaver, Microsoft Office Applications. Project Management : Microsoft Project AWARDS AND ACHIEVEMENTS Center for Student Advising Top 1 Peer Adviser (4th year College : 1st Semester SY 2012-2013) Center for Student Advising Top 4 Peer Adviser (4th year College : 2nd Semester SY 2012-2013) Center for Student Advising Top 7 Peer Adviser (4th year College : 3rd Semester SY 2012-2013) Microsoft Student Partner Junior (SY 2013-2014) RESEARCH PAPERS AND PROJECTS HANDLED Thesis Project: Securing Information through Speaker Recognition Model (On-going) Course Projects: POS with Inventory Tracker System (Windows-based Application): Prototype Design and Programming, Database Design, Documentation Game Tournament Tracker for the Filipino Fighting Game Community (Windows-based Application): Prototype Design, Database Design Philippine Tourist Attraction Website (HTML Coded-Site): Prototype Web Design, Documentation Movie Reservation System (Windows-based Application): Prototype Design and Programming, Documentation C++ Hangman Game (Console-based Application): Prototype Game Design and Programming, Documentation C++ Tic Tac Toe Game (Console-based Application): Prototype Game Design and Programming, Documentation TRAININGS AND SEMINARS ATTENDED Peer Advisers : Strategize your way to success (November 2012) Microsoft Start-App Intense 2013 (February 2013) Peer Advisers: Espirit de Corps 2 (March 2013 ) Web Development (August 2013) Open Cloud using Windows Azure (August 2013) Privileged Accounts (September 2013) Big Data (September 2013) Distributed.Net Application Development Using WCF (September 2013)
This episode is brought to you by LedgerLink.Here's the question Jeremy asked a long time ago.The book Database Design for Mere Mortals is an excellent read about all things data Structure.
Episode 015 "Database Design to No SQL" I have some fun with the CEO and Founder of RavenDB, Oren Eini @ayende from Israel having him on the fly on the podcast teach me how No SQL works, what it is and why you would consider it. Oren just goes into this overview of the evolution of the PC, it's really cool and it really sets the stage for having you think, how many times is my application making my hard drive spin and could it and should it be spinning much less with a better meta data dictionary and maybe there's something to this million little databases... and what you can do with the Cloud and Strawberries, you just have to listen to find out more!
Often when we walk into a client with an existing software system, it’s quickly evident that their database design leaves something to be desired. In this interview, Eric Strom from Covering Data Consulting and I discuss when it’s time to tune up your database, and some of the concepts you can implement when you’re creating a […]
After 170 episodes, we bring back Louis Davidson to talk about database design and get his thoughts on how we can get better at planning for our data. The show notes for today's episode can be found at http://sqldatapartners.com/2019/10/16/episode-178-database-design. Have fun on the SQL Trail!
Frank and Andy talked about doing a Deep Dive show where they take a deep look into a particular data science technology, term, or methodology. And now, they deliver! In this very first Deep Dive, Frank and Andy discuss the differences between Data Science and Data Engineering, where they overlap, where they differ, and why so many C-level execs can’t seem to figure out the deltas. Links Sponsor: Audible.com (http://thedatadrivenbook.com) – Get a free audio book when you sign up for a free trial! Sponsor: Enterprise Data & Analytics (https://entdna.com) Notable Quotes Frank’s new courses are up at WintellectNow ([01:30]) David Goggins (http://davidgoggins.com/) ([03:00]) Dive! Dive! Dive! It’s a deep dive on Data Science vs. Data Engineering ([06:00]) “Clean data” means different things to different people. ([09:30]) “Shaping the data.” ([11:00]) Our conversation with Buck Woody (http://datadriven.tv/buck_woody/) ([12:30]) Andy’s screed on managing NULLs ([14:00]) Andy’s screed on managing dupes ([17:00]) Frank, on aggregation and schema changes… ([21:21]) Attempted NoSQL definition ([23:45]) On MySQL… ([25:00]) Maybe “No” stands for “Not only” ([26:45]) “What sorcery is this?!” ([28:30]) Kevin Hazzard’s article on Database Design if we started today (https://blog.sqlauthority.com/2015/08/20/sql-server-rewriting-database-history-notes-from-the-field-094/) ([29:15]) Andy’s opinion: We’re not using the SSD-ness of SSD’s ([31:30]) “I don’t know how much simpler you can get.” – Andy ([33:00]) Denny Cherry’s company: Denny Cherry and Associates (https://www.dcac.co/) ([34:45]) “… somewhere between useless and lying…” ([35:45]) Frank on HDFS (https://hortonworks.com/apache/hdfs/) ([38:00]) ClearDB wiped out 13 years of Frank’s blog data, and we’re still bothered by that. ([40:30]) sklearn (http://scikit-learn.org/stable/) ([42:50]) Correlation is not causation. ([45:30]) How to Lie with Statistics (https://www.amazon.com/How-Lie-Statistics-Darrell-Huff/dp/0393310728/) ([45:45]) Movie/TV Reference: Star Trek TNG (http://www.imdb.com/title/tt0092455/) ([46:15]) CNTK (Microsoft Cognitive Toolkit) (https://www.microsoft.com/en-us/cognitive-toolkit/) ([48:00]) Frank, on selling ice cream… ([49:25]) On over-fitting (https://machinelearningmastery.com/overfitting-and-underfitting-with-machine-learning-algorithms/) ([55:30]) Training the model ([56:30]) Request for feedback! ([57:30])
RR 314 DynamoDB on Rails with Chandan Jhunjhunwal Today's Ruby Rogues podcast features DynamoDB on Rails with Chandan Jhunjhunwal. DynamoDB is a NoSQL database that helps your team solve managing infrastructure issues like setup, costing and maintenance. Take some time to listen and know more about DynamoDB! [00:02:18] – Introduction to Chandan Jhunjhunwal Chanchan Jhunjhunwal is an owner of Faodail Technology, which is currently helping many startups for their web and mobile applications. They started from IBM, designing and building scalable mobile and web applications. He mainly worked on C++ and DB2 and later on, worked primarily on Ruby on Rails. Questions for Chandan [00:04:05] – Introduction to DynamoDB on Rails I would say that majority of developers work in PostgreSQL, MySQL or other relational database. On the other hand, Ruby on Rails is picked up by many startup or founder for actually implementing their ideas and bringing them to scalable products. I would say that more than 80% of developers are mostly working on RDBMS databases. For the remaining 20%, their applications need to capture large amounts of data so they go with NoSQL. In NoSQL, there are plenty of options like MongoDB, Cassandra, or DynamoDB. When using AWS, there’s no provided MongoDB. With Cassandra, it requires a lot of infrastructure setup and costing, and you’ll have to have a team which is kind of maintaining it on a day to day basis. So DynamoDB takes all those pain out of your team and you no longer have to focus on managing the infrastructure. [00:07:35] – Is it a good idea to start with a regular SQL database and then, switch to NoSQL database or is it better to start with NoSQL database from day one? It depends on a couple of factors. For many of the applications, they start with RDBMS because they just want to get some access, and probably switch to something like NoSQL. First, you have to watch the incoming data and their capacity. Second is familiarity because most of the developers are more familiar with RDBMS and SQL queries. For example, you have a feed application, or a messaging application, where you know that there will be a lot of chat happening and you’d expect that you’re going to take a huge number of users. You can accommodate that in RDBMS but I would probably not recommend that. [00:09:30] Can I use DynamoDB as a caching mechanism or cache store? I would not say replacement, exactly. On those segments where I could see that there’s a lot of activity happening, I plugged in DynamoDB. The remaining part of the application was handled by RDBMS. In many applications, what I’ve seen is that they have used a combination of them. [00:13:05] How do you decide if you actually want to use DynamoDB for all the data in your system? The place where we say that this application is going to be picked from day one is where the number of data which will be coming will increase. It also depends on the development team that you have if they’re familiar with DynamoDB, or any other NoSQL databases. [00:14:50] Is DynamoDB has document store or do you have of columns? You can say key value pairs or document stores. The terminologies are just different and the way you design the database. In DynamoDB, you have something like hash key and range key. [00:22:10] – Why don’t we store images in the database? I would say that there are better places to store the, which is faster and cheaper. There are better storage like CDN or S3. Another good reason is that if you want to fetch a proper size of image based on the user devices screen, resizing and all of the stuff inside the database could be cumbersome. You’ll repeat adding different columns where we’ll be storing those different sizes of images. [00:24:40] – Is there a potentially good reason for NoSQL database as your default go-to data store? If you have some data, which is complete unstructured, if you try to store back in RDBMS, it will be a pain. If we talk about the kind of media which gets generated in our day to day life, if you try to model them in a relational database, it will be pretty painful and eventually, there will be a time when you don’t know how to create correlations. [00:28:30] – Horizontally scalable versus vertically scalable In vertically scalable, when someone posts, we keep adding that at the same table. As we add data to the table, the database size increases (number of rows increases). But in horizontally scalable, we keep different boxes connected via Hadoop or Elastic MapReduce which will process the added data. [00:30:20] – What does it take to hook up a DynamoDB instance to a Rails app? We could integrate DynamoDB by using the SDK provided by AWS. I provided steps which I’ve outlined in the blog - how to create different kinds of tables, how to create those indexes, how to create the throughput, etc. We could configure AWS SDK, add the required credential, then we could create different kinds of tables. [00:33:00] – In terms of scaling, what is the limit for something like PostgreSQL or MySQL, versus DynamoDB? There’s no scalability limit in DynamoDB, or any other NoSQL solutions. Picks David Kimura CorgUI Jason Swett Database Design for Mere Mortals Charles Maxwood VMWare Workstation GoCD Ruby Rogues Parley Ruby Dev Summit Chandan Jhunjhunwal Twitter @ChandanJ chandan@faodailtechnology.com
RR 314 DynamoDB on Rails with Chandan Jhunjhunwal Today's Ruby Rogues podcast features DynamoDB on Rails with Chandan Jhunjhunwal. DynamoDB is a NoSQL database that helps your team solve managing infrastructure issues like setup, costing and maintenance. Take some time to listen and know more about DynamoDB! [00:02:18] – Introduction to Chandan Jhunjhunwal Chanchan Jhunjhunwal is an owner of Faodail Technology, which is currently helping many startups for their web and mobile applications. They started from IBM, designing and building scalable mobile and web applications. He mainly worked on C++ and DB2 and later on, worked primarily on Ruby on Rails. Questions for Chandan [00:04:05] – Introduction to DynamoDB on Rails I would say that majority of developers work in PostgreSQL, MySQL or other relational database. On the other hand, Ruby on Rails is picked up by many startup or founder for actually implementing their ideas and bringing them to scalable products. I would say that more than 80% of developers are mostly working on RDBMS databases. For the remaining 20%, their applications need to capture large amounts of data so they go with NoSQL. In NoSQL, there are plenty of options like MongoDB, Cassandra, or DynamoDB. When using AWS, there’s no provided MongoDB. With Cassandra, it requires a lot of infrastructure setup and costing, and you’ll have to have a team which is kind of maintaining it on a day to day basis. So DynamoDB takes all those pain out of your team and you no longer have to focus on managing the infrastructure. [00:07:35] – Is it a good idea to start with a regular SQL database and then, switch to NoSQL database or is it better to start with NoSQL database from day one? It depends on a couple of factors. For many of the applications, they start with RDBMS because they just want to get some access, and probably switch to something like NoSQL. First, you have to watch the incoming data and their capacity. Second is familiarity because most of the developers are more familiar with RDBMS and SQL queries. For example, you have a feed application, or a messaging application, where you know that there will be a lot of chat happening and you’d expect that you’re going to take a huge number of users. You can accommodate that in RDBMS but I would probably not recommend that. [00:09:30] Can I use DynamoDB as a caching mechanism or cache store? I would not say replacement, exactly. On those segments where I could see that there’s a lot of activity happening, I plugged in DynamoDB. The remaining part of the application was handled by RDBMS. In many applications, what I’ve seen is that they have used a combination of them. [00:13:05] How do you decide if you actually want to use DynamoDB for all the data in your system? The place where we say that this application is going to be picked from day one is where the number of data which will be coming will increase. It also depends on the development team that you have if they’re familiar with DynamoDB, or any other NoSQL databases. [00:14:50] Is DynamoDB has document store or do you have of columns? You can say key value pairs or document stores. The terminologies are just different and the way you design the database. In DynamoDB, you have something like hash key and range key. [00:22:10] – Why don’t we store images in the database? I would say that there are better places to store the, which is faster and cheaper. There are better storage like CDN or S3. Another good reason is that if you want to fetch a proper size of image based on the user devices screen, resizing and all of the stuff inside the database could be cumbersome. You’ll repeat adding different columns where we’ll be storing those different sizes of images. [00:24:40] – Is there a potentially good reason for NoSQL database as your default go-to data store? If you have some data, which is complete unstructured, if you try to store back in RDBMS, it will be a pain. If we talk about the kind of media which gets generated in our day to day life, if you try to model them in a relational database, it will be pretty painful and eventually, there will be a time when you don’t know how to create correlations. [00:28:30] – Horizontally scalable versus vertically scalable In vertically scalable, when someone posts, we keep adding that at the same table. As we add data to the table, the database size increases (number of rows increases). But in horizontally scalable, we keep different boxes connected via Hadoop or Elastic MapReduce which will process the added data. [00:30:20] – What does it take to hook up a DynamoDB instance to a Rails app? We could integrate DynamoDB by using the SDK provided by AWS. I provided steps which I’ve outlined in the blog - how to create different kinds of tables, how to create those indexes, how to create the throughput, etc. We could configure AWS SDK, add the required credential, then we could create different kinds of tables. [00:33:00] – In terms of scaling, what is the limit for something like PostgreSQL or MySQL, versus DynamoDB? There’s no scalability limit in DynamoDB, or any other NoSQL solutions. Picks David Kimura CorgUI Jason Swett Database Design for Mere Mortals Charles Maxwood VMWare Workstation GoCD Ruby Rogues Parley Ruby Dev Summit Chandan Jhunjhunwal Twitter @ChandanJ chandan@faodailtechnology.com
RR 314 DynamoDB on Rails with Chandan Jhunjhunwal Today's Ruby Rogues podcast features DynamoDB on Rails with Chandan Jhunjhunwal. DynamoDB is a NoSQL database that helps your team solve managing infrastructure issues like setup, costing and maintenance. Take some time to listen and know more about DynamoDB! [00:02:18] – Introduction to Chandan Jhunjhunwal Chanchan Jhunjhunwal is an owner of Faodail Technology, which is currently helping many startups for their web and mobile applications. They started from IBM, designing and building scalable mobile and web applications. He mainly worked on C++ and DB2 and later on, worked primarily on Ruby on Rails. Questions for Chandan [00:04:05] – Introduction to DynamoDB on Rails I would say that majority of developers work in PostgreSQL, MySQL or other relational database. On the other hand, Ruby on Rails is picked up by many startup or founder for actually implementing their ideas and bringing them to scalable products. I would say that more than 80% of developers are mostly working on RDBMS databases. For the remaining 20%, their applications need to capture large amounts of data so they go with NoSQL. In NoSQL, there are plenty of options like MongoDB, Cassandra, or DynamoDB. When using AWS, there’s no provided MongoDB. With Cassandra, it requires a lot of infrastructure setup and costing, and you’ll have to have a team which is kind of maintaining it on a day to day basis. So DynamoDB takes all those pain out of your team and you no longer have to focus on managing the infrastructure. [00:07:35] – Is it a good idea to start with a regular SQL database and then, switch to NoSQL database or is it better to start with NoSQL database from day one? It depends on a couple of factors. For many of the applications, they start with RDBMS because they just want to get some access, and probably switch to something like NoSQL. First, you have to watch the incoming data and their capacity. Second is familiarity because most of the developers are more familiar with RDBMS and SQL queries. For example, you have a feed application, or a messaging application, where you know that there will be a lot of chat happening and you’d expect that you’re going to take a huge number of users. You can accommodate that in RDBMS but I would probably not recommend that. [00:09:30] Can I use DynamoDB as a caching mechanism or cache store? I would not say replacement, exactly. On those segments where I could see that there’s a lot of activity happening, I plugged in DynamoDB. The remaining part of the application was handled by RDBMS. In many applications, what I’ve seen is that they have used a combination of them. [00:13:05] How do you decide if you actually want to use DynamoDB for all the data in your system? The place where we say that this application is going to be picked from day one is where the number of data which will be coming will increase. It also depends on the development team that you have if they’re familiar with DynamoDB, or any other NoSQL databases. [00:14:50] Is DynamoDB has document store or do you have of columns? You can say key value pairs or document stores. The terminologies are just different and the way you design the database. In DynamoDB, you have something like hash key and range key. [00:22:10] – Why don’t we store images in the database? I would say that there are better places to store the, which is faster and cheaper. There are better storage like CDN or S3. Another good reason is that if you want to fetch a proper size of image based on the user devices screen, resizing and all of the stuff inside the database could be cumbersome. You’ll repeat adding different columns where we’ll be storing those different sizes of images. [00:24:40] – Is there a potentially good reason for NoSQL database as your default go-to data store? If you have some data, which is complete unstructured, if you try to store back in RDBMS, it will be a pain. If we talk about the kind of media which gets generated in our day to day life, if you try to model them in a relational database, it will be pretty painful and eventually, there will be a time when you don’t know how to create correlations. [00:28:30] – Horizontally scalable versus vertically scalable In vertically scalable, when someone posts, we keep adding that at the same table. As we add data to the table, the database size increases (number of rows increases). But in horizontally scalable, we keep different boxes connected via Hadoop or Elastic MapReduce which will process the added data. [00:30:20] – What does it take to hook up a DynamoDB instance to a Rails app? We could integrate DynamoDB by using the SDK provided by AWS. I provided steps which I’ve outlined in the blog - how to create different kinds of tables, how to create those indexes, how to create the throughput, etc. We could configure AWS SDK, add the required credential, then we could create different kinds of tables. [00:33:00] – In terms of scaling, what is the limit for something like PostgreSQL or MySQL, versus DynamoDB? There’s no scalability limit in DynamoDB, or any other NoSQL solutions. Picks David Kimura CorgUI Jason Swett Database Design for Mere Mortals Charles Maxwood VMWare Workstation GoCD Ruby Rogues Parley Ruby Dev Summit Chandan Jhunjhunwal Twitter @ChandanJ chandan@faodailtechnology.com
In this episode of the SuperDataScience Podcast, I chat with my brother, QUT student Ilya Eremenko. You will hear insights about Generation Z, learn about data privacy and get more knowledge about SQL and database design. If you enjoyed this episode, check out show notes, resources, and more at https://www.superdatascience.com/20
I chat will Louis Davidson about database design and get his thoughts on some strategies about how to go about making your design and what tools are available to help you. It may surprise you that, according to Louis, the data type is not the most important component of database design. I hope you enjoy the show. Be sure to check out http://sqldatapartners.com/2015/09/08/episode-08-database-design/for the show notes.
Carl and Richard talk to the one-and-only Kim Tripp about physical database design - and why it's still important. The conversation starts out talking about the state of SQL Server today, its maturity and how it works well enough that it's often ignored until there are problems. Kim talks about a 30-day blog series written by the SQLSkills team about being an accidental DBA - you didn't want to take care of a SQL Server, you just are! Always fun to talk to Kim!Support this podcast at — https://redcircle.com/net-rocks/donations
Carl and Richard talk to the one-and-only Kim Tripp about physical database design - and why it's still important. The conversation starts out talking about the state of SQL Server today, its maturity and how it works well enough that it's often ignored until there are problems. Kim talks about a 30-day blog series written by the SQLSkills team about being an accidental DBA - you didn't want to take care of a SQL Server, you just are! Always fun to talk to Kim!Support this podcast at — https://redcircle.com/net-rocks/donations