Podcast appearances and mentions of jeremiah lowin

Podcast: Invest Like the Best with Patrick O'Shaughnessy (LS 67 · TOP 0.05% what is this?)Episode: Jeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307]Pub date: 2022-12-13My guest this week is Jeremiah Lowin. Jeremiah has been on the podcast a number of times over the years. He's one of my oldest friends who has been a sounding board for me throughout my career. Today he is the founder and CEO of Prefect, which helps companies automate and orchestrate their dataflows. In full disclosure, Positive Sum is an investor in Prefect. We didn't plan this conversation, but when OpenAI released ChatGPT, I called Jeremiah for a primer on what's happening under the hood and how best to contextualize this product amidst the growing AI movement. We have these conversations often, but this time I decided to record it so we can all learn from someone I consider to be a leading mind in the fields of data science and machine learning. We start off in the weeds and zoom out as the discussion unfolds. Please enjoy this conversation with my friend, Jeremiah Lowin. Listen to Founders podcast Founders Episode #136 A Success Story: Estee Lauder  Invest Like the Best with David Senra: Passion & Pain For the full show notes, transcript, and links to mentioned content, check out the episode page here. ----- This episode is brought to you by Tegus. Tegus streamlines the investment research process so you can get up to speed and find answers to critical questions on companies faster and more efficiently. The Tegus platform surfaces the hard-to-get qualitative insights, gives instant access to critical public financial data through BamSEC, and helps you set up customized expert calls. It's all done on a single, modern SaaS platform that offers 360-degree insight into any public or private company. As a listener, you can take Tegus for a free test drive by visiting tegus.co/patrick. ----- Today's episode is brought to you by Brex. Brex is the integrated financial platform trusted by the world's most innovative entrepreneurs and fastest-growing companies. With Brex, you can move money fast for instant impact with high-limit corporate cards, payments, venture debt, and spend management software all in one place. Ready to accelerate your business? Learn more at brex.com/best. ----- Invest Like the Best is a property of Colossus, LLC. For more episodes of Invest Like the Best, visit joincolossus.com/episodes.  Stay up to date on all our podcasts by signing up to Colossus Weekly, our quick dive every Sunday highlighting the top business and investing concepts from our podcasts and the best of what we read that week. Sign up here. Follow us on Twitter: @patrick_oshag | @JoinColossus Show Notes[00:03:38] - [First question] - What a pre-trained transformer is [00:06:12] - What latent representation means in the context of AI models [00:09:57] - Models using math to interpret input data and generate images accurately [00:11:43] - Whether or not understanding AI complexity in light of the results they arrive at will become a black box scenario [00:14:13] - A high level history of the companies involved in generative AI[00:17:51] - The precursory technology that makes generative AI art possible[00:21:01] - What people are doing to improve AI models in between versions [00:26:39] - Things that are literally happening during AI training[00:33:38] - Whether or not AI models might one day function as a utility like electricity[00:36:01] - Coding using GitHub Copilot and what it's felt like to use it [00:40:30] - How he'd approach starting an AI company from scratch [00:44:40] - Developing this technology beyond general and into specific use cases[00:49:44] - The secret sauce for defensibility in the AI model space [00:53:02] - What he's watching more closely as the story unfolds [00:56:32] - Whether or not he thinks that these toolkits will eventually learn how to use other systems like Unreal Engine on our behalf The podcast and artwork embedded on this page are from Colossus | Investing & Business Podcasts, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.

Podcast: Invest Like the Best with Patrick O'Shaughnessy (LS 67 · TOP 0.05% what is this?)Episode: Jeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307]Pub date: 2022-12-13My guest this week is Jeremiah Lowin. Jeremiah has been on the podcast a number of times over the years. He's one of my oldest friends who has been a sounding board for me throughout my career. Today he is the founder and CEO of Prefect, which helps companies automate and orchestrate their dataflows. In full disclosure, Positive Sum is an investor in Prefect. We didn't plan this conversation, but when OpenAI released ChatGPT, I called Jeremiah for a primer on what's happening under the hood and how best to contextualize this product amidst the growing AI movement. We have these conversations often, but this time I decided to record it so we can all learn from someone I consider to be a leading mind in the fields of data science and machine learning. We start off in the weeds and zoom out as the discussion unfolds. Please enjoy this conversation with my friend, Jeremiah Lowin.   Listen to Founders podcast   Founders Episode #136 A Success Story: Estee Lauder    Invest Like the Best with David Senra: Passion & Pain   For the full show notes, transcript, and links to mentioned content, check out the episode page here.   -----   This episode is brought to you by Tegus. Tegus streamlines the investment research process so you can get up to speed and find answers to critical questions on companies faster and more efficiently. The Tegus platform surfaces the hard-to-get qualitative insights, gives instant access to critical public financial data through BamSEC, and helps you set up customized expert calls. It's all done on a single, modern SaaS platform that offers 360-degree insight into any public or private company. I've been so impressed by the platform that my firm, Positive Sum, recently made an investment in Tegus. We did so because we feel that Tegus will be the gold standard platform for investing research for decades to come. As a listener, you can take Tegus for a free test drive by visiting tegus.co/patrick.   -----   Today's episode is brought to you by Brex. Brex is the integrated financial platform trusted by the world's most innovative entrepreneurs and fastest-growing companies. With Brex, you can move money fast for instant impact with high-limit corporate cards, payments, venture debt, and spend management software all in one place. Ready to accelerate your business? Learn more at brex.com/best.   -----   Invest Like the Best is a property of Colossus, LLC. For more episodes of Invest Like the Best, visit joincolossus.com/episodes.    Past guests include Tobi Lutke, Kevin Systrom, Mike Krieger, John Collison, Kat Cole, Marc Andreessen, Matthew Ball, Bill Gurley, Anu Hariharan, Ben Thompson, and many more.   Stay up to date on all our podcasts by signing up to Colossus Weekly, our quick dive every Sunday highlighting the top business and investing concepts from our podcasts and the best of what we read that week. Sign up here.   Follow us on Twitter: @patrick_oshag | @JoinColossus   Show Notes [00:03:38] - [First question] - What a pre-trained transformer is  [00:06:12] - What latent representation means in the context of AI models  [00:09:57] - Models using math to interpret input data and generate images accurately  [00:11:43] - Whether or not understanding AI complexity in light of the results they arrive at will become a black box scenario  [00:14:13] - A high level history of the companies involved in generative AI [00:17:51] - The precursory technology that makes generative AI art possible [00:21:01] - What people are doing to improve AI models in between versions  [00:26:39] - Things that are literally happening during AI training [00:29:44] - The power dynamics and barriers to entry for building AI models [00:33:38] - Whether or not AI models might one day function as a utility like electricity [00:36:01] - Coding using GitHub Copilot and what it's felt like to use it  [00:40:30] - How he'd approach starting an AI company from scratch  [00:44:40] - Developing this technology beyond general and into specific use cases [00:49:44] - The secret sauce for defensibility in the AI model space  [00:53:02] - What he's watching more closely as the story unfolds  [00:56:32] - Whether or not he thinks that these toolkits will eventually learn how to use other systems like Unreal Engine on our behalf The podcast and artwork embedded on this page are from Colossus | Investing & Business Podcasts, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.

My guest this week is Jeremiah Lowin. Jeremiah has been on the podcast a number of times over the years. He's one of my oldest friends who has been a sounding board for me throughout my career. Today he is the founder and CEO of Prefect, which helps companies automate and orchestrate their dataflows. In full disclosure, Positive Sum is an investor in Prefect. We didn't plan this conversation, but when OpenAI released ChatGPT, I called Jeremiah for a primer on what's happening under the hood and how best to contextualize this product amidst the growing AI movement. We have these conversations often, but this time I decided to record it so we can all learn from someone I consider to be a leading mind in the fields of data science and machine learning. We start off in the weeds and zoom out as the discussion unfolds. Please enjoy this conversation with my friend, Jeremiah Lowin.   Listen to Founders podcast   Founders Episode #136 A Success Story: Estee Lauder    Invest Like the Best with David Senra: Passion & Pain   For the full show notes, transcript, and links to mentioned content, check out the episode page here.   -----   This episode is brought to you by Tegus. Tegus streamlines the investment research process so you can get up to speed and find answers to critical questions on companies faster and more efficiently. The Tegus platform surfaces the hard-to-get qualitative insights, gives instant access to critical public financial data through BamSEC, and helps you set up customized expert calls. It's all done on a single, modern SaaS platform that offers 360-degree insight into any public or private company. I've been so impressed by the platform that my firm, Positive Sum, recently made an investment in Tegus. We did so because we feel that Tegus will be the gold standard platform for investing research for decades to come. As a listener, you can take Tegus for a free test drive by visiting tegus.co/patrick.   -----   Today's episode is brought to you by Brex. Brex is the integrated financial platform trusted by the world's most innovative entrepreneurs and fastest-growing companies. With Brex, you can move money fast for instant impact with high-limit corporate cards, payments, venture debt, and spend management software all in one place. Ready to accelerate your business? Learn more at brex.com/best.   -----   Invest Like the Best is a property of Colossus, LLC. For more episodes of Invest Like the Best, visit joincolossus.com/episodes.    Past guests include Tobi Lutke, Kevin Systrom, Mike Krieger, John Collison, Kat Cole, Marc Andreessen, Matthew Ball, Bill Gurley, Anu Hariharan, Ben Thompson, and many more.   Stay up to date on all our podcasts by signing up to Colossus Weekly, our quick dive every Sunday highlighting the top business and investing concepts from our podcasts and the best of what we read that week. Sign up here.   Follow us on Twitter: @patrick_oshag | @JoinColossus   Show Notes [00:03:38] - [First question] - What a pre-trained transformer is  [00:06:12] - What latent representation means in the context of AI models  [00:09:57] - Models using math to interpret input data and generate images accurately  [00:11:43] - Whether or not understanding AI complexity in light of the results they arrive at will become a black box scenario  [00:14:13] - A high level history of the companies involved in generative AI [00:17:51] - The precursory technology that makes generative AI art possible [00:21:01] - What people are doing to improve AI models in between versions  [00:26:39] - Things that are literally happening during AI training [00:29:44] - The power dynamics and barriers to entry for building AI models [00:33:38] - Whether or not AI models might one day function as a utility like electricity [00:36:01] - Coding using GitHub Copilot and what it's felt like to use it  [00:40:30] - How he'd approach starting an AI company from scratch  [00:44:40] - Developing this technology beyond general and into specific use cases [00:49:44] - The secret sauce for defensibility in the AI model space  [00:53:02] - What he's watching more closely as the story unfolds  [00:56:32] - Whether or not he thinks that these toolkits will eventually learn how to use other systems like Unreal Engine on our behalf 

Jeremiah Lowin (CEO/Co-Founder @ Prefect) joins the show to chat about why he's excited about boring tech, the current VC/startup environment, building trust, meetups, and much more. #dataengineering #prefect #data

Jeremiah Lowin is the founder & CEO of Prefect, a dataflow automation company. Jeremiah joins Jim for his second appearance on Infinite Loops to discuss executing, storytelling, artificial intelligence and, of course, puns. Important Links: Prefect.io Disney Research Hub The story of the fake statue of Venus Show Notes: Slack, puns and the Hitchhiker's Guide to the Galaxy Planning, executing and the story of Prefect in 2022 Why naming things is a superpower If you can't pivot, you're dead Make original mistakes AI, storytelling, deep fakes and open source Books Mentioned: The Hitchhiker's Guide to the Galaxy; by Douglas Adams What Works on Wall Street; by Jim O'Shaughnessy The Beginning of Infinity; by David Deutsch

Jeremiah Lowin is co-founder and CEO of Prefect, the company behind the popular open source data workflow orchestration system with the same name. We discussed the major design changes in Prefect 2.0, their move towards treating “code as workflows”, data engineering challenges facing data and ML teams today, and implications of looming trends in machine learning and AI.Download the FREE Report: State of Workflow Orchestration → https://www.prefect.io/lp/gradientflow?utm_source=gradientflow&utm_medium=newsletterSubscribe: Apple • Android • Spotify • Stitcher • Google • AntennaPod • RSS.Detailed show notes can be found on The Data Exchange web site.

This week's special guest is Jeremiah Lowin.  Jeremiah is the Founder and CEO of Prefect, which is a workflow management system that helps to eliminate data flow problems for companies' data teams. They provide a new dataflow automation platform that reduces engineering time by automating pipelines and workflows of any complexity. Prefect combines the convenience […]

Jeremiah Lowin and host Kelly Kohlleffel discuss how Prefect is making “dataflows as easy as .py.” Jeremiah is Co-Founder and CEO at Prefect where they are providing workflow management, orchestration, scheduling, and dataflow automation. Jeremiah and the team view Prefect as an insurance product. They provide the most value when something has gone wrong rather than when everything is working fine. Listen in to the episode to hear Jeremiah's story, how Prefect started and where they are today, and how they are eliminating the worry from data pipelines. Show Notes: Learn more about Prefect: https://www.prefect.io/about/company/ Take a sneak peek at Orion: https://www.prefect.io/orion/ Get started with Prefect: https://universal.prefect.io/signin/register Listen to Jeremiah's podcast explaining Crypto: https://www.businessinsider.com/bitcoin-podcast-explains-cryptocurrencies-2017-9 On tap for today's episode: Compass Coffee and Bulletproof Coffee Contact Us: https://www.hashmapinc.com/reach-out

Eric Anderson (@ericmander) and Douwe Maan (@DouweM) chat about Meltano, the open-source DataOps operating system. Meltano provides the connective tissue that allows teams to treat their data stack as a single software development project. Tune in to learn how Meltano is trying to bring software development best practices into the data world. In this episode we discuss: Meltano's origins as a side project at GitLab How Meltano glues together open-source technologies like Singer, dbt and Airflow Douwe's experience wearing many different hats in the early days of Meltano Meltano's shift from an ELT solution to an operating system The Love-Tap Fest community event, starting right after this episode's release! Links: Meltano Love-Tap Fest - February 17-24th, 2022 GitLab Singer dbt Apache Airflow Apache Superset Terraform People mentioned: Taylor Murphy (@tayloramurphy) AJ Steers (@aaronsteers) Other episodes: Great Expectations with Abe Gong and Kyle Eaton Dagster with Nick Schrock Prefect with Jeremiah Lowin

Before we get into the episode notes, I want to take a beat to thank all of you for supporting the Show over the last year. It's been amazing watching it go from a fun way to connect with some of my favorite folks in data to a full, polished podcast (featuring even more awesome people). We couldn't do it without you and I'm looking forward to giving the best and brightest of our industry the stage in the coming year. To kick things off with season 2, we have a great episode with Jeremiah Lowin, founder and CEO of dataflow automation tool Prefect. In this 1-hour, 7-minute episode, Jeremiah and I dive into the lessons that the wider data industry can learn from the experts in data finance. Some of the major points include: How he got his start in data finance The difference in reporting in terms of uncertainty vs outcomes The case for hearing/focusing on problems vs solutions Building non-political organizational culture Non-managerial growth in data careers As always, let me know what you think of the newest episode over on Twitter at @borisjabes. Resources: Prefect's Website: https://www.prefect.io/ Find Jeremiah on Twitter:https://twitter.com/jlowin Find Jeremiah on Linkedin: https://www.linkedin.com/in/jlowin/ Prefect's Linkedin: https://www.linkedin.com/company/prefect/ Prefect's Twitter: https://twitter.com/PrefectIO Music by the talented Joe Stevens: https://www.joestevenssound.com/ Know someone you think would make an awesome guest on the podcast (you can totally nominate yourself, too)? Send your suggestions to our content and community team.

Today we are re-sharing our Hash Power documentary. This series was originally released in September 2017 when 1 Bitcoin hovered around $4000 US Dollars. While so much has changed in the years since - these episodes are a great introduction into the technology, the power of decentralization, Bitcoin, Ethereum, ICO's, cryptography, and hashing. You will hear from a variety of industry experts throughout these episodes - please enjoy.   For the full show notes, transcript, and links to the best content to learn more, check out the episode page here.   ----   Original Intro (09.26.17)   Welcome to the first episode of Hash Power, an audio documentary that explores the world of blockchain and cryptocurrencies with leaders in the field like Naval Ravikant, Olaf Carlson-Wee, Fred Ehrsam, & Ari Paul. Hash Power is meant to be an introduction, but really, it is an invitation to explore this emerging world on your own.    We will cover the technology, the power of decentralization, bitcoin, Ethereum, ICOs, cryptography and hashing. We will spend time with the leading active hedge fund managers in the field, and with outside investors who are both optimistic and skeptical. Episode one covers the big picture, and answers the question: what is blockchain and why might it significantly affect our world?   -----   Web3 Breakdowns is a property of Colossus, LLC. For more episodes of Web3 Breakdowns, visit joincolossus.com/episodes.   Stay up to date on all our podcasts by signing up to Colossus Weekly, our quick dive every Sunday highlighting the top business and investing concepts from our podcasts and the best of what we read that week. Sign up here.   Follow us on Twitter: @Web3Breakdowns | @patrick_oshag | @JoinColossus   Show Notes: [00:03:25] – CHAPTER 1 – Understanding the Concept of Blockchain [00:04:30] – Jeremiah Lowin explains how blockchain is like a database [00:05:46] – Owning a digital asset [00:07:14] – Naval Ravikant, CEO of Angelist on how blockchains can help to create personal networks and organize humans [00:11:01] – How blockchains represent a way to coordinate global activity through tokens [00:13:33] – New coins popping up around data storage and utility needs like solar panels [00:14:57] – Permission vs permissionless networks [00:16:37] – Protocols and the introduction of scarcity [00:18:13] – Keeping track of scarcity and the introduction of tokens [00:18:49] – Societal structures and how blockchains will change them again [00:21:55] – The role of blockchains in the informational age and the rise of more individual sovereignty [00:23:29] – Fred Ehrsam, co-founder of Coinbase, on the increasing shift to digital worlds led by incentive structures [00:27:48] – CHAPTER 2 – Blockchain Technology [00:31:53] – Charlie Noyes, Pantera Capital, explains how SHA-256 was developed and what makes it so special [00:35:48] – How miners create new blocks and the incentives to do so [00:40:22] – The nonce field [00:43:48] – The incentives that exist for miners and the arms race to build more powerful systems to mine [00:45:20] – The development of mining pools [00:46:54] – Ethereum, the “spiritual successor” to bitcoin [00:48:36] – How the Ether network is an ecosystem in which other tokens can sit [00:50:51] – Naval Ravikant on alternative coins or tokens [00:51:37] – How the protocol creators are the ones getting wealthy [00:52:43] – Blockchain as an experiment in distributed government [00:54:10] – How cryptocurrency is more than just technology, it's a movement [01:00:07] – Peter Jubber, of Fidelity, on how huge institutions, like theirs, are getting into the cryptocurrency game [01:03:34] – The notion of cooperation in an open-source project or protocol [01:04:39] – Olaf Carlson-Wee, the first employee at Coinbase and the founder of Polychain, on the early excitement for cryptocurrency

Today we are re-sharing our Hash Power documentary. This series was originally released in September 2017 when 1 Bitcoin hovered around $4000 US Dollars. While so much has changed in the years since - these episodes are a great introduction to the technology, the power of decentralization, Bitcoin, Ethereum, ICO's, cryptography, and hashing. You will hear from a variety of industry experts throughout these episodes - please enjoy.   For the full show notes, transcript, and links to the best content to learn more, check out the episode page here.    ----   Original Intro (10.03.17)   In episode 1 of Hash Power, we explored blockchains as a technology—how they work, why tokens (also known as cryptocurrencies) are an integral part of any blockchain, and how these new networks might change the world. In episode two, we spend time with the leading investors in the field. Like any frenzied asset class, there are countless cryptocurrency hedge funds popping up everywhere. But founders from three of the original firms—Polychain, Metastable, and Blocktower Capital—are our primary guides this week.   As I speak, the total market cap of all cryptocurrencies is $136B. There are hundreds of tokens currently available, but bitcoin and Ethereum represent 75% of the total market cap. $136B sounds like a big number, but its tiny relative to any other asset class—and I use that term with hesitation. To put it in perspective, that's exactly the same size as the market cap of IBM. But IBM had more than $10B of earnings in 2016. Tokens have none. As you will hear, valuing tokens is a very hard exercise.   In such a nascent world, we are seeing investing strategies take hold. Olaf Carlson-Wee, Josh Seims, and Ari Paul walk us through different takes on cryptocurrency investing, be it early stage, long term buy and hold, or more hedge fund style strategies.   -----   Web3 Breakdowns is a property of Colossus, LLC. For more episodes of Web3 Breakdowns, visit joincolossus.com/episodes.   Stay up to date on all our podcasts by signing up to Colossus Weekly, our quick dive every Sunday highlighting the top business and investing concepts from our podcasts and the best of what we read that week. Sign up here.   Follow us on Twitter: @Web3Breakdowns | @patrick_oshag | @JoinColossus   Show Notes: [00:00:05] – Recap of part 1 and introduction to part 2 of Hash Power [00:02:58] – Ari Paul, CIO of Blocktower explains how he got involved in cryptocurrencies [00:05:23] – Why do we need bitcoin [00:07:23] – Polychain Capital founder Olaf Carlson-Wee on why the value of tokens accrue [00:09:23] – How mainstream money is getting into this space [00:12:26] – Useful comparisons when talking about ICOs when compared to IPOs [00:15:01] – Naval Ravikant, CEO of Angellist, is asked to explain the protocols of cryptocurrencies to platform businesses like Uber or Airbnb [00:17:43] – Naval's interest in investing in cryptocurrencies [00:18:42] – Why average folks should avoid it before they dive thoroughly into the topic [00:20:25] – What are the most compelling counter-arguments to using cryptocurrencies [00:23:07] – Olaf Carlson Wee on the lifecycle of a token [00:25:31] – What is the earliest stage that edge is most present for investors in cryptocurrency protocols [00:28:12] – How do you mitigate the volatility that is present in blockchain [00:31:18] – Jeremiah Lowin, a risk and statistics expert, who runs risk management for a large private family office, talks about why he no longer owns cryptocurrencies [00:34:19] – Jordan Cooper, a venture capital investor, is optimistic about blockchains in general, but thinks there may be some overvaluations in current currencies [00:37:02] – How Jordan would value a single cryptocurrency [00:43:52] – Josh Seims, of Metastable, the value investor in blockchain? [00:51:15] – Ari Paul on the equivalent of listed stocks in the cryptocurrency world [00:52:33] – Understanding the concept of a coin in blockchain and how people are getting access to them [00:55:07] – The fairground analogy to understand cryptocurrencies [00:57:57] – What lessons from traditional markets can you apply to investing in cryptocurrencies [01:02:48] – Where do family offices stand when it comes to jumping into this space [01:06:51] – Ari is asked to discuss some of the alternative cryptocurrencies

Join us as we chat with Jeremiah Lowin – the founder and CEO of Prefect. We will discuss their new product release, Orion. Meet today's Sharks: - Jeremiah Lowin, CEO of Prefect - Jared Hillam, EVP of Emerging Technologies at Intricity - Rich Hathaway, Senior Solution Architect, Snowflake Expert at Intricity - Arkady Kleyner, Principal, and CoFounder of Intricity Watch the Video on YouTube Sign up for future live sessions intricity.com/datasharks Talk with a Data Shark: intricity.com/intricity101 www.intricity.com youtube.com/intricity101

Jeremiah Lowin, CEO & Founder, Prefect Jeremiah is the founder of Prefect, the data flow company that sits on top of the open-source workflow project Prefect Core as well as the recently released orchestration engine project Prefect Orion. Unlike many open-source companies, Prefect didn't start out as open-source. Two years into the company-building journey, Prefect Core launched and the traction from there has been very strong. Today, Prefect has a Slack community of over 10K members and has raised from VCs including Patrick O'Shaughnessy, Tiger Global, and Positive Sum. In this episode, we discuss the early Prefect story, open-source as a social network, different ways to approach fundraising as an open-source company, product positioning, and more!

Prefect is a workflow management system that helps to eliminate data flow problems for companies' data teams. They provide a new dataflow automation platform that reduces engineering time by automating pipelines and workflows of any complexity. Prefect combines the convenience of the cloud with the security of on-prem to meet the needs of companies looking to deploy quickly, monitor, and manage their workflows. Jeremiah Lowin is the Founder and CEO. He graduated from Harvard University with both a Bachelors in Economics and a Masters in Statistics. Learn More

Prefect is a workflow management system that helps to eliminate data flow problems for companies' data teams. They provide a new dataflow automation platform that reduces engineering time by automating pipelines and workflows of any complexity. Prefect combines the convenience of the cloud with the security of on-prem to meet the needs of companies looking to deploy quickly, monitor, and manage their workflows. Jeremiah Lowin is the Founder and CEO. He graduated from Harvard University with both a Bachelors in Economics and a Masters in Statistics. Learn More

Today's guest Shark is Jeremiah Lowin, Founder, and CEO of Prefect. The Data Sharks discuss the future of Data Orchestration and how Prefect provides the easiest way to automate your data with incredible flexibility. Plus learn how Prefect evolved from a tiny startup in a windowless closet, to the game changers they are today. intricity.com/datasharks prefect.io github.com/prefectHQ Meet today's Sharks: - Jared Hillam, EVP of Emerging Technologies at Intricity - Arkady Kleyner, Principal, and Co-Founder of Intricity - Jeremiah Lowin, Founder, and CEO of Prefect Watch the Video on YouTube Talk with a Specialist: intricity.com/intricity101 www.intricity.com youtube.com/intricity101

In this episode of Infinite Loops, we speak with Jeremiah Lowin, CEO at Prefect. In this conversation we cover: Overcoming inertia When information challenges your beliefs Choosing the right words for expression Narratives and decision-making Building a culture that appreciates uncertainty  And A LOT more Follow Jeremiah on Twitter (https://twitter.com/jlowin), and learn more about Prefect at https://www.prefect.io/ 

This is the story of Backstage -- a “platform of platforms”, built by Spotify and open to anyone as open source software. Tune in to hear insights about when to build vs buy - and when to open source - or not! Interviews with Jeremiah Lowin, CEO of Prefect.io, a company that runs on what is called an open core model, as well as from Spotify insiders like Pia Nilsson, Director of Engineering and Tyson Singer, Head of Technology and Platforms.

In this episode of Founded and Funded, Anu Sharma continues her deep dive into commercial open source projects and talks to Jeremiah Lowin, the founder and CEO of Prefect, a dataflow automation platform that is trusted to build, run, and monitor millions of data workflows and pipelines. Jeremiah talks about how he and his team built this open source community from zero to 5,000, and how the community helps the team at Prefect reach their users and intentionally break out of internal echo chambers that often trap early stage products. 

Eric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail. In this episode we discuss: Solving the “negative engineering problem” Learning from the complaints of data engineers at Apache Airflow The difficulty of having a product that serves two masters How COVID changed the direction of Prefect Links: Prefect Apache Airflow Why Not Airflow? People mentioned: Jim O'Shaughnessy (@jposhaughnessy) Patrick O’Shaughnessy (@patrick_oshag)

My guests this week are Jeremiah Lowin and Chetan Puttagunta. Jeremiah is the founder of Prefect.io, an open-source software company where my family and I are investors, and Chetan is a partner at Benchmark Capital. Both are past guests and good friends. I asked them on to help the audience understand the open source software business model. I’ve been fascinated with this model in which companies give a huge chunk of their work and value away for free to a community of developers, and then make money by building additional tools, functionality, and services on top of their free and open platform. While this may strike you as a wonky discussion on a niche software topic, I think it is valuable for everyone because the ideas can be applied to more than just code. I view much of my own activity as open-sourcing investment research and knowledge. It is also important because much of the world’s technology is built on top of open source projects. I hope you learn something new about this emerging category. Please enjoy.   This episode of Invest Like The Best is sponsored by Canalyst. Canalyst is the leading destination for public company data and analysis.  If you’re a professional equity investor and haven’t talked to Canalyst recently, you should give them a shout. Learn more and try Canalyst for yourself at canalyst.com/Patrick.     For more episodes go to InvestorFieldGuide.com/podcast. Sign up for the book club and new email newsletter called “Inside the Episode” at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag   Show Notes (2:40) – (First question) – Originator business in open source software; Redhat (5:51) – Why open source is valuable in building a business (7:40) – Examples of the benefits of open source projects (10:27) – Open source business models that produce the best results (17:04) – Defensibility of open source companies (25:02) – Mentoring younger founders on using open-source (30:54) – The benefits of launching open-source (36:41) – Building a digital community (41:31) – Lessons from Open Source that can be applied to other businesses (50:04) – The opportunity sets available in the open source space (53:33) – Future of open source             (56:31) – Tobi Lutke Podcast Episode   Learn More For more episodes go to InvestorFieldGuide.com/podcast. Sign up for the book club and new email newsletter called “Inside the Episode” at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag

A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model.  The workflow scheduler manages the tasks in that The post Prefect Dataflow Scheduler with Jeremiah Lowin appeared first on Software Engineering Daily.

A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model.  The workflow scheduler manages the tasks in that The post Prefect Dataflow Scheduler with Jeremiah Lowin appeared first on Software Engineering Daily.

A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model.  The workflow scheduler manages the tasks in that The post Prefect Dataflow Scheduler with Jeremiah Lowin appeared first on Software Engineering Daily.

A data workflow scheduler is a tool used for connecting multiple systems together in order to build pipelines for processing data. A data pipeline might include a Hadoop task for ETL, a Spark task for stream processing, and a TensorFlow task to train a machine learning model. The workflow scheduler manages the tasks in that data pipeline and the logical flow between them. Airflow is a popular data workflow scheduler that was originally created at Airbnb. Since then, the project has been adopted by numerous companies that need workflow orchestration for their data pipelines. Jeremiah Lowin was a core committer to Airflow for several years before he identified several features of Airflow that he wanted to change.Prefect is a dataflow scheduler that was born out of Jeremiah's experience working with Airflow. Prefect's features include data sharing between tasks, task parameterization, and a different API than Airflow. Jeremiah joins the show to discuss Prefect, and how his experience with Airflow led to his current work in dataflow scheduling.

In this episode I talk with Jeremiah Lowin, founder and CEO of Prefect, the company behind the open-source dataflow automation tool of the same name.We first dive into his background in risk management and his frustrations behind trying to automate certain tasks using the currently available tools. This inspired him to write Prefect, an open-source dataflow automation tool for Python which focuses on the data scientist's needs.We go on to discuss his decisions and experiences in founding a company with a significant portion of the software being open-source.Finally, Jeremiah explains how COVID-19 has caused him to question everything he thought he knew about his business and decide to open-source even more of his company's software stack. He shares his insights and experiences of how other startups can turn this challenge into an advantage and how to overcome the challenges of all employees switching to remote-only.Links:https://twitter.com/jlowinhttps://www.prefect.io/https://github.com/PrefectHQ/prefecthttps://tandem.chat/Special thanks to my patrons:Ayan DossDaniel GerlancRichard CraibJonathan NgIf you would like to support the podcast, you can do so here: https://www.patreon.com/twiecki Support the show (https://www.patreon.com/twiecki)

Building a data platform that works equally well for data engineering and data science is a task that requires familiarity with the needs of both roles. Data engineering platforms have a strong focus on stateful execution and tasks that are strictly ordered based on dependency graphs. Data science platforms provide an environment that is conducive to rapid experimentation and iteration, with data flowing directly between stages. Jeremiah Lowin has gained experience in both styles of working, leading him to be frustrated with all of the available tools. In this episode he explains his motivation for creating a new workflow engine that marries the needs of data engineers and data scientists, how it helps to smooth the handoffs between teams working on data projects, and how the design lets you focus on what you care about while it handles the failure cases for you. It is exciting to see a new generation of workflow engine that is learning from the benefits and failures of previous tools for processing your data pipelines.

My guest this week is Alex Mittal, co-founder of Funders Club. Following past guest Jeremiah Lowin, Alex is my second elementary school friend to appear on the podcast—a trend I hope continues. Funders club is a unique venture firm, because it is build around a network of investors and entrepreneurs who submit deals for consideration and invest together. But as you’ll hear, Alex and his co-founder Boris aren’t just building an open platform for early stage investing: they also then take a very traditional venture approach, making investing decisions themselves when it comes to building a centralized portfolio. Our conversation is about what Alex has learned investing in almost 300 early stage companies over the past 7 years. Please enjoy.   For more episodes go to InvestorFieldGuide.com/podcast. Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag   Show Notes 1:30 - (First Question) – Inception of the Founder’s Club             1:36 – Jeremiah Lowin Podcast Episode 3:59 – How the process of their platform works 5:40 – Role of the network in Founders Club setup and success 8:26 – What he has learned from all of the data he has access to 16:00 – Early stage investing and finding the sweet spot 22:17 – What makes a really intriguing bad idea 25:23 – Why he remains so excited about Ethereum 31:18 – More bad ideas             31:55 – Apoorva Mehta on How I Built This Podcast 37:15 – Thoughts on retail and logistics and how they fit his Venn diagram of boring and crazy 43:13 – Chip and electronic design 45:47 – Companies that are not just increasing efficiencies but actually making foundational changes             45:54 – Energy and Civilization: A History 52:34 – What does he look for in founders             55:26 – Pivot or Fail 57:05 – Kindest thing anyone has done for Alex   Learn More For more episodes go to InvestorFieldGuide.com/podcast.  Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub Follow Patrick on twitter at @patrick_oshag

My guest this week is one of my best and oldest friends, Jeremiah Lowin. Jeremiah has had a fascinating career, starting with advanced work in statistics before moving into the risk management field in the hedge fund world. Through his career he has studied data, risk, statistics, and machine learning—the last of which is the topic of our conversation today.  He has now left the world of finance to found a company called Prefect, which is a framework for building data infrastructure. Prefect was inspired by observing frictions between data scientists and data engineers, and solves these problems with a functional API for defining and executing data workflows. These problems, while wonky, are ones I can relate to working in quantitative investing—and others that suffer from them out there will be nodding their heads. In full and fair disclosure, both me and my family are investors in Jeremiah’s business. You won’t have to worry about that potential conflict of interest in today’s conversation, though, because our focus is on the deployment of machine learning technologies in the realm of investing. What I love about talking to Jeremiah is that he is an optimist and a skeptic. He loves working with new statistical learning technologies, but often thinks they are overhyped or entirely unsuited to the tasks they are being used for. We get into some deep detail on how tests are set up, the importance of data, and how the minimization of error is a guiding light in machine learning and perhaps all of human learning, too. Let’s dive in. For more episodes go to InvestorFieldGuide.com/podcast. Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag Show Notes 2:06 - (First Question) – What do people need to think about when considering using machine learning tools 3:19 – Types of problems that AI is perfect for 6:09 – Walking through an actual test and understanding the terminology 11:52 – Data in training: training set, test set, validation set 13:55 – The difference between machine learning and classical academic finance modelling 16:09 – What will the future of investing look like using these technologies 19:53 – The concept of stationarity 21:31 – Why you shouldn’t take for granted label formation in tests 24:12 – Ability for a model to shrug 26:13 – Hyper parameter tuning 28:16 – Categories of types of models 30:49 – Idea of a nearest neighbor or K-Means Algorithm 34:48 – Trees as the ultimate utility player in this landscape 38:00 – Features and data sets as the driver of edge in Machine Learning 40:12 – Key considerations when working through time series 42:05 – Pitfalls he has seen when folks try to build predictive market investing models 44:36 – Getting started 46:29 – Looking back at his career, what are some of the frontier vs settled applications of machine learning he has implemented 49:49 – Does intereptability matter in all of this 52:31 – How gradient decent fits into this whole picture     Learn More For more episodes go to InvestorFieldGuide.com/podcast.  Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub Follow Patrick on twitter at @patrick_oshag

In episode 1 of Hash Power, we explored blockchains as a technology—how they work, why tokens (also known as cryptocurrencies) are an integral part of any blockchain, and how these new networks might change the world. In episode two, we spend time with the leading investors in the field. Like any frenzied asset class, there are countless cryptocurrency hedge funds popping up everywhere. But founders from three of the original firms—Polychain, Metastable, and Blocktower Capital—are our primary guides this week. As I speak, the total market cap of cryptocurrencies is $136B. There are hundreds of tokens currently available, but bitcoin and Ethereum represent 75% of the total market cap. $136B sounds like a big number, but its tiny relative to any other asset class—and I use that term with hesitation. To put it in perspective, that’s exactly the same size as the market cap of IBM. But IBM had more than $10B of earnings in 2016. Tokens have none. As you will hear, valuing tokens is a very hard exercise. In such a nascent world, we are seeing investing strategies take hold. Olaf Carlson-Wee, Josh Seims, and Ari Paul walk us through different takes on cryptocurrency investing, be it early stage, long term buy and hold, or more hedge fund style strategies. Hash Power is presented by Fidelity Investments For comprehensive show notes on this episode go to http://investorfieldguide.com/hashpower For more episodes go to InvestorFieldGuide.com/podcast. To get involved with Project Frontier, head to InvestorFieldGuide.com/frontier. Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag   Links Referenced Fat Protocols (Joel Monegro)   Show Notes 0:05 – Recap of part 1 and introduction to part 2 of Hash Power 2:58 – Ari Paul, CIO of Blocktower explains how he got involved in cryptocurrencies 5:23 – Why do we need bitcoin 7:23 – Polychain Capital founder Olaf Carlson-Wee on why the value of tokens accrue 9:23 – How main stream money is getting into this space 12:26- Useful comparisons when talking about ICOs when compared to IPOs 15:01 - Naval Ravikant, CEO of Angellist, is asked to explain the protocols of cryptocurrencies to platform businesses like Uber or Airbnb 17:43 – Naval’s interest in investing in cryptocurrencies 18:42 – Why average folks should avoid it before they dive thoroughly into the topic 20:25 – what are the most compelling counter arguments to using cryptocurrencies 23:07 - Olaf Carlson Wee on the lifecycle of a token 24:02 – SAFT note, Simple Agreement for Future Tokens 25:31 – What is the earliest stage that edge is most present for investors in cryptocurrency protocols 28:12 – How do you mitigate the volatility that is present in blockchain 31:18 - Jeremiah Lowin, a risk and statistics expert, who runs risk management for a large private family office, talks about why he no longer owns cryptocurrencies  34:19 - Jordan Cooper, a venture capital investor, is optimistic about blockchains in general, but thinks there may be some overvaluations in current currencies 37:02 – How Jordan would value a single cryptocurrency 42:10 – Fat Protocols (Joel Monegro) 43:52 - Josh Seims, of Metastable, the value investor in blockchain? 51:15 - Ari Paul on the equivalent of listed stocks in the crypto currency world 52:33 – Understanding the concept of a coin in blockchain and how people are getting access to them 55:07 – The fairground analogy to understand cryptocurrencies 57:57 – What lessons from traditional markets can you apply to investing in cryptocurrencies 1:02:48 – Where do family offices stand when it comes to jumping into this space 1:06:51 – Ari is asked to discuss some of the alternative cryptocurrencies outside of Bitcoin and Ethereum. He starts with Ripple 1:10:27 – What would help firms or traders create edge in investing in cryptocurrencies   Learn More For more episodes go to InvestorFieldGuide.com/podcast.  Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub Follow Patrick on twitter at @patrick_oshag

Welcome to the first episode of Hash Power, an audio documentary that explores the world of blockchain and cryptocurrencies with leaders in the field like Naval Ravikant, Olaf Carlson-Wee, Fred Ehrsam, & Ari Paul. Hash Power is meant to be an introduction, but really, it is an invitation to explore this emerging world on your own.  In the coming weeks, we will cover the technology, the power of decentralization, bitcoin, Ethereum, ICOs, cryptography and hashing. We will spend time with the leading active hedge fund managers in the field, and with outside investors who are both optimistic and skeptical. Episode one covers the big picture, and answers the question: what is blockchain and why might it significantly affect our world? If you enjoy what follows, you’ll still be very early in understanding this field. Most don’t. So help me spread it like wildfire, because the more people that understand blockchain, the better its impact might become. Please enjoy episode one, and stay tuned next week for episode 2, which explores investing in cryptocurrencies. Hash Power is presented by Fidelity Investments   For comprehensive show notes on this episode go to http://investorfieldguide.com/hashpower For more episodes go to InvestorFieldGuide.com/podcast. To get involved with Project Frontier, head to InvestorFieldGuide.com/frontier. Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub. Follow Patrick on Twitter at @patrick_oshag   Books Referenced The Sovereign Individual: Mastering the Transition to the Information Age Nostalgia for the Absolute   Links Referenced Bitcoin: A Peer-to-Peer Electronic Cash System Reddit User jav_rddt SHA-256 Calculator The BitCoin Model for Crowdfunding Fat Protocols #cryptotwitter   Show Notes 0:05 – Introduction    CHAPTER 1 – Understanding the Concept of Blockchain (3:25) 4:30 – Jeremiah Lowin explains how blockchain is like a database             5:14 – Bitcoin: A Peer-to-Peer Electronic Cash System 5:46 – Owning a digital asset 7:14 – Naval Ravikant, CEO of Angelist on how blockchains can help to create personal networks and organize humans 11:01 – How blockchains represent a way to coordinate global activity through tokens 13:33 – New coins popping up around data storage and utility needs like solar panels 14:57 – Permission vs permissionless networks 16:37 – Protocols and the introduction of scarcity 18:13 – Keeping track of scarcity and the introduction of tokens 18:49 – Societal structures and how blockchains will change them again             18:51 – The Sovereign Individual: Mastering the Transition to the Information Age 21:55 – The role of blockchains in the informational age and the rise of more individual sovereignty 23:29 - Fred Ehrsam, co-founder of Coinbase, on the increasing shift to digital worlds led by incentive structures   CHAPTER 2 – Blockchain Technology (27:48)             29:09 - Reddit User jav_rddt             30:43 - SHA-256 Calculator 31:53 - Charlie Noyes, Pantera Capital, explains how SHA-256 was developed and what make its so special 35:48 – How miners create new blocks and the incentives to do so 40:22 – The nonce field 43:48 – The incentives that exist for miners and the arms race to build more powerful systems to mine 45:20 – The development of mining pools 46:54 – Ethereum, the “spiritual successor” to bitcoin 48:36 – How the Ether network is an ecosystem in which other tokens can sit 50:51 - Naval Ravikant on alternative coins or tokens             50:50 - The BitCoin Model for Crowdfunding 51:37 – How the protocol creators are the ones getting wealthy             52:35 – Fat Protocols 53:22 – Blockchain as an experiment in distributed government 54:47 – How cryptocurrency is more than just technology, it’s a movement             54:50 – Nostalgia for the Absolute             57:27 - #cryptotwitter 1:00:58 - Peter Jubber, of Fidelity, on how huge institutions, like theirs, are getting into the cryptocurrency game 1:4:01 –The notion of cooperation in an open source project or protocol 1:05:21- Olaf Carlson-Wee, first employee at Coinbase and the founder of Polychain, on the early excitement for cryptocurrency 1:06:56– Closing thoughts from Patrick             Looking to work in this space - hashpowerdeveloper@gmail.com   Learn More For more episodes go to InvestorFieldGuide.com/podcast.  Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub Follow Patrick on twitter at @patrick_oshag

Jeremiah Lowin is probably the smartest guy I know, and that is saying something. He is an expert in the fields of statistics, artificial intelligence, and risk management—among many other things.  He is currently the Director of Risk Management for a private investment firm in the New York area, but has spent years working with machine learning and AI.  This conversation is broken up into two parts.  In the first part, we explore artificial intelligence, machine learning, and models.  Then we shift to what risk means in a portfolio and how it can be managed or at least redistributed (which starts around 40 minutes into the conversation).  Please enjoy!   For comprehensive show notes on this episode go to investorfieldguide.com/lowin/ For more episodes go to InvestorFieldGuide.com/podcast.  Sign up for the book club, where you’ll get a full investor curriculum and then 3-4 suggestions every month at InvestorFieldGuide.com/bookclub Follow Patrick on twitter at @patrick_oshag