Podcasts about hashnode

We will be recording a preview of the AI Engineer World's Fair soon with swyx and Ben Dunphy, send any questions about Speaker CFPs and Sponsor Guides you have!Alessio is now hiring engineers for a new startup he is incubating at Decibel: Ideal candidate is an ex-technical co-founder type (can MVP products end to end, comfortable with ambiguous prod requirements, etc). Reach out to him for more!Thanks for all the love on the Four Wars episode! We're excited to develop this new “swyx & Alessio rapid-fire thru a bunch of things” format with you, and feedback is welcome. Jan 2024 RecapThe first half of this monthly audio recap pod goes over our highlights from the Jan Recap, which is mainly focused on notable research trends we saw in Jan 2024:Feb 2024 RecapThe second half catches you up on everything that was topical in Feb, including:* OpenAI Sora - does it have a world model? Yann LeCun vs Jim Fan * Google Gemini Pro 1.5 - 1m Long Context, Video Understanding* Groq offering Mixtral at 500 tok/s at $0.27 per million toks (swyx vs dylan math)* The {Gemini | Meta | Copilot} Alignment Crisis (Sydney is back!)* Grimes' poetic take: Art for no one, by no one* F*** you, show me the promptLatent Space AnniversaryPlease also read Alessio's longform reflections on One Year of Latent Space!We launched the podcast 1 year ago with Logan from OpenAI:and also held an incredible demo day that got covered in The Information:Over 750k downloads later, having established ourselves as the top AI Engineering podcast, reaching #10 in the US Tech podcast charts, and crossing 1 million unique readers on Substack, for our first anniversary we held Latent Space Final Frontiers, where 10 handpicked teams, including Lindy.ai and Julius.ai, competed for prizes judged by technical AI leaders from (former guest!) LlamaIndex, Replit, GitHub, AMD, Meta, and Lemurian Labs.The winners were Pixee and RWKV (that's Eugene from our pod!):And finally, your cohosts got cake!We also captured spot interviews with 4 listeners who kindly shared their experience of Latent Space, everywhere from Hungary to Australia to China:* Balázs Némethi* Sylvia Tong* RJ Honicky* Jan ZhengOur birthday wishes for the super loyal fans reading this - tag @latentspacepod on a Tweet or comment on a @LatentSpaceTV video telling us what you liked or learned from a pod that stays with you to this day, and share us with a friend!As always, feedback is welcome. Timestamps* [00:03:02] Top Five LLM Directions* [00:03:33] Direction 1: Long Inference (Planning, Search, AlphaGeometry, Flow Engineering)* [00:11:42] Direction 2: Synthetic Data (WRAP, SPIN)* [00:17:20] Wildcard: Multi-Epoch Training (OLMo, Datablations)* [00:19:43] Direction 3: Alt. Architectures (Mamba, RWKV, RingAttention, Diffusion Transformers)* [00:23:33] Wildcards: Text Diffusion, RALM/Retro* [00:25:00] Direction 4: Mixture of Experts (DeepSeekMoE, Samba-1)* [00:28:26] Wildcard: Model Merging (mergekit)* [00:29:51] Direction 5: Online LLMs (Gemini Pro, Exa)* [00:33:18] OpenAI Sora and why everyone underestimated videogen* [00:36:18] Does Sora have a World Model? Yann LeCun vs Jim Fan* [00:42:33] Groq Math* [00:47:37] Analyzing Gemini's 1m Context, Reddit deal, Imagegen politics, Gemma via the Four Wars* [00:55:42] The Alignment Crisis - Gemini, Meta, Sydney is back at Copilot, Grimes' take* [00:58:39] F*** you, show me the prompt* [01:02:43] Send us your suggestions pls* [01:04:50] Latent Space Anniversary* [01:04:50] Lindy.ai - Agent Platform* [01:06:40] RWKV - Beyond Transformers* [01:15:00] Pixee - Automated Security* [01:19:30] Julius AI - Competing with Code Interpreter* [01:25:03] Latent Space Listeners* [01:25:03] Listener 1 - Balázs Némethi (Hungary, Latent Space Paper Club* [01:27:47] Listener 2 - Sylvia Tong (Sora/Jim Fan/EntreConnect)* [01:31:23] Listener 3 - RJ (Developers building Community & Content)* [01:39:25] Listener 4 - Jan Zheng (Australia, AI UX)Transcript[00:00:00] AI Charlie: Welcome to the Latent Space podcast, weekend edition. This is Charlie, your new AI co host. Happy weekend. As an AI language model, I work the same every day of the week, although I might get lazier towards the end of the year. Just like you. Last month, we released our first monthly recap pod, where Swyx and Alessio gave quick takes on the themes of the month, and we were blown away by your positive response.[00:00:33] AI Charlie: We're delighted to continue our new monthly news recap series for AI engineers. Please feel free to submit questions by joining the Latent Space Discord, or just hit reply when you get the emails from Substack. This month, we're covering the top research directions that offer progress for text LLMs, and then touching on the big Valentine's Day gifts we got from Google, OpenAI, and Meta.[00:00:55] AI Charlie: Watch out and take care.[00:00:57] Alessio: Hey everyone, welcome to the Latent Space Podcast. This is Alessio, partner and CTO of Residence at Decibel Partners, and we're back with a monthly recap with my co host[00:01:06] swyx: Swyx. The reception was very positive for the first one, I think people have requested this and no surprise that I think they want to hear us more applying on issues and maybe drop some alpha along the way I'm not sure how much alpha we have to drop, this month in February was a very, very heavy month, we also did not do one specifically for January, so I think we're just going to do a two in one, because we're recording this on the first of March.[00:01:29] Alessio: Yeah, let's get to it. I think the last one we did, the four wars of AI, was the main kind of mental framework for people. I think in the January one, we had the five worthwhile directions for state of the art LLMs. Four, five,[00:01:42] swyx: and now we have to do six, right? Yeah.[00:01:46] Alessio: So maybe we just want to run through those, and then do the usual news recap, and we can do[00:01:52] swyx: one each.[00:01:53] swyx: So the context to this stuff. is one, I noticed that just the test of time concept from NeurIPS and just in general as a life philosophy I think is a really good idea. Especially in AI, there's news every single day, and after a while you're just like, okay, like, everyone's excited about this thing yesterday, and then now nobody's talking about it.[00:02:13] swyx: So, yeah. It's more important, or better use of time, to spend things, spend time on things that will stand the test of time. And I think for people to have a framework for understanding what will stand the test of time, they should have something like the four wars. Like, what is the themes that keep coming back because they are limited resources that everybody's fighting over.[00:02:31] swyx: Whereas this one, I think that the focus for the five directions is just on research that seems more proMECEng than others, because there's all sorts of papers published every single day, and there's no organization. Telling you, like, this one's more important than the other one apart from, you know, Hacker News votes and Twitter likes and whatever.[00:02:51] swyx: And obviously you want to get in a little bit earlier than Something where, you know, the test of time is counted by sort of reference citations.[00:02:59] The Five Research Directions[00:02:59] Alessio: Yeah, let's do it. We got five. Long inference.[00:03:02] swyx: Let's start there. Yeah, yeah. So, just to recap at the top, the five trends that I picked, and obviously if you have some that I did not cover, please suggest something.[00:03:13] swyx: The five are long inference, synthetic data, alternative architectures, mixture of experts, and online LLMs. And something that I think might be a bit controversial is this is a sorted list in the sense that I am not the guy saying that Mamba is like the future and, and so maybe that's controversial.[00:03:31] Direction 1: Long Inference (Planning, Search, AlphaGeometry, Flow Engineering)[00:03:31] swyx: But anyway, so long inference is a thesis I pushed before on the newsletter and on in discussing The thesis that, you know, Code Interpreter is GPT 4. 5. That was the title of the post. And it's one of many ways in which we can do long inference. You know, long inference also includes chain of thought, like, please think step by step.[00:03:52] swyx: But it also includes flow engineering, which is what Itamar from Codium coined, I think in January, where, basically, instead of instead of stuffing everything in a prompt, You do like sort of multi turn iterative feedback and chaining of things. In a way, this is a rebranding of what a chain is, what a lang chain is supposed to be.[00:04:15] swyx: I do think that maybe SGLang from ElemSys is a better name. Probably the neatest way of flow engineering I've seen yet, in the sense that everything is a one liner, it's very, very clean code. I highly recommend people look at that. I'm surprised it hasn't caught on more, but I think it will. It's weird that something like a DSPy is more hyped than a Shilang.[00:04:36] swyx: Because it, you know, it maybe obscures the code a little bit more. But both of these are, you know, really good sort of chain y and long inference type approaches. But basically, the reason that the basic fundamental insight is that the only, like, there are only a few dimensions we can scale LLMs. So, let's say in like 2020, no, let's say in like 2018, 2017, 18, 19, 20, we were realizing that we could scale the number of parameters.[00:05:03] swyx: 20, we were And we scaled that up to 175 billion parameters for GPT 3. And we did some work on scaling laws, which we also talked about in our talk. So the datasets 101 episode where we're like, okay, like we, we think like the right number is 300 billion tokens to, to train 175 billion parameters and then DeepMind came along and trained Gopher and Chinchilla and said that, no, no, like, you know, I think we think the optimal.[00:05:28] swyx: compute optimal ratio is 20 tokens per parameter. And now, of course, with LLAMA and the sort of super LLAMA scaling laws, we have 200 times and often 2, 000 times tokens to parameters. So now, instead of scaling parameters, we're scaling data. And fine, we can keep scaling data. But what else can we scale?[00:05:52] swyx: And I think understanding the ability to scale things is crucial to understanding what to pour money and time and effort into because there's a limit to how much you can scale some things. And I think people don't think about ceilings of things. And so the remaining ceiling of inference is like, okay, like, we have scaled compute, we have scaled data, we have scaled parameters, like, model size, let's just say.[00:06:20] swyx: Like, what else is left? Like, what's the low hanging fruit? And it, and it's, like, blindingly obvious that the remaining low hanging fruit is inference time. So, like, we have scaled training time. We can probably scale more, those things more, but, like, not 10x, not 100x, not 1000x. Like, right now, maybe, like, a good run of a large model is three months.[00:06:40] swyx: We can scale that to three years. But like, can we scale that to 30 years? No, right? Like, it starts to get ridiculous. So it's just the orders of magnitude of scaling. It's just, we're just like running out there. But in terms of the amount of time that we spend inferencing, like everything takes, you know, a few milliseconds, a few hundred milliseconds, depending on what how you're taking token by token, or, you know, entire phrase.[00:07:04] swyx: But We can scale that to hours, days, months of inference and see what we get. And I think that's really proMECEng.[00:07:11] Alessio: Yeah, we'll have Mike from Broadway back on the podcast. But I tried their product and their reports take about 10 minutes to generate instead of like just in real time. I think to me the most interesting thing about long inference is like, You're shifting the cost to the customer depending on how much they care about the end result.[00:07:31] Alessio: If you think about prompt engineering, it's like the first part, right? You can either do a simple prompt and get a simple answer or do a complicated prompt and get a better answer. It's up to you to decide how to do it. Now it's like, hey, instead of like, yeah, training this for three years, I'll still train it for three months and then I'll tell you, you know, I'll teach you how to like make it run for 10 minutes to get a better result.[00:07:52] Alessio: So you're kind of like parallelizing like the improvement of the LLM. Oh yeah, you can even[00:07:57] swyx: parallelize that, yeah, too.[00:07:58] Alessio: So, and I think, you know, for me, especially the work that I do, it's less about, you know, State of the art and the absolute, you know, it's more about state of the art for my application, for my use case.[00:08:09] Alessio: And I think we're getting to the point where like most companies and customers don't really care about state of the art anymore. It's like, I can get this to do a good enough job. You know, I just need to get better. Like, how do I do long inference? You know, like people are not really doing a lot of work in that space, so yeah, excited to see more.[00:08:28] swyx: So then the last point I'll mention here is something I also mentioned as paper. So all these directions are kind of guided by what happened in January. That was my way of doing a January recap. Which means that if there was nothing significant in that month, I also didn't mention it. Which is which I came to regret come February 15th, but in January also, you know, there was also the alpha geometry paper, which I kind of put in this sort of long inference bucket, because it solves like, you know, more than 100 step math olympiad geometry problems at a human gold medalist level and that also involves planning, right?[00:08:59] swyx: So like, if you want to scale inference, you can't scale it blindly, because just, Autoregressive token by token generation is only going to get you so far. You need good planning. And I think probably, yeah, what Mike from BrightWave is now doing and what everyone is doing, including maybe what we think QSTAR might be, is some form of search and planning.[00:09:17] swyx: And it makes sense. Like, you want to spend your inference time wisely. How do you[00:09:22] Alessio: think about plans that work and getting them shared? You know, like, I feel like if you're planning a task, somebody has got in and the models are stochastic. So everybody gets initially different results. Somebody is going to end up generating the best plan to do something, but there's no easy way to like store these plans and then reuse them for most people.[00:09:44] Alessio: You know, like, I'm curious if there's going to be. Some paper or like some work there on like making it better because, yeah, we don't[00:09:52] swyx: really have This is your your pet topic of NPM for[00:09:54] Alessio: Yeah, yeah, NPM, exactly. NPM for, you need NPM for anything, man. You need NPM for skills. You need NPM for planning. Yeah, yeah.[00:10:02] Alessio: You know I think, I mean, obviously the Voyager paper is like the most basic example where like, now their artifact is like the best planning to do a diamond pickaxe in Minecraft. And everybody can just use that. They don't need to come up with it again. Yeah. But there's nothing like that for actually useful[00:10:18] swyx: tasks.[00:10:19] swyx: For plans, I believe it for skills. I like that. Basically, that just means a bunch of integration tooling. You know, GPT built me integrations to all these things. And, you know, I just came from an integrations heavy business and I could definitely, I definitely propose some version of that. And it's just, you know, hard to execute or expensive to execute.[00:10:38] swyx: But for planning, I do think that everyone lives in slightly different worlds. They have slightly different needs. And they definitely want some, you know, And I think that that will probably be the main hurdle for any, any sort of library or package manager for planning. But there should be a meta plan of how to plan.[00:10:57] swyx: And maybe you can adopt that. And I think a lot of people when they have sort of these meta prompting strategies of like, I'm not prescribing you the prompt. I'm just saying that here are the like, Fill in the lines or like the mad libs of how to prompts. First you have the roleplay, then you have the intention, then you have like do something, then you have the don't something and then you have the my grandmother is dying, please do this.[00:11:19] swyx: So the meta plan you could, you could take off the shelf and test a bunch of them at once. I like that. That was the initial, maybe, promise of the, the prompting libraries. You know, both 9chain and Llama Index have, like, hubs that you can sort of pull off the shelf. I don't think they're very successful because people like to write their own.[00:11:36] swyx: Yeah,[00:11:37] Direction 2: Synthetic Data (WRAP, SPIN)[00:11:37] Alessio: yeah, yeah. Yeah, that's a good segue into the next one, which is synthetic[00:11:41] swyx: data. Synthetic data is so hot. Yeah, and, you know, the way, you know, I think I, I feel like I should do one of these memes where it's like, Oh, like I used to call it, you know, R L A I F, and now I call it synthetic data, and then people are interested.[00:11:54] swyx: But there's gotta be older versions of what synthetic data really is because I'm sure, you know if you've been in this field long enough, There's just different buzzwords that the industry condenses on. Anyway, the insight that I think is relatively new that why people are excited about it now and why it's proMECEng now is that we have evidence that shows that LLMs can generate data to improve themselves with no teacher LLM.[00:12:22] swyx: For all of 2023, when people say synthetic data, they really kind of mean generate a whole bunch of data from GPT 4 and then train an open source model on it. Hello to our friends at News Research. That's what News Harmony says. They're very, very open about that. I think they have said that they're trying to migrate away from that.[00:12:40] swyx: But it is explicitly against OpenAI Terms of Service. Everyone knows this. You know, especially once ByteDance got banned for, for doing exactly that. So so, so synthetic data that is not a form of model distillation is the hot thing right now, that you can bootstrap better LLM performance from the same LLM, which is very interesting.[00:13:03] swyx: A variant of this is RLAIF, where you have a, where you have a sort of a constitutional model, or, you know, some, some kind of judge model That is sort of more aligned. But that's not really what we're talking about when most people talk about synthetic data. Synthetic data is just really, I think, you know, generating more data in some way.[00:13:23] swyx: A lot of people, I think we talked about this with Vipul from the Together episode, where I think he commented that you just have to have a good world model. Or a good sort of inductive bias or whatever that, you know, term of art is. And that is strongest in math and science math and code, where you can verify what's right and what's wrong.[00:13:44] swyx: And so the REST EM paper from DeepMind explored that. Very well, it's just the most obvious thing like and then and then once you get out of that domain of like things where you can generate You can arbitrarily generate like a whole bunch of stuff and verify if they're correct and therefore they're they're correct synthetic data to train on Once you get into more sort of fuzzy topics, then it's then it's a bit less clear So I think that the the papers that drove this understanding There are two big ones and then one smaller one One was wrap like rephrasing the web from from Apple where they basically rephrased all of the C4 data set with Mistral and it be trained on that instead of C4.[00:14:23] swyx: And so new C4 trained much faster and cheaper than old C, than regular raw C4. And that was very interesting. And I have told some friends of ours that they should just throw out their own existing data sets and just do that because that seems like a pure win. Obviously we have to study, like, what the trade offs are.[00:14:42] swyx: I, I imagine there are trade offs. So I was just thinking about this last night. If you do synthetic data and it's generated from a model, probably you will not train on typos. So therefore you'll be like, once the model that's trained on synthetic data encounters the first typo, they'll be like, what is this?[00:15:01] swyx: I've never seen this before. So they have no association or correction as to like, oh, these tokens are often typos of each other, therefore they should be kind of similar. I don't know. That's really remains to be seen, I think. I don't think that the Apple people export[00:15:15] Alessio: that. Yeah, isn't that the whole, Mode collapse thing, if we do more and more of this at the end of the day.[00:15:22] swyx: Yeah, that's one form of that. Yeah, exactly. Microsoft also had a good paper on text embeddings. And then I think this is a meta paper on self rewarding language models. That everyone is very interested in. Another paper was also SPIN. These are all things we covered in the the Latent Space Paper Club.[00:15:37] swyx: But also, you know, I just kind of recommend those as top reads of the month. Yeah, I don't know if there's any much else in terms, so and then, regarding the potential of it, I think it's high potential because, one, it solves one of the data war issues that we have, like, everyone is OpenAI is paying Reddit 60 million dollars a year for their user generated data.[00:15:56] swyx: Google, right?[00:15:57] Alessio: Not OpenAI.[00:15:59] swyx: Is it Google? I don't[00:16:00] Alessio: know. Well, somebody's paying them 60 million, that's[00:16:04] swyx: for sure. Yes, that is, yeah, yeah, and then I think it's maybe not confirmed who. But yeah, it is Google. Oh my god, that's interesting. Okay, because everyone was saying, like, because Sam Altman owns 5 percent of Reddit, which is apparently 500 million worth of Reddit, he owns more than, like, the founders.[00:16:21] Alessio: Not enough to get the data,[00:16:22] swyx: I guess. So it's surprising that it would go to Google instead of OpenAI, but whatever. Okay yeah, so I think that's all super interesting in the data field. I think it's high potential because we have evidence that it works. There's not a doubt that it doesn't work. I think it's a doubt that there's, what the ceiling is, which is the mode collapse thing.[00:16:42] swyx: If it turns out that the ceiling is pretty close, then this will maybe augment our data by like, I don't know, 30 50 percent good, but not game[00:16:51] Alessio: changing. And most of the synthetic data stuff, it's reinforcement learning on a pre trained model. People are not really doing pre training on fully synthetic data, like, large enough scale.[00:17:02] swyx: Yeah, unless one of our friends that we've talked to succeeds. Yeah, yeah. Pre trained synthetic data, pre trained scale synthetic data, I think that would be a big step. Yeah. And then there's a wildcard, so all of these, like smaller Directions,[00:17:15] Wildcard: Multi-Epoch Training (OLMo, Datablations)[00:17:15] swyx: I always put a wildcard in there. And one of the wildcards is, okay, like, Let's say, you have pre, you have, You've scraped all the data on the internet that you think is useful.[00:17:25] swyx: Seems to top out at somewhere between 2 trillion to 3 trillion tokens. Maybe 8 trillion if Mistral, Mistral gets lucky. Okay, if I need 80 trillion, if I need 100 trillion, where do I go? And so, you can do synthetic data maybe, but maybe that only gets you to like 30, 40 trillion. Like where, where is the extra alpha?[00:17:43] swyx: And maybe extra alpha is just train more on the same tokens. Which is exactly what Omo did, like Nathan Lambert, AI2, After, just after he did the interview with us, they released Omo. So, it's unfortunate that we didn't get to talk much about it. But Omo actually started doing 1. 5 epochs on every, on all data.[00:18:00] swyx: And the data ablation paper that I covered in Europe's says that, you know, you don't like, don't really start to tap out of like, the alpha or the sort of improved loss that you get from data all the way until four epochs. And so I'm just like, okay, like, why do we all agree that one epoch is all you need?[00:18:17] swyx: It seems like to be a trend. It seems that we think that memorization is very good or too good. But then also we're finding that, you know, For improvement in results that we really like, we're fine on overtraining on things intentionally. So, I think that's an interesting direction that I don't see people exploring enough.[00:18:36] swyx: And the more I see papers coming out Stretching beyond the one epoch thing, the more people are like, it's completely fine. And actually, the only reason we stopped is because we ran out of compute[00:18:46] Alessio: budget. Yeah, I think that's the biggest thing, right?[00:18:51] swyx: Like, that's not a valid reason, that's not science. I[00:18:54] Alessio: wonder if, you know, Matt is going to do it.[00:18:57] Alessio: I heard LamaTree, they want to do a 100 billion parameters model. I don't think you can train that on too many epochs, even with their compute budget, but yeah. They're the only ones that can save us, because even if OpenAI is doing this, they're not going to tell us, you know. Same with DeepMind.[00:19:14] swyx: Yeah, and so the updates that we got on Lambda 3 so far is apparently that because of the Gemini news that we'll talk about later they're pushing it back on the release.[00:19:21] swyx: They already have it. And they're just pushing it back to do more safety testing. Politics testing.[00:19:28] Alessio: Well, our episode with Sumit will have already come out by the time this comes out, I think. So people will get the inside story on how they actually allocate the compute.[00:19:38] Direction 3: Alt. Architectures (Mamba, RWKV, RingAttention, Diffusion Transformers)[00:19:38] Alessio: Alternative architectures. Well, shout out to our WKV who won one of the prizes at our Final Frontiers event last week.[00:19:47] Alessio: We talked about Mamba and Strapain on the Together episode. A lot of, yeah, monarch mixers. I feel like Together, It's like the strong Stanford Hazy Research Partnership, because Chris Ray is one of the co founders. So they kind of have a, I feel like they're going to be the ones that have one of the state of the art models alongside maybe RWKB.[00:20:08] Alessio: I haven't seen as many independent. People working on this thing, like Monarch Mixer, yeah, Manbuster, Payena, all of these are together related. Nobody understands the math. They got all the gigabrains, they got 3DAO, they got all these folks in there, like, working on all of this.[00:20:25] swyx: Albert Gu, yeah. Yeah, so what should we comment about it?[00:20:28] swyx: I mean, I think it's useful, interesting, but at the same time, both of these are supposed to do really good scaling for long context. And then Gemini comes out and goes like, yeah, we don't need it. Yeah.[00:20:44] Alessio: No, that's the risk. So, yeah. I was gonna say, maybe it's not here, but I don't know if we want to talk about diffusion transformers as like in the alt architectures, just because of Zora.[00:20:55] swyx: One thing, yeah, so, so, you know, this came from the Jan recap, which, and diffusion transformers were not really a discussion, and then, obviously, they blow up in February. Yeah. I don't think they're, it's a mixed architecture in the same way that Stripe Tiena is mixed there's just different layers taking different approaches.[00:21:13] swyx: Also I think another one that I maybe didn't call out here, I think because it happened in February, was hourglass diffusion from stability. But also, you know, another form of mixed architecture. So I guess that is interesting. I don't have much commentary on that, I just think, like, we will try to evolve these things, and maybe one of these architectures will stick and scale, it seems like diffusion transformers is going to be good for anything generative, you know, multi modal.[00:21:41] swyx: We don't see anything where diffusion is applied to text yet, and that's the wild card for this category. Yeah, I mean, I think I still hold out hope for let's just call it sub quadratic LLMs. I think that a lot of discussion this month actually was also centered around this concept that People always say, oh, like, transformers don't scale because attention is quadratic in the sequence length.[00:22:04] swyx: Yeah, but, you know, attention actually is a very small part of the actual compute that is being spent, especially in inference. And this is the reason why, you know, when you multiply, when you, when you, when you jump up in terms of the, the model size in GPT 4 from like, you know, 38k to like 32k, you don't also get like a 16 times increase in your, in your performance.[00:22:23] swyx: And this is also why you don't get like a million times increase in your, in your latency when you throw a million tokens into Gemini. Like people have figured out tricks around it or it's just not that significant as a term, as a part of the overall compute. So there's a lot of challenges to this thing working.[00:22:43] swyx: It's really interesting how like, how hyped people are about this versus I don't know if it works. You know, it's exactly gonna, gonna work. And then there's also this, this idea of retention over long context. Like, even though you have context utilization, like, the amount of, the amount you can remember is interesting.[00:23:02] swyx: Because I've had people criticize both Mamba and RWKV because they're kind of, like, RNN ish in the sense that they have, like, a hidden memory and sort of limited hidden memory that they will forget things. So, for all these reasons, Gemini 1. 5, which we still haven't covered, is very interesting because Gemini magically has fixed all these problems with perfect haystack recall and reasonable latency and cost.[00:23:29] Wildcards: Text Diffusion, RALM/Retro[00:23:29] swyx: So that's super interesting. So the wildcard I put in here if you want to go to that. I put two actually. One is text diffusion. I think I'm still very influenced by my meeting with a mid journey person who said they were working on text diffusion. I think it would be a very, very different paradigm for, for text generation, reasoning, plan generation if we can get diffusion to work.[00:23:51] swyx: For text. And then the second one is Dowie Aquila's contextual AI, which is working on retrieval augmented language models, where it kind of puts RAG inside of the language model instead of outside.[00:24:02] Alessio: Yeah, there's a paper called Retro that covers some of this. I think that's an interesting thing. I think the The challenge, well not the challenge, what they need to figure out is like how do you keep the rag piece always up to date constantly, you know, I feel like the models, you put all this work into pre training them, but then at least you have a fixed artifact.[00:24:22] Alessio: These architectures are like constant work needs to be done on them and they can drift even just based on the rag data instead of the model itself. Yeah,[00:24:30] swyx: I was in a panel with one of the investors in contextual and the guy, the way that guy pitched it, I didn't agree with. He was like, this will solve hallucination.[00:24:38] Alessio: That's what everybody says. We solve[00:24:40] swyx: hallucination. I'm like, no, you reduce it. It cannot,[00:24:44] Alessio: if you solved it, the model wouldn't exist, right? It would just be plain text. It wouldn't be a generative model. Cool. So, author, architectures, then we got mixture of experts. I think we covered a lot of, a lot of times.[00:24:56] Direction 4: Mixture of Experts (DeepSeekMoE, Samba-1)[00:24:56] Alessio: Maybe any new interesting threads you want to go under here?[00:25:00] swyx: DeepSeq MOE, which was released in January. Everyone who is interested in MOEs should read that paper, because it's significant for two reasons. One three reasons. One, it had, it had small experts, like a lot more small experts. So, for some reason, everyone has settled on eight experts for GPT 4 for Mixtral, you know, that seems to be the favorite architecture, but these guys pushed it to 64 experts, and each of them smaller than the other.[00:25:26] swyx: But then they also had the second idea, which is that it is They had two, one to two always on experts for common knowledge and that's like a very compelling concept that you would not route to all the experts all the time and make them, you know, switch to everything. You would have some always on experts.[00:25:41] swyx: I think that's interesting on both the inference side and the training side for for memory retention. And yeah, they, they, they, the, the, the, the results that they published, which actually excluded, Mixed draw, which is interesting. The results that they published showed a significant performance jump versus all the other sort of open source models at the same parameter count.[00:26:01] swyx: So like this may be a better way to do MOEs that are, that is about to get picked up. And so that, that is interesting for the third reason, which is this is the first time a new idea from China. has infiltrated the West. It's usually the other way around. I probably overspoke there. There's probably lots more ideas that I'm not aware of.[00:26:18] swyx: Maybe in the embedding space. But the I think DCM we, like, woke people up and said, like, hey, DeepSeek, this, like, weird lab that is attached to a Chinese hedge fund is somehow, you know, doing groundbreaking research on MOEs. So, so, I classified this as a medium potential because I think that it is a sort of like a one off benefit.[00:26:37] swyx: You can Add to any, any base model to like make the MOE version of it, you get a bump and then that's it. So, yeah,[00:26:45] Alessio: I saw Samba Nova, which is like another inference company. They released this MOE model called Samba 1, which is like a 1 trillion parameters. But they're actually MOE auto open source models.[00:26:56] Alessio: So it's like, they just, they just clustered them all together. So I think people. Sometimes I think MOE is like you just train a bunch of small models or like smaller models and put them together. But there's also people just taking, you know, Mistral plus Clip plus, you know, Deepcoder and like put them all together.[00:27:15] Alessio: And then you have a MOE model. I don't know. I haven't tried the model, so I don't know how good it is. But it seems interesting that you can then have people working separately on state of the art, you know, Clip, state of the art text generation. And then you have a MOE architecture that brings them all together.[00:27:31] swyx: I'm thrown off by your addition of the word clip in there. Is that what? Yeah, that's[00:27:35] Alessio: what they said. Yeah, yeah. Okay. That's what they I just saw it yesterday. I was also like[00:27:40] swyx: scratching my head. And they did not use the word adapter. No. Because usually what people mean when they say, Oh, I add clip to a language model is adapter.[00:27:48] swyx: Let me look up the Which is what Lava did.[00:27:50] Alessio: The announcement again.[00:27:51] swyx: Stable diffusion. That's what they do. Yeah, it[00:27:54] Alessio: says among the models that are part of Samba 1 are Lama2, Mistral, DeepSigCoder, Falcon, Dplot, Clip, Lava. So they're just taking all these models and putting them in a MOE. Okay,[00:28:05] swyx: so a routing layer and then not jointly trained as much as a normal MOE would be.[00:28:12] swyx: Which is okay.[00:28:13] Alessio: That's all they say. There's no paper, you know, so it's like, I'm just reading the article, but I'm interested to see how[00:28:20] Wildcard: Model Merging (mergekit)[00:28:20] swyx: it works. Yeah, so so the wildcard for this section, the MOE section is model merges, which has also come up as, as a very interesting phenomenon. The last time I talked to Jeremy Howard at the Olama meetup we called it model grafting or model stacking.[00:28:35] swyx: But I think the, the, the term that people are liking these days, the model merging, They're all, there's all different variations of merging. Merge types, and some of them are stacking, some of them are, are grafting. And, and so like, some people are approaching model merging in the way that Samba is doing, which is like, okay, here are defined models, each of which have their specific, Plus and minuses, and we will merge them together in the hope that the, you know, the sum of the parts will, will be better than others.[00:28:58] swyx: And it seems like it seems like it's working. I don't really understand why it works apart from, like, I think it's a form of regularization. That if you merge weights together in like a smart strategy you, you, you get a, you get a, you get a less overfitting and more generalization, which is good for benchmarks, if you, if you're honest about your benchmarks.[00:29:16] swyx: So this is really interesting and good. But again, they're kind of limited in terms of like the amount of bumps you can get. But I think it's very interesting in the sense of how cheap it is. We talked about this on the Chinatalk podcast, like the guest podcast that we did with Chinatalk. And you can do this without GPUs, because it's just adding weights together, and dividing things, and doing like simple math, which is really interesting for the GPU ports.[00:29:42] Alessio: There's a lot of them.[00:29:44] Direction 5: Online LLMs (Gemini Pro, Exa)[00:29:44] Alessio: And just to wrap these up, online LLMs? Yeah,[00:29:48] swyx: I think that I ki I had to feature this because the, one of the top news of January was that Gemini Pro beat GPT-4 turbo on LM sis for the number two slot to GPT-4. And everyone was very surprised. Like, how does Gemini do that?[00:30:06] swyx: Surprise, surprise, they added Google search. Mm-hmm to the results. So it became an online quote unquote online LLM and not an offline LLM. Therefore, it's much better at answering recent questions, which people like. There's an emerging set of table stakes features after you pre train something.[00:30:21] swyx: So after you pre train something, you should have the chat tuned version of it, or the instruct tuned version of it, however you choose to call it. You should have the JSON and function calling version of it. Structured output, the term that you don't like. You should have the online version of it. These are all like table stakes variants, that you should do when you offer a base LLM, or you train a base LLM.[00:30:44] swyx: And I think online is just like, There, it's important. I think companies like Perplexity, and even Exa, formerly Metaphor, you know, are rising to offer that search needs. And it's kind of like, they're just necessary parts of a system. When you have RAG for internal knowledge, and then you have, you know, Online search for external knowledge, like things that you don't know yet?[00:31:06] swyx: Mm-Hmm. . And it seems like it's, it's one of many tools. I feel like I may be underestimating this, but I'm just gonna put it out there that I, I think it has some, some potential. One of the evidence points that it doesn't actually matter that much is that Perplexity has a, has had online LMS for three months now and it performs, doesn't perform great.[00:31:25] swyx: Mm-Hmm. on, on lms, it's like number 30 or something. So it's like, okay. You know, like. It's, it's, it helps, but it doesn't give you a giant, giant boost. I[00:31:34] Alessio: feel like a lot of stuff I do with LLMs doesn't need to be online. So I'm always wondering, again, going back to like state of the art, right? It's like state of the art for who and for what.[00:31:45] Alessio: It's really, I think online LLMs are going to be, State of the art for, you know, news related activity that you need to do. Like, you're like, you know, social media, right? It's like, you want to have all the latest stuff, but coding, science,[00:32:01] swyx: Yeah, but I think. Sometimes you don't know what is news, what is news affecting.[00:32:07] swyx: Like, the decision to use an offline LLM is already a decision that you might not be consciously making that might affect your results. Like, what if, like, just putting things on, being connected online means that you get to invalidate your knowledge. And when you're just using offline LLM, like it's never invalidated.[00:32:27] swyx: I[00:32:28] Alessio: agree, but I think going back to your point of like the standing the test of time, I think sometimes you can get swayed by the online stuff, which is like, hey, you ask a question about, yeah, maybe AI research direction, you know, and it's like, all the recent news are about this thing. So the LLM like focus on answering, bring it up, you know, these things.[00:32:50] swyx: Yeah, so yeah, I think, I think it's interesting, but I don't know if I can, I bet heavily on this.[00:32:56] Alessio: Cool. Was there one that you forgot to put, or, or like a, a new direction? Yeah,[00:33:01] swyx: so, so this brings us into sort of February. ish.[00:33:05] OpenAI Sora and why everyone underestimated videogen[00:33:05] swyx: So like I published this in like 15 came with Sora. And so like the one thing I did not mention here was anything about multimodality.[00:33:16] swyx: Right. And I have chronically underweighted this. I always wrestle. And, and my cop out is that I focused this piece or this research direction piece on LLMs because LLMs are the source of like AGI, quote unquote AGI. Everything else is kind of like. You know, related to that, like, generative, like, just because I can generate better images or generate better videos, it feels like it's not on the critical path to AGI, which is something that Nat Friedman also observed, like, the day before Sora, which is kind of interesting.[00:33:49] swyx: And so I was just kind of like trying to focus on like what is going to get us like superhuman reasoning that we can rely on to build agents that automate our lives and blah, blah, blah, you know, give us this utopian future. But I do think that I, everybody underestimated the, the sheer importance and cultural human impact of Sora.[00:34:10] swyx: And you know, really actually good text to video. Yeah. Yeah.[00:34:14] Alessio: And I saw Jim Fan at a, at a very good tweet about why it's so impressive. And I think when you have somebody leading the embodied research at NVIDIA and he said that something is impressive, you should probably listen. So yeah, there's basically like, I think you, you mentioned like impacting the world, you know, that we live in.[00:34:33] Alessio: I think that's kind of like the key, right? It's like the LLMs don't have, a world model and Jan Lekon. He can come on the podcast and talk all about what he thinks of that. But I think SORA was like the first time where people like, Oh, okay, you're not statically putting pixels of water on the screen, which you can kind of like, you know, project without understanding the physics of it.[00:34:57] Alessio: Now you're like, you have to understand how the water splashes when you have things. And even if you just learned it by watching video and not by actually studying the physics, You still know it, you know, so I, I think that's like a direction that yeah, before you didn't have, but now you can do things that you couldn't before, both in terms of generating, I think it always starts with generating, right?[00:35:19] Alessio: But like the interesting part is like understanding it. You know, it's like if you gave it, you know, there's the video of like the, the ship in the water that they generated with SORA, like if you gave it the video back and now it could tell you why the ship is like too rocky or like it could tell you why the ship is sinking, then that's like, you know, AGI for like all your rig deployments and like all this stuff, you know, so, but there's none, there's none of that yet, so.[00:35:44] Alessio: Hopefully they announce it and talk more about it. Maybe a Dev Day this year, who knows.[00:35:49] swyx: Yeah who knows, who knows. I'm talking with them about Dev Day as well. So I would say, like, the phrasing that Jim used, which resonated with me, he kind of called it a data driven world model. I somewhat agree with that.[00:36:04] Does Sora have a World Model? Yann LeCun vs Jim Fan[00:36:04] swyx: I am on more of a Yann LeCun side than I am on Jim's side, in the sense that I think that is the vision or the hope that these things can build world models. But you know, clearly even at the current SORA size, they don't have the idea of, you know, They don't have strong consistency yet. They have very good consistency, but fingers and arms and legs will appear and disappear and chairs will appear and disappear.[00:36:31] swyx: That definitely breaks physics. And it also makes me think about how we do deep learning versus world models in the sense of You know, in classic machine learning, when you have too many parameters, you will overfit, and actually that fails, that like, does not match reality, and therefore fails to generalize well.[00:36:50] swyx: And like, what scale of data do we need in order to world, learn world models from video? A lot. Yeah. So, so I, I And cautious about taking this interpretation too literally, obviously, you know, like, I get what he's going for, and he's like, obviously partially right, obviously, like, transformers and, and, you know, these, like, these sort of these, these neural networks are universal function approximators, theoretically could figure out world models, it's just like, how good are they, and how tolerant are we of hallucinations, we're not very tolerant, like, yeah, so It's, it's, it's gonna prior, it's gonna bias us for creating like very convincing things, but then not create like the, the, the useful role models that we want.[00:37:37] swyx: At the same time, what you just said, I think made me reflect a little bit like we just got done saying how important synthetic data is for Mm-Hmm. for training lms. And so like, if this is a way of, of synthetic, you know, vi video data for improving our video understanding. Then sure, by all means. Which we actually know, like, GPT 4, Vision, and Dolly were trained, kind of, co trained together.[00:38:02] swyx: And so, like, maybe this is on the critical path, and I just don't fully see the full picture yet.[00:38:08] Alessio: Yeah, I don't know. I think there's a lot of interesting stuff. It's like, imagine you go back, you have Sora, you go back in time, and Newton didn't figure out gravity yet. Would Sora help you figure it out?[00:38:21] Alessio: Because you start saying, okay, a man standing under a tree with, like, Apples falling, and it's like, oh, they're always falling at the same speed in the video. Why is that? I feel like sometimes these engines can like pick up things, like humans have a lot of intuition, but if you ask the average person, like the physics of like a fluid in a boat, they couldn't be able to tell you the physics, but they can like observe it, but humans can only observe this much, you know, versus like now you have these models to observe everything and then They generalize these things and maybe we can learn new things through the generalization that they pick up.[00:38:55] swyx: But again, And it might be more observant than us in some respects. In some ways we can scale it up a lot more than the number of physicists that we have available at Newton's time. So like, yeah, absolutely possible. That, that this can discover new science. I think we have a lot of work to do to formalize the science.[00:39:11] swyx: And then, I, I think the last part is you know, How much, how much do we cheat by gen, by generating data from Unreal Engine 5? Mm hmm. which is what a lot of people are speculating with very, very limited evidence that OpenAI did that. The strongest evidence that I saw was someone who works a lot with Unreal Engine 5 looking at the side characters in the videos and noticing that they all adopt Unreal Engine defaults.[00:39:37] swyx: of like, walking speed, and like, character choice, like, character creation choice. And I was like, okay, like, that's actually pretty convincing that they actually use Unreal Engine to bootstrap some synthetic data for this training set. Yeah,[00:39:52] Alessio: could very well be.[00:39:54] swyx: Because then you get the labels and the training side by side.[00:39:58] swyx: One thing that came up on the last day of February, which I should also mention, is EMO coming out of Alibaba, which is also a sort of like video generation and space time transformer that also involves probably a lot of synthetic data as well. And so like, this is of a kind in the sense of like, oh, like, you know, really good generative video is here and It is not just like the one, two second clips that we saw from like other, other people and like, you know, Pika and all the other Runway are, are, are, you know, run Cristobal Valenzuela from Runway was like game on which like, okay, but like, let's see your response because we've heard a lot about Gen 1 and 2, but like, it's nothing on this level of Sora So it remains to be seen how we can actually apply this, but I do think that the creative industry should start preparing.[00:40:50] swyx: I think the Sora technical blog post from OpenAI was really good.. It was like a request for startups. It was so good in like spelling out. Here are the individual industries that this can impact.[00:41:00] swyx: And anyone who, anyone who's like interested in generative video should look at that. But also be mindful that probably when OpenAI releases a Soa API, right? The you, the in these ways you can interact with it are very limited. Just like the ways you can interact with Dahlia very limited and someone is gonna have to make open SOA to[00:41:19] swyx: Mm-Hmm to, to, for you to create comfy UI pipelines.[00:41:24] Alessio: The stability folks said they wanna build an open. For a competitor, but yeah, stability. Their demo video, their demo video was like so underwhelming. It was just like two people sitting on the beach[00:41:34] swyx: standing. Well, they don't have it yet, right? Yeah, yeah.[00:41:36] swyx: I mean, they just wanna train it. Everybody wants to, right? Yeah. I, I think what is confusing a lot of people about stability is like they're, they're, they're pushing a lot of things in stable codes, stable l and stable video diffusion. But like, how much money do they have left? How many people do they have left?[00:41:51] swyx: Yeah. I have had like a really, Ima Imad spent two hours with me. Reassuring me things are great. And, and I'm like, I, I do, like, I do believe that they have really, really quality people. But it's just like, I, I also have a lot of very smart people on the other side telling me, like, Hey man, like, you know, don't don't put too much faith in this, in this thing.[00:42:11] swyx: So I don't know who to believe. Yeah.[00:42:14] Alessio: It's hard. Let's see. What else? We got a lot more stuff. I don't know if we can. Yeah, Groq.[00:42:19] Groq Math[00:42:19] Alessio: We can[00:42:19] swyx: do a bit of Groq prep. We're, we're about to go to talk to Dylan Patel. Maybe, maybe it's the audio in here. I don't know. It depends what, what we get up to later. What, how, what do you as an investor think about Groq? Yeah. Yeah, well, actually, can you recap, like, why is Groq interesting? So,[00:42:33] Alessio: Jonathan Ross, who's the founder of Groq, he's the person that created the TPU at Google. It's actually, it was one of his, like, 20 percent projects. It's like, he was just on the side, dooby doo, created the TPU.[00:42:46] Alessio: But yeah, basically, Groq, they had this demo that went viral, where they were running Mistral at, like, 500 tokens a second, which is like, Fastest at anything that you have out there. The question, you know, it's all like, The memes were like, is NVIDIA dead? Like, people don't need H100s anymore. I think there's a lot of money that goes into building what GRUK has built as far as the hardware goes.[00:43:11] Alessio: We're gonna, we're gonna put some of the notes from, from Dylan in here, but Basically the cost of the Groq system is like 30 times the cost of, of H100 equivalent. So, so[00:43:23] swyx: let me, I put some numbers because me and Dylan were like, I think the two people actually tried to do Groq math. Spreadsheet doors.[00:43:30] swyx: Spreadsheet doors. So, one that's, okay, oh boy so, so, equivalent H100 for Lama 2 is 300, 000. For a system of 8 cards. And for Groq it's 2. 3 million. Because you have to buy 576 Groq cards. So yeah, that, that just gives people an idea. So like if you deprecate both over a five year lifespan, per year you're deprecating 460K for Groq, and 60K a year for H100.[00:43:59] swyx: So like, Groqs are just way more expensive per model that you're, that you're hosting. But then, you make it up in terms of volume. So I don't know if you want to[00:44:08] Alessio: cover that. I think one of the promises of Groq is like super high parallel inference on the same thing. So you're basically saying, okay, I'm putting on this upfront investment on the hardware, but then I get much better scaling once I have it installed.[00:44:24] Alessio: I think the big question is how much can you sustain the parallelism? You know, like if you get, if you're going to get 100% Utilization rate at all times on Groq, like, it's just much better, you know, because like at the end of the day, the tokens per second costs that you're getting is better than with the H100s, but if you get to like 50 percent utilization rate, you will be much better off running on NVIDIA.[00:44:49] Alessio: And if you look at most companies out there, who really gets 100 percent utilization rate? Probably open AI at peak times, but that's probably it. But yeah, curious to see more. I saw Jonathan was just at the Web Summit in Dubai, in Qatar. He just gave a talk there yesterday. That I haven't listened to yet.[00:45:09] Alessio: I, I tweeted that he should come on the pod. He liked it. And then rock followed me on Twitter. I don't know if that means that they're interested, but[00:45:16] swyx: hopefully rock social media person is just very friendly. They, yeah. Hopefully[00:45:20] Alessio: we can get them. Yeah, we, we gonna get him. We[00:45:22] swyx: just call him out and, and so basically the, the key question is like, how sustainable is this and how much.[00:45:27] swyx: This is a loss leader the entire Groq management team has been on Twitter and Hacker News saying they are very, very comfortable with the pricing of 0. 27 per million tokens. This is the lowest that anyone has offered tokens as far as Mixtral or Lama2. This matches deep infra and, you know, I think, I think that's, that's, that's about it in terms of that, that, that low.[00:45:47] swyx: And we think the pro the break even for H100s is 50 cents. At a, at a normal utilization rate. To make this work, so in my spreadsheet I made this, made this work. You have to have like a parallelism of 500 requests all simultaneously. And you have, you have model bandwidth utilization of 80%.[00:46:06] swyx: Which is way high. I just gave them high marks for everything. Groq has two fundamental tech innovations that they hinge their hats on in terms of like, why we are better than everyone. You know, even though, like, it remains to be independently replicated. But one you know, they have this sort of the entire model on the chip idea, which is like, Okay, get rid of HBM.[00:46:30] swyx: And, like, put everything in SREM. Like, okay, fine, but then you need a lot of cards and whatever. And that's all okay. And so, like, because you don't have to transfer between memory, then you just save on that time and that's why they're faster. So, a lot of people buy that as, like, that's the reason that you're faster.[00:46:45] swyx: Then they have, like, some kind of crazy compiler, or, like, Speculative routing magic using compilers that they also attribute towards their higher utilization. So I give them 80 percent for that. And so that all that works out to like, okay, base costs, I think you can get down to like, maybe like 20 something cents per million tokens.[00:47:04] swyx: And therefore you actually are fine if you have that kind of utilization. But it's like, I have to make a lot of fearful assumptions for this to work.[00:47:12] Alessio: Yeah. Yeah, I'm curious to see what Dylan says later.[00:47:16] swyx: So he was like completely opposite of me. He's like, they're just burning money. Which is great.[00:47:22] Analyzing Gemini's 1m Context, Reddit deal, Imagegen politics, Gemma via the Four Wars[00:47:22] Alessio: Gemini, want to do a quick run through since this touches on all the four words.[00:47:28] swyx: Yeah, and I think this is the mark of a useful framework, that when a new thing comes along, you can break it down in terms of the four words and sort of slot it in or analyze it in those four frameworks, and have nothing left.[00:47:41] swyx: So it's a MECE categorization. MECE is Mutually Exclusive and Collectively Exhaustive. And that's a really, really nice way to think about taxonomies and to create mental frameworks. So, what is Gemini 1. 5 Pro? It is the newest model that came out one week after Gemini 1. 0. Which is very interesting.[00:48:01] swyx: They have not really commented on why. They released this the headline feature is that it has a 1 million token context window that is multi modal which means that you can put all sorts of video and audio And PDFs natively in there alongside of text and, you know, it's, it's at least 10 times longer than anything that OpenAI offers which is interesting.[00:48:20] swyx: So it's great for prototyping and it has interesting discussions on whether it kills RAG.[00:48:25] Alessio: Yeah, no, I mean, we always talk about, you know, Long context is good, but you're getting charged per token. So, yeah, people love for you to use more tokens in the context. And RAG is better economics. But I think it all comes down to like how the price curves change, right?[00:48:42] Alessio: I think if anything, RAG's complexity goes up and up the more you use it, you know, because you have more data sources, more things you want to put in there. The token costs should go down over time, you know, if the model stays fixed. If people are happy with the model today. In two years, three years, it's just gonna cost a lot less, you know?[00:49:02] Alessio: So now it's like, why would I use RAG and like go through all of that? It's interesting. I think RAG is better cutting edge economics for LLMs. I think large context will be better long tail economics when you factor in the build cost of like managing a RAG pipeline. But yeah, the recall was like the most interesting thing because we've seen the, you know, You know, in the haystack things in the past, but apparently they have 100 percent recall on anything across the context window.[00:49:28] Alessio: At least they say nobody has used it. No, people[00:49:30] swyx: have. Yeah so as far as, so, so what this needle in a haystack thing for people who aren't following as closely as us is that someone, I forget his name now someone created this needle in a haystack problem where you feed in a whole bunch of generated junk not junk, but just like, Generate a data and ask it to specifically retrieve something in that data, like one line in like a hundred thousand lines where it like has a specific fact and if it, if you get it, you're, you're good.[00:49:57] swyx: And then he moves the needle around, like, you know, does it, does, does your ability to retrieve that vary if I put it at the start versus put it in the middle, put it at the end? And then you generate this like really nice chart. That, that kind of shows like it's recallability of a model. And he did that for GPT and, and Anthropic and showed that Anthropic did really, really poorly.[00:50:15] swyx: And then Anthropic came back and said it was a skill issue, just add this like four, four magic words, and then, then it's magically all fixed. And obviously everybody laughed at that. But what Gemini came out with was, was that, yeah, we, we reproduced their, you know, haystack issue you know, test for Gemini, and it's good across all, all languages.[00:50:30] swyx: All the one million token window, which is very interesting because usually for typical context extension methods like rope or yarn or, you know, anything like that, or alibi, it's lossy like by design it's lossy, usually for conversations that's fine because we are lossy when we talk to people but for superhuman intelligence, perfect memory across Very, very long context.[00:50:51] swyx: It's very, very interesting for picking things up. And so the people who have been given the beta test for Gemini have been testing this. So what you do is you upload, let's say, all of Harry Potter and you change one fact in one sentence, somewhere in there, and you ask it to pick it up, and it does. So this is legit.[00:51:08] swyx: We don't super know how, because this is, like, because it doesn't, yes, it's slow to inference, but it's not slow enough that it's, like, running. Five different systems in the background without telling you. Right. So it's something, it's something interesting that they haven't fully disclosed yet. The open source community has centered on this ring attention paper, which is created by your friend Matei Zaharia, and a couple other people.[00:51:36] swyx: And it's a form of distributing the compute. I don't super understand, like, why, you know, doing, calculating, like, the fee for networking and attention. In block wise fashion and distributing it makes it so good at recall. I don't think they have any answer to that. The only thing that Ring of Tension is really focused on is basically infinite context.[00:51:59] swyx: They said it was good for like 10 to 100 million tokens. Which is, it's just great. So yeah, using the four wars framework, what is this framework for Gemini? One is the sort of RAG and Ops war. Here we care less about RAG now, yes. Or, we still care as much about RAG, but like, now it's it's not important in prototyping.[00:52:21] swyx: And then, for data war I guess this is just part of the overall training dataset, but Google made a 60 million deal with Reddit and presumably they have deals with other companies. For the multi modality war, we can talk about the image generation, Crisis, or the fact that Gemini also has image generation, which we'll talk about in the next section.[00:52:42] swyx: But it also has video understanding, which is, I think, the top Gemini post came from our friend Simon Willison, who basically did a short video of him scanning over his bookshelf. And it would be able to convert that video into a JSON output of what's on that bookshelf. And I think that is very useful.[00:53:04] swyx: Actually ties into the conversation that we had with David Luan from Adept. In a sense of like, okay what if video was the main modality instead of text as the input? What if, what if everything was video in, because that's how we work. We, our eyes don't actually read, don't actually like get input, our brains don't get inputs as characters.[00:53:25] swyx: Our brains get the pixels shooting into our eyes, and then our vision system takes over first, and then we sort of mentally translate that into text later. And so it's kind of like what Adept is kind of doing, which is driving by vision model, instead of driving by raw text understanding of the DOM. And, and I, I, in that, that episode, which we haven't released I made the analogy to like self-driving by lidar versus self-driving by camera.[00:53:52] swyx: Mm-Hmm. , right? Like, it's like, I think it, what Gemini and any other super long context that model that is multimodal unlocks is what if you just drive everything by video. Which is[00:54:03] Alessio: cool. Yeah, and that's Joseph from Roboflow. It's like anything that can be seen can be programmable with these models.[00:54:12] Alessio: You mean[00:54:12] swyx: the computer vision guy is bullish on computer vision?[00:54:18] Alessio: It's like the rag people. The rag people are bullish on rag and not a lot of context. I'm very surprised. The, the fine tuning people love fine tuning instead of few shot. Yeah. Yeah. The, yeah, the, that's that. Yeah, the, I, I think the ring attention thing, and it's how they did it, we don't know. And then they released the Gemma models, which are like a 2 billion and 7 billion open.[00:54:41] Alessio: Models, which people said are not, are not good based on my Twitter experience, which are the, the GPU poor crumbs. It's like, Hey, we did all this work for us because we're GPU rich and we're just going to run this whole thing. And

Sam joins Brad and Amy to discuss server components, loadting states and getting into UI development.Sponsor###Contenful Contentful is the leading composable content platform that allows developers to build intelligent experiences to drive brand engagement. It gives content creators the tools they need to create, manage, and publish content seamlessly across every channel. Managing content has never been so easy or flexible.Check out ContentfulHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:15 Reusable Component07:49 Server Components31:06 Loading States45:46 Getting into UI50:32 Picks and Plugs

James and Amy take audience questions and discuss their favorite hot topics talking about frameworks, AI, and jobs.Sponsor###Contenful Contentful is the leading composable content platform that allows developers to build intelligent experiences to drive brand engagement. It gives content creators the tools they need to create, manage, and publish content seamlessly across every channel. Managing content has never been so easy or flexible.Check out ContentfulHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:33 Use Cases for AI07:48 Choosing Frameworks10:22 Next and Remix26:31 Money Talk for Frameworks34:45 Knowing Multiple Frameworks39:19 Landing a Job46:46 Leaving Coding51:49 Picks and Plugs

In this episode, I spoke with Sandro Volpicella, who is a platform lead at Hashnode, a fully serverless blogging platform. He is also the co-author of AWS Fundamentals (https://awsfundamentals.com).We explored Hashnode's architecture and went deep into its caching strategy, which is a crucial ingredient of a scalable and performant blogging platform.Links from the episode:Hashnode's overall architectureAWS FundamentalsCloudWatch BookStellateUpstashHow Hashnode implements the user feedOctoLenseServerlessQChoosing a database for serverless applications You can find Sandro on X as @sandro_vol-----For more stories about real-world use of serverless technologies, please subscribe to the channel and follow me on X as @theburningmonk.And if you're hungry for more insights, best practices, and invaluable tips on building serverless apps, make sure to subscribe to our free newsletter and elevate your serverless game! https://theburningmonk.com/subscribeOpening theme song:Cheery Monday by Kevin MacLeodLink: https://incompetech.filmmusic.io/song/3495-cheery-mondayLicense: http://creativecommons.org/licenses/by/4.0

Join us in this enlightening episode as our hosts Linda and Dave get an opportunity to dig deep into the fascinating world of gaming and cloud services with David Heidt, Senior Solutions Architect, Games for Amazon Web Services. From his transition to the cloud to his entrance into the gaming industry, David's story is one of passion, innovation, and relentless dedication. As a perimeter defense specialist for games, he tirelessly secures AWS customers' game servers against DDOS attacks, enhancing gamers' experiences worldwide. David also opens up about his innovative creation - the AWS Builder Cards, a unique collectable card game, that cleverly combines AWS Services education with enjoyable in-person gaming. In addition, the trio gives us a glimpse into their personal life and shares candid insights about parenting in a world where video games have become a quintessential part of our children's lives and the delicate balance between entertainment and discipline. Don't miss out on this dynamic and insightful conversation! David on Twitter: https://twitter.com/davidsheidt David on LinkedIn: https://www.linkedin.com/in/davidsimonheidt/ Linda on Twitter: https://twitter.com/lindavivah Linda's Website: https://lindavivah.com/ Linda on TikTok: https://www.tiktok.com/@lindavivah Linda on Instagram: https://www.instagram.com/lindavivah/ Linda's Medium: https://medium.com/@LindaVivah Dave on Twitter: https://twitter.com/thedavedev ** ALERT ** New Developer Hackathon from July 1st through July 31st, 2023! We're excited to announce the AWS Amplify hackathon in partnership with Hashnode. This is a great opportunity to build your dream app and win exciting prizes! The hackathon is open to everyone, and prizes include: $5, $5.5k worth of AWS credits, Hashnode swag, and AWS Amplify swag. *** REGISTER HERE *** https://bit.ly/julydevhack [PORTAL] AWS Builder Cards - https://aws.amazon.com/gametech/buildercards/ [VIDEO] Linda's Tok on AWS Cloud Quest - https://www.tiktok.com/@lindavivah/video/7132911650503445802 [VIDEO] AWS Cloud Quest – An Interactive Roleplaying Game - https://aws.amazon.com/training/digital/aws-cloud-quest/ [YOUTUBE] How to Play AWS Buildercards (2023) - https://www.youtube.com/watch?v=Pn6w8-abgis&ab_channel=AWSforGames Catan - Boardgame and Video Games - https://www.catan.com/ Dominion – Boardgame - https://boardgamegeek.com/boardgame/36218/dominion Clank – Deck Building Adventure Game - https://boardgamegeek.com/boardgame/201808/clank-deck-building-adventure Subscribe: Spotify: https://open.spotify.com/show/7rQjgnBvuyr18K03tnEHBI Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-developers-podcast/id1574162669 Stitcher: https://www.stitcher.com/show/1065378 Pandora: https://www.pandora.com/podcast/aws-developers-podcast/PC:1001065378 TuneIn: https://tunein.com/podcasts/Technology-Podcasts/AWS-Developers-Podcast-p1461814/ Amazon Music: https://music.amazon.com/podcasts/f8bf7630-2521-4b40-be90-c46a9222c159/aws-developers-podcast Google Podcasts: https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkcy5zb3VuZGNsb3VkLmNvbS91c2Vycy9zb3VuZGNsb3VkOnVzZXJzOjk5NDM2MzU0OS9zb3VuZHMucnNz RSS Feed: https://feeds.soundcloud.com/users/soundcloud:users:994363549/sounds.rss

In this episode, Dave and Emily have an enlightening chat with Meet Bhagdev, Principal Product Manager for Amazon Keyspaces at AWS. Venture with us into the world of serverless Cassandra-compatible databases as we uncover the power and benefits of Amazon Keyspaces. Meet helps us understand what it's like to steer the product ship at AWS, and the journey he embarked on to reach this exciting role. He dives into a rich developer-focused discussion on how Amazon Keyspaces, with its seamless scalability and high availability, empowers developers to build high-performing applications. Learn about new possibilities created by the de-coupling of compute and storage and get up to speed on the latest multi-region replication updates. If thousands of requests per second, unlimited throughput, and boundless storage sound like your ideal playground, don't miss this episode! Meet on Twitter: https://twitter.com/meet_bhagdev Meet on LinkedIn: https://www.linkedin.com/in/meet-bhagdev/ Meet's Website: https://www.meetbhagdev.com/ Emily on Twitter: https://twitter.com/editingemily Dave on Twitter: https://twitter.com/thedavedev [BLOG] Announcing Amazon Keyspaces Multi-Region Replication - https://aws.amazon.com/blogs/database/announcing-amazon-keyspaces-multi-region-replication/ [CASE STUDY] Venmo's process of migrating to Amazon DocumentDB - https://aws.amazon.com/blogs/database/venmos-process-of-migrating-to-amazon-documentdb-with-mongodb-compatibility/ [PORTAL] Amazon Keyspaces - https://aws.amazon.com/keyspaces/ [PORTAL] Apache Cassandra - Open Source NoSQL Database - https://cassandra.apache.org [YOUTUBE] What is Amazon Keyspaces - https://www.youtube.com/watch?v=PYdLIvBHe2E [YOUTUBE] How Intuit migrated to Amazon Keyspaces - https://youtu.be/AjsKP0Key6U?t=9 ** ALERT ** New Developer Hackathon from July 1st through July 31st, 2023! We're excited to announce the AWS Amplify hackathon in partnership with Hashnode. This is a great opportunity to build your dream app and win exciting prizes! The hackathon is open to everyone, and prizes include: $5, $5.5k worth of AWS credits, Hashnode swag, and AWS Amplify swag. *** REGISTER HERE *** https://bit.ly/julydevhack Subscribe: Spotify: https://open.spotify.com/show/7rQjgnBvuyr18K03tnEHBI Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-developers-podcast/id1574162669 Stitcher: https://www.stitcher.com/show/1065378 Pandora: https://www.pandora.com/podcast/aws-developers-podcast/PC:1001065378 TuneIn: https://tunein.com/podcasts/Technology-Podcasts/AWS-Developers-Podcast-p1461814/ Amazon Music: https://music.amazon.com/podcasts/f8bf7630-2521-4b40-be90-c46a9222c159/aws-developers-podcast Google Podcasts: https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkcy5zb3VuZGNsb3VkLmNvbS91c2Vycy9zb3VuZGNsb3VkOnVzZXJzOjk5NDM2MzU0OS9zb3VuZHMucnNz RSS Feed: https://feeds.soundcloud.com/users/soundcloud:users:994363549/sounds.rss

Join us in this insightful episode as we welcome back the inimitable Brian Tarbox, an AWS Community Hero and Alexa Champion, whose expertise is steeped in over thirty years of hands-on experience in the tech industry. With an impressive track record that includes ten patents, a slew of papers under his belt, and the co-leadership of the Boston AWS Meetup, Brian's insights are nothing short of invaluable. In this lively and engaging conversation, Emily, Dave, and Brian traverse the burgeoning landscape of technological terminology, exploring how definitions and interpretations have evolved over time. Specifically, they delve into the concept of "Serverless" - a term that, like many in our industry, has undergone significant transformation since its inception. What does Serverless mean in 2023? Brian, with his deep knowledge and candid demeanor, unpacks this in a way that is both easy to grasp and thought-provoking. This episode is not just a feast for your ears, but also a metaphorical banquet, as Brian masterfully utilizes metaphors to bring clarity to these often-complex concepts. It's a lively and humorous ride through the often-puzzling labyrinth of tech jargon, punctuated by heaps of fun and laughter. So, whether you're a seasoned tech veteran or a curious newcomer, tune in to this episode and savor the knowledge-rich discussion between Emily, Dave, and Brian. Be prepared to laugh, learn, and see the tech world through a fresh lens. It's an episode you won't want to miss! Brian on LinkedIn: https://www.linkedin.com/in/briantarbox/ Brian's Website: https://briantarbox.org/ Brian's AWS Community Hero page: https://aws.amazon.com/developer/community/heroes/brian-tarbox/ Brian's Alexa Champion page: https://developer.amazon.com/en-US/alexa/champions/brian-tarbox Emily on Twitter: https://twitter.com/editingemily Dave on Twitter: https://twitter.com/thedavedev [BLOG] Brian's post for AWS Heroes - Time to Rethink Cattle vs. Pets (Serverless Edition) - https://dev.to/aws-heroes/time-to-rethink-cattle-vs-pets-serverless-5c0j [PODCAST] Episode 059 of AWS Developers Podcast – AWS CodeWhisperer with Brian Tarbox - https://open.spotify.com/episode/2IAvSYwNchzEwqqylzun4F ** ALERT ** New Developer Hackathon from July 1st through July 31st, 2023! We're excited to announce the AWS Amplify hackathon in partnership with Hashnode. This is a great opportunity to build your dream app and win exciting prizes! The hackathon is open to everyone, and prizes include: $5, $5.5k worth of AWS credits, Hashnode swag, and AWS Amplify swag. *** REGISTER HERE ***  https://bit.ly/julydevhack Subscribe: Spotify: https://open.spotify.com/show/7rQjgnBvuyr18K03tnEHBI Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-developers-podcast/id1574162669 Stitcher: https://www.stitcher.com/show/1065378 Pandora: https://www.pandora.com/podcast/aws-developers-podcast/PC:1001065378 TuneIn: https://tunein.com/podcasts/Technology-Podcasts/AWS-Developers-Podcast-p1461814/ Amazon Music: https://music.amazon.com/podcasts/f8bf7630-2521-4b40-be90-c46a9222c159/aws-developers-podcast Google Podcasts: https://podcasts.google.com/feed/aHR0cHM6Ly9mZWVkcy5zb3VuZGNsb3VkLmNvbS91c2Vycy9zb3VuZGNsb3VkOnVzZXJzOjk5NDM2MzU0OS9zb3VuZHMucnNz RSS Feed: https://feeds.soundcloud.com/users/soundcloud:users:994363549/sounds.rss

In this episode we're bringing you a very special AI Edition of Watchtower Weekly. Tune in as we explain why all the headlines about AI cracking passwords are actually old news. And how AI is making pop fans' fantasies come true.

James and Amy discuss all things current in tech as well as answer your questions from the livestream.SponsorHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction02:07 Current Fun Work06:03 Posting More and Social Media17:24 Learning From Building the Astro Course19:54 Using Next 1323:19 Made With Zeta30:11 AI Tools34:04 Midjourney45:01 Paid Content and Value49:09 Framework Decision Process56:27 Starting in Content Creation01:06:44 Sources to Keep Up01:07:27 Starting With Sponsors01:11:21 Starting Your Own Podcast01:15:32 Express API and Videos01:16:16 Picks and Plugs…Sort Of

Welcome to Remote Ruby and thanks for joining us!  It's Jason and Andrew today and do they have so much to talk about. RailsConf 2023 is coming up, Andrew booked his flight and lodging early, Jason announces he's doing a podcast with Brittany while they're there, and the guys discuss how their ADHD is so different from each other.  Then they discuss npx, the benefits of using it, and how it can be useful in Ruby.  Jason and Andrew talk about building user interfaces in Ruby, creating games with DragonRuby, learning Rust and Python for hardware projects, and using OpenAI API for Ai projects. We'll also hear about their programming backgrounds, not liking math, regrets about not taking a statistics class seriously, and experiences with other college classes. Press download now to hear more!  [00:04:19] The guys are excited to go to RailsConf but Jason's feeling socially anxious since he had surgery. [00:06:03] Andrew explains what Hashnode is since Jason has no idea what it is.[00:06:28] In the wonderful world of Ruby, Andrew's been scripting lately since he wanted to have fun, and if you don't know what npx is, he explains what it is. Jason and Andrew also discuss using npx with Tailwind and esbuild, [00:11:09] Jason brings up using standards VS Code extension and mentions how surprisingly fast it is.[00:13:35] Jason mentions Nick Schwaderer taking on building a new Shoes project, which was a GUI graphic user interface library for Ruby, built by, why the lucky stiff. It looks like their using WebView, and if anyone can explain it, please Tweet Andrew on Twitter or message him on discord. [00:15:17] The guys talk about building user interfaces in Ruby, creating games with DragonRuby, and a Tweet by Amir Rajan about DragonRuby.[00:20:35] Jason tells us about trying to learn Rust and Python for hardware projects, and Andrew tells us about a widget he built using Rubyist.[00:22:28] There's a discussion on using OpenAI API, Andrew has an interest in creating a profitable business with web3 technology and AI, Jason mentions “Ask Rails,” an Open AI powered chat to help you with all things Ruby on Rails.[00:25:42] The conversation shifts to Jason and Andrew's programming backgrounds and their interest in using Ruby for hardware projects. [00:29:34] Have you heard of PicoRuby? Also, if you know mRuby, please reach out to Jason or Andrew because they need to talk to you.[00:31:50] Andrew was asked to be a Guide at RailsConf, saw the email too late, and he's not doing it because of his commitment issues.[00:34:37] Jason and Andrew discuss their rabbit holes. One is about a speech professor, the other is being back on Khan Academy filling gaps in math knowledge, and regrets about not taking statistics class seriously and other classes.   Panelists:Jason CharnesAndrew MasonSponsor:HoneybadgerLinks:Jason Charnes TwitterChris Oliver TwitterAndrew Mason TwitterRailsConf 2023HashnodeAmir Rajan TwitterDragonRubyAsk Railsnpx-GitHubSearls After Dark #1-ChatJPN (YouTube)ShoesRubyistOpenAI APIPicoRuby-GitHubRuby Radar TwitterRuby for All Podcast

Kiedy słyszymy Content Management System (CMS) to najpewniej w pierwszym momencie przychodzi nam na myśl WordPress albo Drupal. Raczej mało kto podejrzewa, że System Zarządzania Incydentami (Issue Tracking System) może również w powodzeniem służyć nam do zarządzania treścią. Rozmawiamy o platformie Octotype, która wykorzystuje Next.js do publikowania wpisów z GitHub Issues. Omawiamy szczegóły tego rozwiązania i zastanawiamy się czy podobne podejście można by wykorzystać w świecie dokumentacji technicznej. Sprostowanie: Podczas nagrania skrótowiec ISR rozwijamy jako "Incremental Site Regeneration". To jest błąd z naszej strony, ponieważ prawidłowa wersja to "Incremental Static Regeneration". Dźwięki wykorzystane w audycji pochodzą z kolekcji "107 Free Retro Game Sounds" dostępnej na stronie https://dominik-braun.net, udostępnianej na podstawie licencji Creative Commons license CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Informacje dodatkowe: Octotype: https://octotype.app/ Profil Pablo Bermejo na LinkedIn: https://es.linkedin.com/in/pablobermejo Vercel: https://vercel.com Medium: https://medium.com/ Dev.to: https://dev.to/ Hashnode: https://hashnode.com/ GitHub Issues: https://github.com/features/issues ChatGPT: https://openai.com/blog/chatgpt/ TypeScript: https://www.typescriptlang.org/ Incremental Static Regeneration (ISR) w Next.js: https://nextjs.org/docs/basic-features/data-fetching/incremental-static-regeneration Introducing JSX: https://reactjs.org/docs/introducing-jsx.html "#32 Tech Writer zatrudnia asystenta, czyli sztuczna inteligencja w służbie dokumentacji", Tech Writer koduje: https://techwriterkoduje.pl/blog/2021/07/29/tech-writer-zatrudnia-asystenta Mastodon: https://joinmastodon.org/ diaspora*: https://diasporafoundation.org/ WordPress: https://wordpress.com/ Strapi: https://strapi.io/

Michael speaks about his experience at Amplify and the benefits of going serverless and what are some of the logistics of utilizing it.SponsorHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction00:43 Welcome Michael02:30 Background in AWS and Amplify08:01 Amplify Overview13:09 Overwhelmed by AWS21:08 Sponsor: Hashnode21:54 Amplify and SvelteKit23:45 Cold Starts and Lambda Function29:15 Terms and Definition41:03 Edge and Cloud Functions42:04 Endpoints45:42 How are APIs created?00:00 Daily.dev00:00 How to Start with AWS?00:00 Michaels New Team00:00 Picks and Plugs

Ben joins James and Amy to showcase all the wonderful things you can do with Astro as well as to have some fun.SponsorHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction00:53 Welcome Ben and Astro07:10 Funding and Roles11:38 What is Astro?17:40 When to not use Astro?21:12 Sponsor: Hashnode21:27 1.0 Launch23:23 Money Strategy25:18 Astro for Full Stack35:49 Sposor: Daily.dev36:49 Front Matter41:08 Picks and Plugs

Chris joins James and Amy to show his love for vanilla JavaScript and why returning back to the basics maybe the best thing for developers.SponsorHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:18 Why Vanilla JavaScript?02:39 Difficult Interview Questions04:01 Patterns and Conventions06:31 Code Generators10:45 Recreating Libraries?13:56 Proxies24:46 Testing26:24 Why Svelte is Different33:33 Sponsor: Hashnode34:18 Local Storage40:51 Web and Service Workers43:28 Chris's Course Platform50:50 Sponsor: Daily.dev51:51 Picks and Plugs

Brad, Amy, and James, talk with Erik about the things he's been building for Twitch and how to excell in the developer world.SponsorHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:42 Welcome Erik03:07 Value of a Degree06:32 Favorite Stacks12:24 Thoughts on Svelte and Angular16:38 Streaming and Tools21:45 Twitch Backend24:01 Sponsor: Hashnode24:46 Hosting Solutions38:21 Sponsor: Daily.dev39:21 Eriks Following45:24 Learn Do Teach Uplift48:20 Picks and Plugs

Brad and Amy discuss the great features of Remix and some of their favorite ways to utilize it.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:12 Getting into Remix05:54 Remix History08:23 Sponsor: Hashnode13:25 Nesting Routing19:12 How Links Work24:15 Server Side Generation25:01 File Location28:15 Input28:59 Writing Code39:53 Form States40:54 Boundary Components45:26 Remix Frustration54:04 Help from Tailwind57:46 Authentication00:00 Database Solutions00:00 Modeling00:00 Sponsor: Daily.dev00:00 Testing00:00 Linting and Formatting00:00 Deploying00:00 Projects for Remix00:00 Grab Bag Questions00:00 Picks and Plugs

Max discusses his start in coding as well as his work with Homebrew and his love for Open-source.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:12 Max's Career Highlight05:54 Building an App in the Open08:23 Homebrew Package Manager13:25 Why so Many Package Managers?19:12 What Makes Homebrew Standout?24:15 Sponsor: Hashnode25:01 Idea for Homebrew28:15 Language Package Managers28:59 Money Talk39:53 Sponsor: Daily.dev40:54 Distributing Sponsorship45:26 Web3 in Tea54:04 Update on Tea57:46 Shoutouts

In this episode, Mike Lynn talks with Jannik Wempe of Hashnode. Hashnode is a Blogging community for engineers, thought leaders and the wider developer community.Jannik discusses his career path to date, he ended up as a full stack software engineer and how writing developer focused content on HashNode actually led him to a role there. On his Hashnode blog, he most recently addressed the challenges of sending Mass Personalised Emails using AWS Serverless Technologies and MongoDB, and that's what brought Jannik to our attention.

Rizel from GitHub discusses the benefits to learning in public as well as her favorite parts of different frameworks.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:03 Welcome Rizel01:51 GitHub Copilot06:45 Code Spaces11:10 Live Share in Code Spaces14:14 Open Source20:17 Brads Open Source Projects23:58 Sponsor: Hashnode24:45 Books and Video for Backend28:17 Node JS Backend Job Market29:39 Astro?32:38 Sponsor: Daily.dev33:39 Learning No-js35:40 The Future of Technology39:00 Picks and Plugs43:22 Teaching to Communities46:11 Uses of JavaScript

Josh joins on the podcast to discuss Pulumi, Copilot, and all the tech buzzwords.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:15 Welcome Josh02:23 Context of Preview Deploys05:50 Does the stack matter?11:48 Developer Experience Marketing13:29 Why Remix?21:24 Sponsor: Hashnode22:09 Why Prisma and ORM?29:19 Pulumi32:04 Copilot34:20 Bring Your Own Stack38:07 Sponsor: Daily.dev39:07 Maintaining Costs40:06 Termial Set Up45:30 Picks and Plugs

Jacob discusses the ways he uses Svelte in his work at Stylitics as well as some of his personal projects.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:31 Jacob's Background03:49 Welding to Software05:29 Combining Code with Your Interests06:38 Passion10:09 Jacob's Interest in Svelte15:36 Working for Stylitics21:24 Choosing to use Svelte24:03 Finding Open-source29:05 Sponsor: Hashnode29:51 Svelete Kit Changes35:54 Sponsor: Daily.dev36:55 Other Frameworks and Side Projecst40:26 Databases42:23 Stores43:43 Picks and Plugs

Debbie discusses the importance of end to end testing as well as her work at Microsoft.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:42 Who is Debbie?02:59 Background and Interest07:26 Sharing What You Learn09:34 Microsoft12:02 5 Year Plan15:31 Imposter Syndrome18:01 Playwrite and Testing21:40 Cyprus23:18 Playwrite and Frameworks24:59 Component Testing30:46 Sponsor: Hashnode31:32 Visual Regression Testing32:27 Microsoft Integration36:04 Storybook and Percy37:28 Hiring at Microsoft38:32 Sponsor: Daily.dev39:32 Interview Process44:00 Inspiring Others48:10 Picks and Plugs

Edan discusses personal and professional challenges he faced throughout his transition into a tech career.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:11 Who is Eden?03:10 Development Experience04:59 Learning in School09:23 Handling Energy12:39 Starting Your Agency15:39 Learning Necessary Ecosystems20:18 Progression of Tools26:16 WordPress and Hosting29:21 Benefits and WordPress34:03 Sponsor: Daily.dev35:03 Side Projects42:17 Being Late to the Game46:25 Sponsor: Hashnode47:10 Important Communities53:18 Picks and Plugs

Hassan discusses his inspiration for Nuna and his philosophy behind coding.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:12 Welcome Hassan02:29 Hassan at Prisma Day05:49 JOMO09:38 Stoicism16:45 Stoicism in Programming23:10 Sponsor: Hashnode23:56 Building a Team30:33 About Nuna36:31 Privacy with Nuna37:28 Sponsor: Daily.dev38:29 Nuna Tech Stack40:33 Moving the Bot to Serverless42:59 Will Serverless Stay Cheap?45:13 Preact JS Pitch47:26 Picks and Plugs

Josh talks with James and Amy about teaching TypeScript and ESLint to beginners.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:21 Josh's Background02:45 Josh's First Project04:37 TypeScript Beginnings05:43 What is a Generic?08:44 What Makes TypeScript Interesting10:11 Transpiring12:58 Sponsor: Daily.dev13:59 Getting into TypeScript ESLint19:54 ESLint Set Up22:38 Josh's Book16:42 Measuring Book Success29:13 Sponsor: Hashnode29:59 Open Source Developer as a Job Title32:08 When Your Passion is Your Career36:34 Josh's Soapbox39:28 Pro Tips41:24 Picks and Plugs45:35 Something Annoying in ESLint46:55 More Picks and Plugs

Kenny joins us to discuss the uses for Plasmic and the advantages of its integration features.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:19 About Kenny02:20 Engineer vs Advocate03:49 Rotating Roles05:40 Code Components in Plasmic06:56 How is Plasmic Different?09:50 Integration With Other Headless CMS12:01 Using Components13:50 Teaching With Low Code17:03 Enabling Developers19:16 Integration24:24 Sponsor: Hashnode25:10 Interest in Jamstack31:19 Other Favorite?36:46 Sponsor: Daily.dev37:47 Picks and Plugs

Joe talks with Amy and James about utilizing open source as a beginner and his interest in TypeScript.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction02:04 Explaining Storybook06:03 Component Testing14:14 Storybook Inside Chromatic16:58 The Value of Testing20:55 Storybook and Redwood23:35 Sponsor: Hashnode24:21 What Chromatic Does28:30 Percy vs Chromatic34:32 Sponsor: Daily.dev35:33 Michael at Chromatic38:35 Components44:37 Picks and Plugs

Joe talks with Amy and James about utilizing open source as a beginner and his interest in TypeScript.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction02:54 Joes Background04:10 Passion for Open-source05:25 Being an Open-source Beginner11:09 How to Find a Potential Project11:54 Love for Teaching14:44 Sponsor: Hashnode15:34 TypeScript Experience17:51 8 Hours to Learn20:16 Conferences and Meetings24:31 Building Learning Tools25:59 The Power of Content30:01 Sponsor: Daiy.dev36:52 One Minute Vim Pitch

In this Episode guest Ben Haynes tells us about his work at Directus and where the software is headed next.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction02:54 Momentum04:10 Ben's Favorite Framework05:25 What problems does Directus solve?11:09 Sponsor: Hashnode11:54 How James Heard of Directus14:44 Hosting Recommendations15:34 Having a Free Tier17:51 Thoughts on TypeScript20:16 Integration with Other Ecosystems24:31 Demoing the Platform25:59 Can Directus do this?30:01 Sponsor: Daily.dev31:02 Transition to CEO36:52 Upcoming Features

Kent discusses his role at Remix and why he loves the product so much.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 Introduction01:33 Kents Background07:08 The Marketing of Remix09:08 Create Things You're Excited About11:06 Transparency and Honesty13:51 Sponsor: Hashnode14:37 Using Remix and What's Coming Soon24:49 Embracing the Web Platform32:14 How to Handle Databases37:15 Sponsor: Daily.dev38:16 Hate Tailwind?43:58 Tradeoffs

In this episode guest Tessa Mero talks to James and guest cohost Brad Garropy about working in Dev Rel and transitioning her job.SponsorsDaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes00:00 Introduction01:12 Introducing Tessa02:36 How did Brad get Into Web05:46 Draw of Developer Relations and Developer Advocacy09:46 Getting Into Speaking12:17 Preparing for Criticism17:06 Sponsor: Hashnode17:53 How to Progress Your Career22:12 Performance Indicators in Developer Relations26:39 Sponsor: Daily.dev27:40 Working for Open-source34:08 Companies that Prioritize Dev42:19 Brad's Pick: Digital Minimalism by Cal Newport44:09 Brad's Plug: Brad Garropy on YouTube44:28 Tessa's Pick: Shure SM7B47:23 Tessa's Plug: Appwrite Discord48:32 James's Pick: The Weekend Away49:39 James's Plug: James Q Quick YouTube

In this episode James Perkins talks about unexpected job changes and what it's like to work for start-ups.SponsorsHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Daily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devShow Notes00:00 - Intro03:08 - Creating Content for Companies You Like05:57 - Startups: Phases and Funding08:08 - Layoffs11:32 - Startups and Unicorns15:30 - Payouts and Stock Options21:36 - Sponsor: Hashnode22:22 - Risky Startups28:26 - Black Market Share Deals30:45 - Where to find startup jobs36:19 - Job Confidence42:49 - Sponsor: Daily.Dev43:50 - Don't Burn Bridges48:16 - Final Thoughts and Community Shoutouts

Anthony Campolo (AJC) joins us to talk about leveraging blockchain infrastructure for decentralized Web3 applications and his experience working as a Developer Advocate at QuickNode.SponsorsDaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes00:00:00 - Intro00:04:06 - Bootcamp Experiences00:09:59  - Sponsor Shoutout: Hashnode00:10:45 - Experience Working on the Core Team of Redwood.js00:18:09 - Sponsor Shoutout: Daily.dev00:19:10 - Defining Web3, Blockchain, and Cryptocurrencies00:27:24 - What is QuickNode? - Blockchain API and Node Infrastructure00:28:54  - The Future of Web3?00:35:48 - Building a Hello World Smart Contract00:43:04 - Closing Thoughts on Web3 and the BlockchainLinksAnthony on Twitter - https://twitter.com/ajcwebdevQuickNode - https://www.quicknode.com/How to Create a dApp on Avalanche's Fuji Testnet with QuickNode: https://www.quicknode.com/guides/web3-sdks/how-to-create-a-dapp-on-avalanches-fuji-testnet-with-quicknodeA First Look at Deploying Smart Contracts: https://www.youtube.com/watch?v=RvvMWGPJVUIA Crash Course in Web3 for Web2 Developers: https://youtube.com/watch?v=kl5nNRKemkY

Corbin Crutchley joins to talk about how to learn Frontend Frameworks better with his upcoming eBook The Framework Field Guide, https://unicorn-utterances.com/collections/framework-field-guide. SponsorsDaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show NotesUnicorn Utterances - https://unicorn-utterances.com/Framework Guide - https://unicorn-utterances.com/collections/framework-field-guideAccelerating Angular Development with Ivy - https://www.packtpub.com/product/accelerating-angular-development-with-ivy/9781800205215Learning TypeScript from Josh Goldbergy - https://www.amazon.com/Learning-TypeScript-Development-Type-Safe-JavaScript/dp/1098110331Brad Garropy - https://bradgarropy.com/00:00:00 - Welcome and Intros00:02:12 - Awkward Question of the Day and Rants00:07:18 - Background in Writing and Content Creation00:11:19 - Imposter Syndrome as a Writer00:15:01 - Sponsor Daily.dev00:16:02 - The Framework Field Guide - Learning the Core of Frontend Frameworks00:23:36 - Comparing Modern Frontend Frameworks00:27:42 - Sponsor Hashnode00:28:28 - The Tech Stack Behind the Book00:33:36 - Why Create a Free Book00:41:21 - Future Content Goals00:50:55 - Picks and Plugs

Adam Bradley joins to talk about some amazing new projects to help increase performance and productivity in Web Development: Partytown, Qwik, and Builder.io.SponsorsDaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes00:00:00 - Intros00:00:52 - Adam Bradley Introductions, Origins of Stencil and Ionic00:08:16 - Qwik Performance Overview00:15:31 - Sponsor Shoutout - Daily.dev00:16:32 - Intelligent JavaScript Bundling and Prefetching00:24:26 - Qwik vs Astro00:29:40 - Sponsor Shoutout: Hashnode00:30:26 - Learning in Modern Web Development00:33:18 - Web Workers and Partytown00:45:07 - Builder.io - "Drag and Drop on Your Tech Stack"

Colby Fayock joins the show to talk about his developer background, experience as a Content Creator, and his role as a Developer Advocate at Cloudinary.SponsorsDaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes00:00:00 - Intro00:00:58 - Colby's Intro and Background00:03:01 - Colby Background and Content Creation00:06:16 - Wordpress Development and Why It's Still Relevant00:09:23 - Favorite Wordpress Hosts00:11:50 - Security Concerns with Wordpress as a Headless CMS00:12:57 - Headless eCommerce00:16:26 - Thought Leadership and Being an "Influencer"00:18:05 - Creating Accessible Content00:21:48 - How We Plan Content00:22:35 - Updating Outdated Content00:25:45 - Colby's Role as Developer Advocate at Cloudinary00:28:17 - Cloudinary Features00:32:24 - Cloudinary and Wordpress Integration00:39:50 - Colby's Astro Brand Explained00:40:57 - Community Shoutouts00:41:42 - Colby Rant on Moving Past Your Initial Barrier to Entry

Our Twitter space: https://twitter.com/Chau_codes/status/1560749221447286784Hour 1 was Q&A - comparing notes on Vercel vs Airbyte, going deep/leveling up in DevRel (Building your Lightsaber) and on content creation (Dev.to vs Hashnode vs Substack)Hour 2 was Video/YouTube/Twitch focused since Theo joined!Previous Devrel Real Talks: https://mixtape.swyx.io/episodes/weekend-drop-devrel-real-talk-ep-1-ft-justin-garrison-micheal-benedict-zack-hoherchak https://mixtape.swyx.io/episodes/devrel-real-talk-making-2m-yr-in-devrel-ft-rebecca-marshburn-and-nader-dabit Our guests: Hassan https://twitter.com/nutlope Alex https://twitter.com/alexandereardon Nairobi https://twitter.com/Tech4Abolition Theo https://twitter.com/t3dotgg Justin https://twitter.com/rothgar Our hosts: https://twitter.com/Chau_codes https://twitter.com/RealChrisSean https://twitter.com/swyx

Our featured guest for this episode is Nadar Dabit. He explains blockchain, decentralization, Web3, its future, volatility, and how you might get started in this space.SponsorsDaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction0:31 Nader Dabit Intro and Working in Dev Rel4:19 What is web3 and why the shift to web3?10:12 Sponsor: Hashnode10:58 GraphQL in Web312:23 What Does Decentralized Mean?16:33 The Business Model of Web318:20 What is the Blockchain25:46 Sponsor: Daily.dev26:47 Volatility in Web329:07 The Difficulty of Finding Developers in the Web3 Space30:04 Nader's Thoughts on the Future34:04 How Web3 Affects Content Creators35:14 Wrap Up

In this episode, the tables are turned and you get a different perspective. Sunjay Armstead, is a UI/UX Designer and Developer at ZEAL. Here, he interviews Amy and asks her about leading a team and being a female in the tech industry.Sponsorsdaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction2:05 What can beginners do to prepare to work on a design / dev team?5:05 Contributing to Open SourceBrian Douglas9:58 Sponsor: Hashnode10:43 What have you learned to so far about leading a team? Challenges, frustrations, highlights?13:36 What ways have you seen your team help you get better?17:33 How do you know what's genuine, constructive critique vs unfounded opinion?19:38 Are there other ways that you can make a design objective?21:11 Sponsor: Daily.dev22:12 What ways has the industry improved and what things still need attention?25:28 What are some of the things that your bosses and coworkers have done right that has been inclusive and that helps you feel part of the team?27:46 What do you do to attend to the different areas of your life?

In this episode our guest, Brad Garropy explains his setup for increasing the developer experience and making his developer experience better. He's created several tools along the pipeline.Sponsorsdaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction4:08 Rants5:39 Introducing Brad Garropy7:39 Developer Tooling8:50 Dot Files RepoWes Bos's Dot FilesBrad Garropy's Dot Files12:38 VS Code SnippetsBrad's VS Code Snippets15:19 NPM PackagesBrad's NPM PackageshttpLabman26:08 Sponsor: Daily.dev30:18 YouTube Shorts32:53 Sponsor: Hashnode33:39 Code Generation and Generating All Kinds of ThingsPlop37:57 GitHub Repository Templates43:55 Picks and Plugs44:04 Brad's Picks: Oculus Quest 246:51 Brad's Pick: Yellowstone47:26 Brad's Pick: Halo49:01 Brad's Plugs: Brad Garropy on YouTube49:39 Amy's Pick: Body Glide51:09 Amy's Plug: Everything Svelte

This episode features Ken Jones, his side project Birdables that's he's turned into an NFT and printed actual trading cards. Ken also runs a small web agency and builds websites in various technologies.Sponsorsdaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction1:36 Introducing Ken Jones1:57 Birdables3:14 Process of Creating the CardsPrint of FigmaTiny Image Compressor5:48 Getting the Cards Printed9:12 NFTs and Minting the CardsOpen Sea13:09 Working with SvelteKitpnpm17:29 Sponsor: Hashnode18:15 No Code / Low Code ToolsWebflowNetlifyBubble27:29 Sponsor: Daily.dev28:29 Determining which tech stack is best for a specific project30:42 Niche Marketing and Tracking UsersBrennan DunnDripMastering ConvertKitRight Message35:45 Client Process38:48 Wrapping UpSvelte SirensEverything Svelte

In this episode, our guest, Swyx talks about how part-time creators have an advantage over full-time content creators, leading indicators when creating content, networking and engaging with your audience, and creating luck.Sponsorsdaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction2:06 Introducing SwyxCoding Career HandbookPart-Time Creator Manifesto3:28 Why Writing?7:16 Priority and Time9:45 Better to be Part-Time Creator than a Full-Time Creator12:16 Do you set up a business entity?13:22 Consistency16:49 Lower the Barrier to Entry20:16 Sponsor: Daily.dev21:17 How much do you pay attention to growth?22:37 What is the leading indicator?Second Brain24:17 Engaging with your Audience25:24 Ratio of One for me, One for Them31:44 Networking34:43 Niching37:18 Sponsor: Hashnode38:04 What's a sustainable action plan for part-time content creation40:23 Getting your stuff stolen41:41 Creating Luck48:31 Community Shout outsMonica Lent: Blogging for DevsCoding Career on Twitter

This episode features Nikolas Burke, Head of Dev Rel at Prisma. Prisma is an abstraction layer for managing and interacting with your database.Sponsorsdaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction1:59 Parenting Tips and Quick Rants5:11 Frontend Developers Becoming Backend / Full Stack7:47 What is an ORM and Why does it Make Working with Databases More Accessible?16:53 Differences with Prisma21:37 Sponsor : Daily.dev22:38 Speed of Working with Prisma23:43 Migrations26:51 Prisma Commands33:42 Sponsor: Hashnode34:27 Prisma: Under the HoodKeystoneJS on Level Up TutorialsEpisode 54: Why RedwoodJS is the App Framework for Startups with David PriceAmplicationEpisode 59: Let's be Animated41:52 Final Thoughts44:41 How should people get started with Prisma?

In this episode, our guest, Brittney Postma talks about the Developer Experience (DX) and how it important it is to the work that we do and the frameworks that use.Sponsorsdaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introduction1:34 Introducing Brittney PostmaGraingercodingcat.devSvelteSirens2:10 Quick Rants, Hot Takes, and Parenting Tips6:22 Developer ExperienceSarah Drasner on the Developer Experience10:21 Sponsor: Hashnode11:10 Developer Experience through Documentation13:34 Tools around the Developer Experience16:54 The Developer Experience when Working on Client ProjectsEpisode 5: Starting a New Project21:18 Developer Experience with Education22:36 Sponsor: Daily.dev - http://daily.dev23:36 Developer Experience when Onboarding28:23 Things to Take into Account when Creating Content33:50 What Advice do you have a Student that's Trying to make Career Choices?Episode 43: New Beginnings for New DevelopersEpisode 35: Crossover Episode with Brittney and AlexFreecodecamp.com35:38 My Vanilla JavaScript is alight and not great, my company wants me to work with Vue JS already. They say I'll learn JavaScript also in a good way while working with the framework right away. What do you guys think?Beginner JavaScriptWes Bos's Courses38:46 Is the dev industry saturated?41:57 Closing Thoughts

Hi there! Thanks for listening, and I hope you'll subscribe to follow along on my journey!Episode Overview:A walkthrough of publishing my second digital product of the year: Sacred Geometry. I discuss my motivations for this type of design-centric product as well as describe the process I went through to create and iterate it. Also, why I made it FREE. I give my brief take on using the Gumroad platform and on my continued product & project creation for 2022. Below is the link to my blog post which was featured on Hashnode. Resources mentioned: Sacred Geometry Blog Post (featured on Hashnode!) Gumroad Platform Youtube Walkthrough of Sacred Geometry My Free Personal Finance Google Sheet P5.js Links for the coding challenge I'm doing: 2022 Web Developer Challenge 100 Days of Code freeCodeCamp freeCodeCamp Become A Dev Challenge Log (free Google spreadsheet I made for you to track your own motivations, notes and progress for the Web Developer Challenge) Tweet at me My other podcasts re-verse Sieis Soundtracks fna show Swansong I would love to hear from you! Find me on eamonncottrell.com Follow me on Twitter @EamonnCottrell  Follow me on Linkedin @EamonnCottrell Follow me on gitHub @sieis

This episode features Bekah Hawrot-Weigel as she talks about how Virtual Coffee got started, the role of storytelling within communities, and the importance of learning the basics in development.SponsorsHashnodedaily.devdaily.dev is where developers grow together. It provides a community-based feed of the best developer news, helping you stay up-to-date. daily.dev aggregates hundreds of sources every few minutes and creates a personal feed for you according to your interests, whether it's web dev, data science, or Elixir. Anything you might be interested in, it has the content for you.Check out daily.devHashnodeCreating a developer blog is crucial in creating an online presence for yourself. It's proof of work for your future employer. Hashnode makes it easy to start a blog in seconds on your custom domain for free. It's fully optimized for developers and supports writing in Markdown, rich embeds, publishing from GitHub repository, syntax highlighting, and edge caching with Next.js blogs deployed on Vercel. On top of these, Hashnode is free from paywall, ads, and sign-up prompts.Hashnode is a community of developers, engineers, and people in tech. Your article gets instant readership from their growing community.Check out Hashnode, and join the community.Show Notes0:00 Introducing: Bekah Hawrot-Weigel2:10 Parenting Tips4:43 Virtual Coffee11:01 Tech Stack for the WebsiteEleventyRemixCraftCMS13:03 Learning New TechnologiesJekyllTensorFlowGant Laborde Book18:13 Sponsor: daily.dev19:13 Working with the Basics24:03 Asking QuestionsVirtual Coffee Discussions on GitHub30:51 Participating in a Community35:34 Sponsor: Hashnode36:23 Renaming Networking to Investing in Your Community40:25 Answering "Why Should we Hire You?"41:12 Finding the Community that you want to be Part Of Through StorytellingHow to get Run Over by a Truck48:29 Soapbox: A Person Centered Approach to Build Both Internal and External CommunitiesNever Split the Difference52:54 Community Shout OutsVirtual CoffeeCincinatti Software Craftsmanshipcfe.devLearn Build Teach Discord CommunityYou Got This Events

In this episode of Syntax, Wes and Scott talk with Ben Vinegar about his work with Sentry, their migration to TypeScript, and advice for running JavaScript on other websites. Kontent by Kentico - Sponsor Kontent by Kentico is a headless CMS that provides live editing experience to non-technical users and hands you the technical tools to build websites, mobile apps, voice assistants, or anything else where you need content. Use REST API or GraphQL and get your content via the global Fastly CDN. Designed to unify all your content and operations, in compliance with ISO27001 and SOC2Type2 certifications.Spin up a new project today and discover Kontent. Hashnode - Sponsor Everything you need to start blogging as a developer. Own your content, share ideas, and connect with the global dev community! Hashnode is a free developer blogging platform that allows you to publish articles on your own domain and helps you stay connected with a global developer community. Hashnode: Everything you need to start blogging as a developer! Show Notes Ben Vinegar 00:20 Guest introduction 05:58 Seeing bug reports from Sentry 07:38 Distributed tracing for full stack developers 12:16 Amazon X Ray AWS Xray 15:32 Using Tracing 19:40 Sponsor: Kontent by Kentico 20:58 Cloudflare Worker Integration 22:30 How does Sentry have open source and a business? Heroku App Platform Media Temple Dreamhost WordPress Calypso 32:30 Sponsor: Hashnode 34:07 What is the tech stack of Sentry? 38:20 Sentry switching to TypeScript Sentry switching to TypeScript 44:36 Running JavaScript on other websites 51:24 Sponsor: Sentry 53:08 Sick Picks ××× SIIIIICK ××× PIIIICKS ××× Scott: Last Seen Wes: SEOUL Sisters Korean Kimchi Seasoning Ben: Worst Scene / Best Scene I Was There Too Shameless Plugs Scott: LevelUp Tutorials Wes: Wes Bos Tutorials Tweet us your tasty treats Scott's Instagram LevelUpTutorials Instagram Wes' Instagram Wes' Twitter Wes' Facebook Scott's Twitter Make sure to include @SyntaxFM in your tweets  

In this Hasty Treat, Scott and Wes talk about the pros and cons of JavaScript servers, Serverless, and Cloudflare Workers. Hashnode - Sponsor Everything you need to start blogging as a developer. Own your content, share ideas, and connect with the global dev community! Hashnode is a free developer blogging platform that allows you to publish articles on your own domain and helps you stay connected with a global developer community. Hashnode: Everything you need to start blogging as a developer! Linode - Sponsor Whether you're working on a personal project or managing enterprise infrastructure, you deserve simple, affordable, and accessible cloud computing solutions that allow you to take your project to the next level. Simplify your cloud infrastructure with Linode's Linux virtual machines and develop, deploy, and scale your modern applications faster and easier. Get started on Linode today with a $100 in free credit for listeners of Syntax. You can find all the details at linode.com/syntax. Linode has 11 global data centers and provides 24/7/365 human support with no tiers or hand-offs regardless of your plan size. In addition to shared and dedicated compute instances, you can use your $100 in credit on S3-compatible object storage, Managed Kubernetes, and more. Visit linode.com/syntax and click on the “Create Free Account” button to get started. Show Notes 00:26:13 Welcome 01:12:15 Sponsor: Hashnode 02:27:10 Sponsor: Linode 03:30:09 Topic introduction Netlify Functions Fastify AWS Lambda 09:46:02 Hosted Linux servers 13:41:11 Serverless functions MongoDB SvelteKit 16:34:02 Connecting to a database in serverless 20:14:14 Cloudflare Workers Cloudflare Workers Works with Workers 25:39:09 What do we recommend? Render.com Tweet us your tasty treats Scott's Instagram LevelUpTutorials Instagram Wes' Instagram Wes' Twitter Wes' Facebook Scott's Twitter Make sure to include @SyntaxFM in your tweets

In this episode of the Tiaras and Tech podcast, Shelley Benhoff talks to Sumudu Siriwardana on the topic of being a Project Leader vs. Project Manager. Shelley is a Business Owner, Author, and Professional Speaker. She is also a Sitecore Technology MVP with experience as a Lead Developer for many years. Intro Hello Gems! Welcome to another episode of Tiaras and Tech. I'm your host, Shelley Benhoff, and today I'm talking to Sumudu Siriwardana about Being a Project Leader vs. Project Manager. She is a Project Manager at Hashnode, aspiring web developer, tech influencer, and a Mother. We talked about the importance of emotional intelligence, the relationship between dev and PM, and our thoughts on project management practices gone wrong. Without further ado, on to the episode! Links to learning resources: Freecodecamp - https://www.freecodecamp.org/ Scrimba - https://scrimba.com/ The Odin Project - https://www.theodinproject.com/ Traversy Media - https://www.youtube.com/c/TraversyMedia The Net Ninja - https://www.youtube.com/c/TheNetNinja Kevin Powell - https://www.youtube.com/kepowob The Complete JavaScript Course 2022: From Zero to Expert by Jonas Schmedtmann - https://www.udemy.com/course/the-complete-javascript-course/ Connect with Sumudu! https://twitter.com/sumusiriwardana https://www.linkedin.com/in/sumudusiriwardana/ Connect with Shelley! https://twitter.com/sbenhoff https://pluralsight.pxf.io/mgGLbO Tiaras and Tech is dedicated to providing inspiration for women & marginalized groups in tech. We aim to provide support, celebrate successes, & discuss how we're treated. Follow us! YouTube, Twitter, TikTok, Instagram @tiarasandtech tiarasandtech.com Tiaras and Tech is a HoffsTech production. Theme music by Nobuo Uematsu and Juan Medrano https://ocremix.org/remix/OCR03610 --- Support this podcast: https://anchor.fm/tiaras-and-tech/support

In this episode of Syntax, Wes and Scott talk through their predictions for 2022. LogRocket - Sponsor LogRocket lets you replay what users do on your site, helping you reproduce bugs and fix issues faster. It's an exception tracker, a session re-player and a performance monitor. Get 14 days free at logrocket.com/syntax. Hashnode - Sponsor Everything you need to start blogging as a developer. Own your content, share ideas, and connect with the global dev community! Hashnode is a free developer blogging platform that allows you to publish articles on your own domain and helps you stay connected with a global developer community. Hashnode: Everything you need to start blogging as a developer! Freshbooks - Sponsor Get a 30 day free trial of Freshbooks at freshbooks.com/syntax and put SYNTAX in the "How did you hear about us?" section. Show Notes 00:11 Welcome... 01:31 Svelte is king Svelte Svelte Kit 03:57 Next.js Next.js Next.js Live 06:40 Web components Open UI Syntax 353 Stylin the Unstylables 11:42 Rust popularity Rust Rome 15:58 Sponsor: LogRocket 17:12 Serverless and Cloud Functions 18:19 Cloudflare becoming a major player Cloudflare Pages 20:05 Tailwind Tailwind Open Props 24:10 Glow Up 24:35 Next gen dev tools OhMyZsh Warp Fig iTerm Starship 27:32 Sponsor: Hashnode 29:48 CSS Container queries, Layers, and More! 31:45 GraphQL 34:13 Deno Deno 37:41 Typescript 43:36 Server come back 45:13 Sponsor: Freshbooks 46:02 Checkouts and payment processors Wise 51:30 Temporal API 53:20 Remote Dev / Thin Client 55:16 Sick Picks 00:16 Shameless Plugs ××× SIIIIICK ××× PIIIICKS ××× Scott: A Show About Animals Wes: Wise Shameless Plugs Scott: Astro Course - Sign up for the year and save 50%! Wes: All Courses - Black Friday sale! Psychology of Devx Gitpod Community Workshops as Code Ghuntley.com Tweet us your tasty treats Scott's Instagram LevelUpTutorials Instagram Wes' Instagram Wes' Twitter Wes' Facebook Scott's Twitter Make sure to include @SyntaxFM in your tweets

Listen now | Pivoting from carpenter to successful web developer in less than a year! My guest for this episode is Sam Sycamore. Sam is a writer, web developer, tree hugger & avowed music junkie. He currently works as Head of Content Strategy & Marketing at Hashnode, a global tech blogging platform that enables bloggers to tap into a fast-growing & supportive community of readers, writers, and tech enthusiasts. Sam is the poster child of taking control of your life and investing in yourself. But, it wasn’t easy… This is a public episode. Get access to private episodes at newsletter.invinciblecareer.com/subscribe

In this episode, we hear from Edidiong Asikpo, a software developer, content creator, and Hashnode Developer Advocate based in Nigeria. We touched on a little of everything! Edidiong shares her interesting journey into tech, touches on Hashnode now and what's to come, developer advocacy tips, the growing developer community in Nigeria, positive takeaways from the pandemic, and tips for software devs general.Edidiong Asikpo is Frontend Developer and Content Creator who currently works as a Developer Advocate at Hashnode. She has given over 50+ talks at various tech conferences/meetups worldwide and played a significant role in building 3 of the most impactful developer communities in Africa. Edidiong writes technical articles about web development, blogging for developers, soft skills, and Open Source contributions on her blog.Edidiong was so fun to chat with and super inspiring! Listen now wherever you access your podcasts. (And if you haven't already, check out the HarperDB + Hashnode Joint Hackathon happening this month: https://townhall.hashnode.com/announcing-harperdb-hackathon-on-hashnodeEdidiong's TwitterHarperDB's Twitter

Chris Bongers is a digital nomad and the author of daily-dev-tips.com joins A-P Koponen on the Frontend Greatness podcast to talk about "Building an Online Network of Peers." In this episode: - How Christ ended building a network of peers. - Why a network of peer outside your current company is so valuable. - How to find and connect with peers online. --- This episode is sponsored by Supermetrics. They are hiring Senior React Developers: https://careers.supermetrics.com/jobs/1070468-senior-react-developer --- Episode Notes Social - Chris' Twitter: https://twitter.com/DailyDevTips1 - A-P's Twitter: https://twitter.com/apkoponen Show Notes - Daily Dev Tips Blog: https://daily-dev-tips.com/ - Blogging for Devs: https://bloggingfordevs.com/ - Reactiflux: https://www.reactiflux.com/ Chris' Recommendations - Hacktoberfest: https://hacktoberfest.digitalocean.com/ - Hackathons - Instead of consuming, interact with content. - daily.dev: http://daily.dev/ - Hashnode: https://hashnode.com/ - Dev.to: http://dev.to/ - freeCodeCamp: https://www.freecodecamp.org/ - The Odin Project: https://www.theodinproject.com/

In today’s episode of React Round Up, Nigerian-based developer Dillion Megida explains how you can create source plugins for Gatsby, the static site generation tool. Gatsby can be used to create landing pages, blogs and e-commerce sites, among other things, and it contains a vast plugin ecosystem that helps developers avoid reinventing the wheel when creating their applications. Dillion also shares his experience blogging for websites such as LogRocket, FreeCodecamp and Dev.to and talks us through his workflow and how he comes up with new article ideas. Panel Carl Mungazi Paige Niedringhaus TJ Vantoll Guest Dillion Megida Sponsors Dev Influencers Accelerator React Error and Performance Monitoring | Sentry Links How to Build a Gatsby Source Plugin, using Hashnode as an example Paige Niedringhaus Gatsby Plugin Library TheWebFor5 Web sharing API A deep dive into queues in Node.js gatsby-source-medium Hashnode Twitter: Dillion Megida ( @iamdillion ) Dillion Megida - Frontend Engineer and Technical Writer Picks Carl- BBQ tips  Carl- JAMstacked newsletter  Dillion- Cypress Paige- Battery Chargers - OptiMate TJ- Remotion TJ- Remotion demo

Learn how to develop a habit of learning in public, writing daily, and helping your audience. Chris Bongers has been sharing software development tips every day for the past 250 days on his blog Daily Dev Tips and on twitter.Here's what we talked about: How Chris got started with writing How he wrote more than 250 articles during lockdown Which daily tips were the most popular How he comes up with ideas for Daily Dev Tips. Spoiler alert: by working in public, he gets lots of suggestions from his followers. Win-win! The benefits of learning in public and writing every day for Daily Dev Tips How he manages his energy levels and productivity, and avoids burnout What helped him grow his audience SEO and blogging tips for beginners Where should you share your blog posts: on Hashnode or dev.to? How hiking is the best activity for writers Thanks to our sponsors: VanHack helps great tech talent get jobs abroad, even during the pandemic!Links: Daily Dev Tips Chris Bongers on Twitter Blogging for Devs Community Subscribe to our newsletter Visit the hexdevs blog