Place in Jalal-Abad Region, Kyrgyzstan
POPULARITY
Note: This episode was recorded before Apple announced the preorder and launch details of Apple Vision Pro. Oliver Weidlich is Director of Design and Innovation at Contxtual. We discuss his design work in spatial computing that predates Apple's unveiling of visionOS by several years. We also dive into his experiences with other headsets including the HoloLens and the Magic Leap 1/2. This episode is sponsored by Glisten. Glisten is the "Good Listen" podcast app for Language Learners. It's all you need to immerse yourself in a language, on the path to becoming fluent. Learn more at www.glisten.ist. Download Glisten now for iPad, iPhone, and Apple Watch. Bonus content and early episodes with chapter markers are available by supporting the podcast at www.visionpros.fm/patreon.Bonus content and early episodes are also now available in Apple Podcasts! Subscribe today to get instant access to iPad Possibilities, iPad Ponderings, and iPad Historia!Show notes are available at www.VisionPros.fm. Feedback is welcomed at tim@visionpros.fm.Links: https://mastodon.social/@oliverwhttps://www.contxtu.al/spatialcomputinghttps://www.thisishcd.com/episode/oliver-weidlich-creating-immersive-experiences-with-spatial-computinghttps://ieeexplore.ieee.org/document/10269051https://www.aweasia.com/blog/oliver-weidlichChapter Markers:00:00:00: Opening00:01:49: Support the Podcast00:02:32: Oliver Weidlich00:07:00: Unlimited apps00:10:33: What have you designed in the past?00:11:28: What headsets have you tried?00:18:26: Magic Leap00:21:31: Outdoors00:22:16: Your first experience 00:23:46: Hololens00:26:30: Apple's potential00:29:14: Sponsor - Glisten00:30:51: What has your team been working on?00:35:30: Unity00:36:31: Buying AVP in Australia00:36:49: Spatial Computing00:38:36: API Limits00:42:34: Year to year upgrades00:45:54: Interaction Methods00:50:25: ARKit apps in visionOS?00:52:21: AR Research Paper00:56:32: AI00:58:57: Australia01:00:29: What questions do you want Apple to answer?01:02:46: Anything else?01:07:00: Where can people follow you online?01:08:02: Closing Hosted on Acast. See acast.com/privacy for more information.
Aiškėjant kitų metų biudžeto projekto apmatams, sunerimo dalis mokytojų dalykininkų, taip pat vadovėlių leidėjai. Juos pasiekė žinia, esą kitiems metams vieno vaiko vadovėliams pirkti bus skirta vos 21 euro suma.Tiesa, Švietimo, mokslo ir sporto ministerija buvo prašiusi Finansų ministerijos padidinti mokinio krepšelyje esančių lėšų sumą vadovėliams pirkti iki 26 eurų.Dėl šios situacijos visos pagrindinės šalies vadovėlių leidyklos šią savaitę išsiuntė raštą Seimo Švietimo ir mokslo, taip pat Seimo ir Biudžeto komitetui, Švietimo, mokslo ir sporto bei Finansų ministerijoms.Kiek šiems metams iš viso numatyta lėšų nelyginių klasių mokinių vadovėliams pirkti? Ir ar jų pakaktų aprūpinti visus mokinius reikiamais visų dalykų vadovėliais, jei žinoma, jie būtų parašyti ir išleisti? Kiek kitiems metams prašoma iš Finansų ministerijos lėšų lyginių klasių mokinių vadovėliams pirkti? Ir ar pavyks gauti prašomą sumą? Pagaliau ar ši suma yra tokia, kuri leistų visoms šalies mokykloms nupirkti visus reikiamus vadovėlius?O ir kiek išeitimi iš situacijos galėtų būti skaitmeniniai vadovėliai?Laidoje dalyvauja Seimo Švietimo ir mokslo komiteto pirmininkas prof. Artūras Žukauskas, Geografijos mokytojų asociacijos prezidentas ir leidyklos „Didakta“ akcininkas Rytas Šalna bei Švietimo, mokslo ir sporto ministerijos Ugdymo departamento direktorė Jolanta Navickaitė.Ved. Jonė Kučinskaitė
The trio are trying to run the visionOS sample apps, but broken Xcode betas are getting in the way! Undeterred, Kotaro leads a discussion on what you can learn via the four visionOS demo apps (if you get them running). Then, the trio speculates about the forthcoming dev kits, Steve brings up the movie Hackers (because it's awesome!), and we end the show with some truly "bad app ideas." We are taking baby steps into our spacial computing developer journeys! ## Topics Discussed: - Beta cycle breakage! - The Four Apps & More - https://developer.apple.com/documentation/visionos/world - https://developer.apple.com/documentation/visionos/diorama - https://developer.apple.com/documentation/visionos/happybeam - https://developer.apple.com/documentation/visionos/destination-video - Learn about visionOS - https://developer.apple.com/visionos/learn/ - Hello World - Introduce you to Windows, Volumes, Spaces - Happy Beam - Mixed immersive, ARKit for hand shape - Physics via ARKit - Meet ARKit for spatial computing - https://developer.apple.com/videos/play/wwdc2023/10082/ - Diorama - 3D map to show shader stuff in a Volume - Destination Video - Multiplatform video playback app - SharePlay - Xcodes.app - manage multiple Xcode versions - https://github.com/XcodesOrg/XcodesApp - Dev Kits Coming Soon? - Work with Apple section on Developer site - Coming in July - VR Gaming Thoughts - VR Gaming in Hackers - https://www.youtube.com/watch?v=rQ7o3ziR5io - What is Vision Pro For? - Desktop metaphors - M2 - iPad/iPhone apps - For Next Time - Hopefully run all these apps in beta 4! - Steve: Load an image and put a filter on it! - Kotaro: UI component exploration & PencilKit. - Aaron: ARKit physics (if it works in the beta) - Bad App Ideas (Gone Good?) - Book Shelf AR Cover Visualizer - visionOS Fart App - visionOS fire/ice hand beams - visionOS movie theater apps - visionOS tabletop card games - visionOS virtual telegram - Next Time: - Big corporation bad ideas - Wrap-Up - Not a Sponsor: https://GetClipDish.com Intro music: "When I Hit the Floor", © 2021 Lorne Behrman. Used with permission of the artist.
- Rundkurs im Nirgendwo: Apples geheime Autoteststrecke - Mac-Saison beendet? Wann weitere Neuerscheinungen folgen - Phil gegen Phil: Früherer App-Store-Chef teilt aus - Unfall oder Tanz? Apples Autounfallerkennung hakt auf Festival - Apple und die Äpfel: Was den Schweizern künftig blüht - Umfrage der Woche - Zuschriften unserer Hörer === Anzeige / Sponsorenhinweis === Exklusiv! Schnapp dir den NordVPN-Deal ➼ https://nordvpn.com/apfelfunk Jetzt risikofrei testen mit der 30-Tage-Geld-zurück-Garantie! === Anzeige / Sponsorenhinweis Ende === - Mac & i: Journalisten finden geheime Autoteststrecke - https://www.heise.de/news/Apples-Project-Titan-Journalisten-finden-geheime-Autoteststrecke-9200614.html - Mac & i: Nächste Macs erst nächstes Jahr - https://www.heise.de/news/Naechste-Macs-erst-naechstes-Jahr-iMac-M3-im-Fruehjahr-MacBook-Air-M3-im-Sommer-9197612.html - Mac & i: Früherer App-Store-Chef hat noch eine Rechnung offen - https://www.heise.de/news/Kritik-an-Apple-Frueherer-App-Store-Chef-hat-noch-eine-Rechnung-offen-9198625.html - Mac & i: Ungewollte iPhone-Notrufe bei Musikfestival - https://www.heise.de/news/Apples-Autounfallerkennng-Ungewollte-iPhone-Notrufe-bei-Musikfestival-9198629.html - Mac & i: Apple und das Risiko für die Marke - https://www.heise.de/hintergrund/Streit-in-der-Schweiz-Warum-Apples-Appetit-auf-den-Apfel-nicht-jedem-schmeckt-9196533.html Kapitelmarken: (00:00:00) Begrüßung (00:10:35) Werbung (https://nordvpn.com/apfelfunk) (00:13:17) Themen (00:14:22) Rundkurs im Nirgendwo: Apples geheime Autoteststrecke (00:40:20) Mac-Saison beendet? Wann weitere Neuerscheinungen folgen (00:54:05) Phil gegen Phil: Früherer App-Store-Chef teilt aus (01:00:34) Unfall oder Tanz? Apples Autounfallerkennung hakt auf Festival (01:09:05) Apple und die Äpfel: Was den Schweizern künftig blüht (01:19:41) Umfrage der Woche (01:26:58) Zuschriften unserer Hörer
2023 is the year of Multimodal AI, and Latent Space is going multimodal too! * This podcast comes with a video demo at the 1hr mark and it's a good excuse to launch our YouTube - please subscribe! * We are also holding two events in San Francisco — the first AI | UX meetup next week (already full; we'll send a recap here on the newsletter) and Latent Space Liftoff Day on May 4th (signup here; but get in touch if you have a high profile launch you'd like to make). * We also joined the Chroma/OpenAI ChatGPT Plugins Hackathon last week where we won the Turing and Replit awards and met some of you in person!This post featured on Hacker News.Out of the five senses of the human body, I'd put sight at the very top. But weirdly when it comes to AI, Computer Vision has felt left out of the recent wave compared to image generation, text reasoning, and even audio transcription. We got our first taste of it with the OCR capabilities demo in the GPT-4 Developer Livestream, but to date GPT-4's vision capability has not yet been released. Meta AI leapfrogged OpenAI and everyone else by fully open sourcing their Segment Anything Model (SAM) last week, complete with paper, model, weights, data (6x more images and 400x more masks than OpenImages), and a very slick demo website. This is a marked change to their previous LLaMA release, which was not commercially licensed. The response has been ecstatic:SAM was the talk of the town at the ChatGPT Plugins Hackathon and I was fortunate enough to book Joseph Nelson who was frantically integrating SAM into Roboflow this past weekend. As a passionate instructor, hacker, and founder, Joseph is possibly the single best person in the world to bring the rest of us up to speed on the state of Computer Vision and the implications of SAM. I was already a fan of him from his previous pod with (hopefully future guest) Beyang Liu of Sourcegraph, so this served as a personal catchup as well. Enjoy! and let us know what other news/models/guests you'd like to have us discuss! - swyxRecorded in-person at the beautiful StudioPod studios in San Francisco.Full transcript is below the fold.Show Notes* Joseph's links: Twitter, Linkedin, Personal* Sourcegraph Podcast and Game Theory Story* Represently* Roboflow at Pioneer and YCombinator* Udacity Self Driving Car dataset story* Computer Vision Annotation Formats* SAM recap - top things to know for those living in a cave* https://segment-anything.com/* https://segment-anything.com/demo* https://arxiv.org/pdf/2304.02643.pdf * https://ai.facebook.com/blog/segment-anything-foundation-model-image-segmentation/* https://blog.roboflow.com/segment-anything-breakdown/* https://ai.facebook.com/datasets/segment-anything/* Ask Roboflow https://ask.roboflow.ai/* GPT-4 Multimodal https://blog.roboflow.com/gpt-4-impact-speculation/Cut for time:* WSJ mention* Des Moines Register story* All In Pod: timestamped mention* In Forbes: underrepresented investors in Series A* Roboflow greatest hits* https://blog.roboflow.com/mountain-dew-contest-computer-vision/* https://blog.roboflow.com/self-driving-car-dataset-missing-pedestrians/* https://blog.roboflow.com/nerualhash-collision/ and Apple CSAM issue * https://www.rf100.org/Timestamps* [00:00:19] Introducing Joseph* [00:02:28] Why Iowa* [00:05:52] Origin of Roboflow* [00:16:12] Why Computer Vision* [00:17:50] Computer Vision Use Cases* [00:26:15] The Economics of Annotation/Segmentation* [00:32:17] Computer Vision Annotation Formats* [00:36:41] Intro to Computer Vision & Segmentation* [00:39:08] YOLO* [00:44:44] World Knowledge of Foundation Models* [00:46:21] Segment Anything Model* [00:51:29] SAM: Zero Shot Transfer* [00:51:53] SAM: Promptability* [00:53:24] SAM: Model Assisted Labeling* [00:56:03] SAM doesn't have labels* [00:59:23] Labeling on the Browser* [01:00:28] Roboflow + SAM Video Demo * [01:07:27] Future Predictions* [01:08:04] GPT4 Multimodality* [01:09:27] Remaining Hard Problems* [01:13:57] Ask Roboflow (2019)* [01:15:26] How to keep up in AITranscripts[00:00:00] Hello everyone. It is me swyx and I'm here with Joseph Nelson. Hey, welcome to the studio. It's nice. Thanks so much having me. We, uh, have a professional setup in here.[00:00:19] Introducing Joseph[00:00:19] Joseph, you and I have known each other online for a little bit. I first heard about you on the Source Graph podcast with bian and I highly, highly recommend that there's a really good game theory story that is the best YC application story I've ever heard and I won't tease further cuz they should go listen to that.[00:00:36] What do you think? It's a good story. It's a good story. It's a good story. So you got your Bachelor of Economics from George Washington, by the way. Fun fact. I'm also an econ major as well. You are very politically active, I guess you, you did a lot of, um, interning in political offices and you were responding to, um, the, the, the sheer amount of load that the Congress people have in terms of the, the support.[00:01:00] So you built, representing, which is Zendesk for Congress. And, uh, I liked in your source guide podcast how you talked about how being more responsive to, to constituents is always a good thing no matter what side of the aisle you're on. You also had a sideline as a data science instructor at General Assembly.[00:01:18] As a consultant in your own consultancy, and you also did a bunch of hackathon stuff with Magic Sudoku, which is your transition from N L P into computer vision. And apparently at TechCrunch Disrupt, disrupt in 2019, you tried to add chess and that was your whole villain origin story for, Hey, computer vision's too hard.[00:01:36] That's full, the platform to do that. Uh, and now you're co-founder c e o of RoboFlow. So that's your bio. Um, what's not in there that[00:01:43] people should know about you? One key thing that people realize within maybe five minutes of meeting me, uh, I'm from Iowa. Yes. And it's like a funnily novel thing. I mean, you know, growing up in Iowa, it's like everyone you know is from Iowa.[00:01:56] But then when I left to go to school, there was not that many Iowans at gw and people were like, oh, like you're, you're Iowa Joe. Like, you know, how'd you find out about this school out here? I was like, oh, well the Pony Express was running that day, so I was able to send. So I really like to lean into it.[00:02:11] And so you kind of become a default ambassador for places that. People don't meet a lot of other people from, so I've kind of taken that upon myself to just make it be a, a part of my identity. So, you know, my handle everywhere Joseph of Iowa, like I I, you can probably find my social security number just from knowing that that's my handle.[00:02:25] Cuz I put it plastered everywhere. So that's, that's probably like one thing.[00:02:28] Why Iowa[00:02:28] What's your best pitch for Iowa? Like why is[00:02:30] Iowa awesome? The people Iowa's filled with people that genuinely care. You know, if you're waiting a long line, someone's gonna strike up a conversation, kinda ask how you were Devrel and it's just like a really genuine place.[00:02:40] It was a wonderful place to grow up too at the time, you know, I thought it was like, uh, yeah, I was kind of embarrassed and then be from there. And then I actually kinda looking back it's like, wow, you know, there's good schools, smart people friendly. The, uh, high school that I went to actually Ben Silverman, the CEO and, or I guess former CEO and co-founder of Pinterest and I have the same teachers in high school at different.[00:03:01] The co-founder, or excuse me, the creator of crispr, the gene editing technique, Dr. Jennifer. Doudna. Oh, so that's the patent debate. There's Doudna. Oh, and then there's Fang Zang. Uh, okay. Yeah. Yeah. So Dr. Fang Zang, who I think ultimately won the patent war, uh, but is also from the same high school.[00:03:18] Well, she won the patent, but Jennifer won the[00:03:20] prize.[00:03:21] I think that's probably, I think that's probably, I, I mean I looked into it a little closely. I think it was something like she won the patent for CRISPR first existing and then Feng got it for, uh, first use on humans, which I guess for commercial reasons is the, perhaps more, more interesting one. But I dunno, biolife Sciences, is that my area of expertise?[00:03:38] Yep. Knowing people that came from Iowa that do cool things, certainly is. Yes. So I'll claim it. Um, but yeah, I, I, we, um, at Roble actually, we're, we're bringing the full team to Iowa for the very first time this last week of, of April. And, well, folks from like Scotland all over, that's your company[00:03:54] retreat.[00:03:54] The Iowa,[00:03:55] yeah. Nice. Well, so we do two a year. You know, we've done Miami, we've done. Some of the smaller teams have done like Nashville or Austin or these sorts of places, but we said, you know, let's bring it back to kinda the origin and the roots. Uh, and we'll, we'll bring the full team to, to Des Moines, Iowa.[00:04:13] So, yeah, like I was mentioning, folks from California to Scotland and many places in between are all gonna descend upon Des Moines for a week of, uh, learning and working. So maybe you can check in with those folks. If, what do they, what do they decide and interpret about what's cool. Our state. Well, one thing, are you actually headquartered in Des Moines on paper?[00:04:30] Yes. Yeah.[00:04:30] Isn't that amazing? That's like everyone's Delaware and you're like,[00:04:33] so doing research. Well, we're, we're incorporated in Delaware. Okay. We we're Delaware Sea like, uh, most companies, but our headquarters Yeah. Is in Des Moines. And part of that's a few things. One, it's like, you know, there's this nice Iowa pride.[00:04:43] And second is, uh, Brad and I both grew up in Brad Mc, co-founder and I grew up in, in Des Moines. And we met each other in the year 2000. We looked it up for the, the YC app. So, you know, I think, I guess more of my life I've known Brad than not, uh, which is kind of crazy. Wow. And during yc, we did it during 2020, so it was like the height of Covid.[00:05:01] And so we actually got a house in Des Moines and lived, worked outta there. I mean, more credit to. So I moved back. I was living in DC at the time, I moved back to to Des Moines. Brad was living in Des Moines, but he moved out of a house with his. To move into what we called our hacker house. And then we had one, uh, member of the team as well, Jacob Sorowitz, who moved from Minneapolis down to Des Moines for the summer.[00:05:21] And frankly, uh, code was a great time to, to build a YC company cuz there wasn't much else to do. I mean, it's kinda like wash your groceries and code. It's sort of the, that was the routine[00:05:30] and you can use, uh, computer vision to help with your groceries as well.[00:05:33] That's exactly right. Tell me what to make.[00:05:35] What's in my fridge? What should I cook? Oh, we'll, we'll, we'll cover[00:05:37] that for with the G P T four, uh, stuff. Exactly. Okay. So you have been featured with in a lot of press events. Uh, but maybe we'll just cover the origin story a little bit in a little bit more detail. So we'll, we'll cover robo flow and then we'll cover, we'll go into segment anything.[00:05:52] Origin of Roboflow[00:05:52] But, uh, I think it's important for people to understand. Robo just because it gives people context for what you're about to show us at the end of the podcast. So Magic Sudoku tc, uh, techers Disrupt, and then you go, you join Pioneer, which is Dan Gross's, um, YC before yc.[00:06:07] Yeah. That's how I think about it.[00:06:08] Yeah, that's a good way. That's a good description of it. Yeah. So I mean, robo flow kind of starts as you mentioned with this magic Sudoku thing. So you mentioned one of my prior business was a company called Represent, and you nailed it. I mean, US Congress gets 80 million messages a year. We built tools that auto sorted them.[00:06:23] They didn't use any intelligent auto sorting. And this is somewhat a solved problem in natural language processing of doing topic modeling or grouping together similar sentiment and things like this. And as you mentioned, I'd like, I worked in DC for a bit and been exposed to some of these problems and when I was like, oh, you know, with programming you can build solutions.[00:06:40] And I think the US Congress is, you know, the US kind of United States is a support center, if you will, and the United States is sports center runs on pretty old software, so mm-hmm. We, um, we built a product for that. It was actually at the time when I was working on representing. Brad, his prior business, um, is a social games company called Hatchlings.[00:07:00] Uh, he phoned me in, in 2017, apple had released augmented reality kit AR kit. And Brad and I are both kind of serial hackers, like I like to go to hackathons, don't really understand new technology until he build something with them type folks. And when AR Kit came out, Brad decided he wanted to build a game with it that would solve Sudoku puzzles.[00:07:19] And the idea of the game would be you take your phone, you hover hold it over top of a Sudoku puzzle, it recognizes the state of the board where it is, and then it fills it all in just right before your eyes. And he phoned me and I was like, Brad, this sounds awesome and sounds like you kinda got it figured out.[00:07:34] What, what's, uh, what, what do you think I can do here? It's like, well, the machine learning piece of this is the part that I'm most uncertain about. Uh, doing the digit recognition and, um, filling in some of those results. I was like, well, I mean digit recognition's like the hell of world of, of computer vision.[00:07:48] That's Yeah, yeah, MNIST, right. So I was like, that that part should be the, the easy part. I was like, ah, I'm, he's like, I'm not so super sure, but. You know, the other parts, the mobile ar game mechanics, I've got pretty well figured out. I was like, I, I think you're wrong. I think you're thinking about the hard part is the easy part.[00:08:02] And he is like, no, you're wrong. The hard part is the easy part. And so long story short, we built this thing and released Magic Sudoku and it kind of caught the Internet's attention of what you could do with augmented reality and, and with computer vision. It, you know, made it to the front ofer and some subreddits it run Product Hunt Air app of the year.[00:08:20] And it was really a, a flash in the pan type app, right? Like we were both running separate companies at the time and mostly wanted to toy around with, with new technology. And, um, kind of a fun fact about Magic Sudoku winning product Hunt Air app of the year. That was the same year that I think the model three came out.[00:08:34] And so Elon Musk won a Golden Kitty who we joked that we share an award with, with Elon Musk. Um, the thinking there was that this is gonna set off a, a revolution of if two random engineers can put together something that makes something, makes a game programmable and at interactive, then surely lots of other engineers will.[00:08:53] Do similar of adding programmable layers on top of real world objects around us. Earlier we were joking about objects in your fridge, you know, and automatically generating recipes and these sorts of things. And like I said, that was 2017. Roboflow was actually co-found, or I guess like incorporated in, in 2019.[00:09:09] So we put this out there, nothing really happened. We went back to our day jobs of, of running our respective businesses, I sold Represently and then as you mentioned, kind of did like consulting stuff to figure out the next sort of thing to, to work on, to get exposed to various problems. Brad appointed a new CEO at his prior business and we got together that summer of 2019.[00:09:27] We said, Hey, you know, maybe we should return to that idea that caught a lot of people's attention and shows what's possible. And you know what, what kind of gives, like the future is here. And we have no one's done anything since. No one's done anything. So why is, why are there not these, these apps proliferated everywhere.[00:09:42] Yeah. And so we said, you know, what we'll do is, um, to add this software layer to the real world. Will build, um, kinda like a super app where if you pointed it at anything, it will recognize it and then you can interact with it. We'll release a developer platform and allow people to make their own interfaces, interactivity for whatever object they're looking at.[00:10:04] And we decided to start with board games because one, we had a little bit of history there with, with Sudoku two, there's social by default. So if one person, you know finds it, then they'd probably share it among their friend. Group three. There's actually relatively few barriers to entry aside from like, you know, using someone else's brand name in your, your marketing materials.[00:10:19] Yeah. But other than that, there's no real, uh, inhibitors to getting things going and, and four, it's, it's just fun. It would be something that'd be bring us enjoyment to work on. So we spent that summer making, uh, boggle the four by four word game provable, where, you know, unlike Magic Sudoku, which to be clear, totally ruins the game, uh, you, you have to solve Sudoku puzzle.[00:10:40] You don't need to do anything else. But with Boggle, if you and I are playing, we might not find all of the words that adjacent letter tiles. Unveil. So if we have a, an AI tell us, Hey, here's like the best combination of letters that make high scoring words. And so we, we made boggle and released it and that, and that did okay.[00:10:56] I mean maybe the most interesting story was there's a English as a second language program in, in Canada that picked it up and used it as a part of their curriculum to like build vocabulary, which I thought was kind of inspiring. Example, and what happens just when you put things on the internet and then.[00:11:09] We wanted to build one for chess. So this is where you mentioned we went to 2019. TechCrunch Disrupt TechCrunch. Disrupt holds a Hackathon. And this is actually, you know, when Brad and I say we really became co-founders, because we fly out to San Francisco, we rent a hotel room in the Tenderloin. We, uh, we, we, uh, have one room and there's like one, there's room for one bed, and then we're like, oh, you said there was a cot, you know, on the, on the listing.[00:11:32] So they like give us a little, a little cot, the end of the cot, like bled and over into like the bathroom. So like there I am sleeping on the cot with like my head in the bathroom and the Tenderloin, you know, fortunately we're at a hackathon glamorous. Yeah. There wasn't, there wasn't a ton of sleep to be had.[00:11:46] There is, you know, we're, we're just like making and, and shipping these, these sorts of many[00:11:50] people with this hack. So I've never been to one of these things, but[00:11:52] they're huge. Right? Yeah. The Disrupt Hackathon, um, I don't, I don't know numbers, but few hundreds, you know, classically had been a place where it launched a lot of famous Yeah.[00:12:01] Sort of flare. Yeah. And I think it's, you know, kind of slowed down as a place for true company generation. But for us, Brad and I, who likes just doing hackathons, being, making things in compressed time skills, it seemed like a, a fun thing to do. And like I said, we'd been working on things, but it was only there that like, you're, you're stuck in a maybe not so great glamorous situation together and you're just there to make a, a program and you wanna make it be the best and compete against others.[00:12:26] And so we add support to the app that we were called was called Board Boss. We couldn't call it anything with Boggle cause of IP rights were called. So we called it Board Boss and it supported Boggle and then we were gonna support chess, which, you know, has no IP rights around it. Uh, it's an open game.[00:12:39] And we did so in 48 hours, we built an app that, or added fit capability to. Point your phone at a chess board. It understands the state of the chess board and converts it to um, a known notation. Then it passes that to stock fish, the open source chess engine for making move recommendations and it makes move recommendations to, to players.[00:13:00] So you could either play against like an ammunition to AI or improve your own game. We learn that one of the key ways users like to use this was just to record their games. Cuz it's almost like reviewing game film of what you should have done differently. Game. Yeah, yeah, exactly. And I guess the highlight of, uh, of chess Boss was, you know, we get to the first round of judging, we get to the second round of judging.[00:13:16] And during the second round of judging, that's when like, TechCrunch kind of brings around like some like celebs and stuff. They'll come by. Evan Spiegel drops by Ooh. Oh, and he uh, he comes up to our, our, our booth and um, he's like, oh, so what does, what does this all do? And you know, he takes an interest in it cuz the underpinnings of, of AR interacting with the.[00:13:33] And, uh, he is kinda like, you know, I could use this to like cheat on chess with my friends. And we're like, well, you know, that wasn't exactly the, the thesis of why we made it, but glad that, uh, at least you think it's kind of neat. Um, wait, but he already started Snapchat by then? Oh, yeah. Oh yeah. This, this is 2019, I think.[00:13:49] Oh, okay, okay. Yeah, he was kind of just checking out things that were new and, and judging didn't end up winning any, um, awards within Disrupt, but I think what we won was actually. Maybe more important maybe like the, the quote, like the co-founders medal along the way. Yep. The friends we made along the way there we go to, to play to the meme.[00:14:06] I would've preferred to win, to be clear. Yes. You played a win. So you did win, uh,[00:14:11] $15,000 from some Des Moines, uh, con[00:14:14] contest. Yeah. Yeah. The, uh, that was nice. Yeah. Slightly after that we did, we did win. Um, some, some grants and some other things for some of the work that we've been doing. John Papa John supporting the, uh, the local tech scene.[00:14:24] Yeah. Well, so there's not the one you're thinking of. Okay. Uh, there's a guy whose name is Papa John, like that's his, that's his, that's his last name. His first name is John. So it's not the Papa John's you're thinking of that has some problematic undertones. It's like this guy who's totally different. I feel bad for him.[00:14:38] His press must just be like, oh, uh, all over the place. But yeah, he's this figure in the Iowa entrepreneurial scene who, um, he actually was like doing SPACs before they were cool and these sorts of things, but yeah, he funds like grants that encourage entrepreneurship in the state. And since we'd done YC and in the state, we were eligible for some of the awards that they were providing.[00:14:56] But yeah, it was disrupt that we realized, you know, um, the tools that we made, you know, it took us better part of a summer to add Boggle support and it took us 48 hours to add chest support. So adding the ability for programmable interfaces for any object, we built a lot of those internal tools and our apps were kind of doing like the very famous shark fin where like it picks up really fast, then it kind of like slowly peters off.[00:15:20] Mm-hmm. And so we're like, okay, if we're getting these like shark fin graphs, we gotta try something different. Um, there's something different. I remember like the week before Thanksgiving 2019 sitting down and we wrote this Readme for, actually it's still the Readme at the base repo of Robo Flow today has spent relatively unedited of the manifesto.[00:15:36] Like, we're gonna build tools that enable people to make the world programmable. And there's like six phases and, you know, there's still, uh, many, many, many phases to go into what we wrote even at that time to, to present. But it's largely been, um, right in line with what we thought we would, we would do, which is give engineers the tools to add software to real world objects, which is largely predicated on computer vision. So finding the right images, getting the right sorts of video frames, maybe annotating them, uh, finding the right sort of models to use to do this, monitoring the performance, all these sorts of things. And that from, I mean, we released that in early 2020, and it's kind of, that's what's really started to click.[00:16:12] Why Computer Vision[00:16:12] Awesome. I think we should just kind[00:16:13] of[00:16:14] go right into where you are today and like the, the products that you offer, just just to give people an overview and then we can go into the, the SAM stuff. So what is the clear, concise elevator pitch? I think you mentioned a bunch of things like make the world programmable so you don't ha like computer vision is a means to an end.[00:16:30] Like there's, there's something beyond that. Yeah.[00:16:32] I mean, the, the big picture mission for the business and the company and what we're working on is, is making the world programmable, making it read and write and interactive, kind of more entertaining, more e. More fun and computer vision is the technology by which we can achieve that pretty quickly.[00:16:48] So like the one liner for the, the product in, in the company is providing engineers with the tools for data and models to build programmable interfaces. Um, and that can be workflows, that could be the, uh, data processing, it could be the actual model training. But yeah, Rob helps you use production ready computer vision workflows fast.[00:17:10] And I like that.[00:17:11] In part of your other pitch that I've heard, uh, is that you basically scale from the very smallest scales to the very largest scales, right? Like the sort of microbiology use case all the way to[00:17:20] astronomy. Yeah. Yeah. The, the joke that I like to make is like anything, um, underneath a microscope and, and through a telescope and everything in between needs to, needs to be seen.[00:17:27] I mean, we have people that run models in outer space, uh, underwater remote places under supervision and, and known places. The crazy thing is that like, All parts of, of not just the world, but the universe need to be observed and understood and acted upon. So vision is gonna be, I dunno, I feel like we're in the very, very, very beginnings of all the ways we're gonna see it.[00:17:50] Computer Vision Use Cases[00:17:50] Awesome. Let's go into a lo a few like top use cases, cuz I think that really helps to like highlight the big names that you've, big logos that you've already got. I've got Walmart and Cardinal Health, but I don't, I don't know if you wanna pull out any other names, like, just to illustrate, because the reason by the way, the reason I think that a lot of developers don't get into computer vision is because they think they don't need it.[00:18:11] Um, or they think like, oh, like when I do robotics, I'll do it. But I think if, if you see like the breadth of use cases, then you get a little bit more inspiration as to like, oh, I can use[00:18:19] CVS lfa. Yeah. It's kind of like, um, you know, by giving, by making it be so straightforward to use vision, it becomes almost like a given that it's a set of features that you could power on top of it.[00:18:32] And like you mentioned, there's, yeah, there's Fortune One there over half the Fortune 100. I've used the, the tools that Robel provides just as much as 250,000 developers. And so over a quarter million engineers finding and developing and creating various apps, and I mean, those apps are, are, are far and wide.[00:18:49] Just as you mentioned. I mean everything from say, like, one I like to talk about was like sushi detection of like finding the like right sorts of fish and ingredients that are in a given piece of, of sushi that you're looking at to say like roof estimation of like finding. If there's like, uh, hail damage on, on a given roof, of course, self-driving cars and understanding the scenes around us is sort of the, you know, very early computer vision everywhere.[00:19:13] Use case hardhat detection, like finding out if like a given workplace is, is, is safe, uh, disseminate, have the right p p p on or p p e on, are there the right distance from various machines? A huge place that vision has been used is environmental monitoring. Uh, what's the count of species? Can we verify that the environment's not changing in unexpected ways or like river banks are become, uh, becoming recessed in ways that we anticipate from satellite imagery, plant phenotyping.[00:19:37] I mean, people have used these apps for like understanding their plants and identifying them. And that dataset that's actually largely open, which is what's given a proliferation to the iNaturalist, is, is that whole, uh, hub of, of products. Lots of, um, people that do manufacturing. So, like Rivian for example, is a Rubal customer, and you know, they're trying to scale from 1000 cars to 25,000 cars to a hundred thousand cars in very short order.[00:20:00] And that relies on having the. Ability to visually ensure that every part that they're making is produced correctly and right in time. Medical use cases. You know, there's actually, this morning I was emailing with a user who's accelerating early cancer detection through breaking apart various parts of cells and doing counts of those cells.[00:20:23] And actually a lot of wet lab work that folks that are doing their PhDs or have done their PhDs are deeply familiar with that is often required to do very manually of, of counting, uh, micro plasms or, or things like this. There's. All sorts of, um, like traffic counting and smart cities use cases of understanding curb utilization to which sort of vehicles are, are present.[00:20:44] Uh, ooh. That can be[00:20:46] really good for city planning actually.[00:20:47] Yeah. I mean, one of our customers does exactly this. They, they measure and do they call it like smart curb utilization, where uhhuh, they wanna basically make a curb be almost like a dynamic space where like during these amounts of time, it's zoned for this during these amounts of times.[00:20:59] It's zoned for this based on the flows and e ebbs and flows of traffic throughout the day. So yeah, I mean the, the, the truth is that like, you're right, it's like a developer might be like, oh, how would I use vision? And then all of a sudden it's like, oh man, all these things are at my fingertips. Like I can just, everything you can see.[00:21:13] Yeah. Right. I can just, I can just add functionality for my app to understand and ingest the way, like, and usually the way that someone gets like almost nerd sniped into this is like, they have like a home automation project, so it's like send Yeah. Give us a few. Yeah. So send me a text when, um, a package shows up so I can like prevent package theft so I can like go down and grab it right away or.[00:21:29] We had a, uh, this one's pretty, pretty niche, but it's pretty funny. There was this guy who, during the pandemic wa, wanted to make sure his cat had like the proper, uh, workout. And so I've shared the story where he basically decided that. He'd make a cat workout machine with computer vision, you might be alone.[00:21:43] You're like, what does that look like? Well, what he decided was he would take a robotic arm strap, a laser pointer to it, and then train a machine to recognize his cat and his cat only, and point the laser pointer consistently 10 feet away from the cat. There's actually a video of you if you type an YouTube cat laser turret, you'll find Dave's video.[00:22:01] Uh, and hopefully Dave's cat has, has lost the weight that it needs to, cuz that's just the, that's an intense workout I have to say. But yeah, so like, that's like a, um, you know, these, uh, home automation projects are pretty common places for people to get into smart bird feeders. I've seen people that like are, are logging and understanding what sort of birds are, uh, in their background.[00:22:18] There's a member of our team that was working on actually this as, as a whole company and has open sourced a lot of the data for doing bird species identification. And now there's, I think there's even a company that's, uh, founded to create like a smart bird feeder, like captures photos and tells you which ones you've attracted to your yard.[00:22:32] I met that. Do, you know, get around the, uh, car sharing company that heard it? Them never used them. They did a SPAC last year and they had raised at like, They're unicorn. They raised at like 1.2 billion, I think in the, the prior round and inspected a similar price. I met the CTO of, of Getaround because he was, uh, using Rob Flow to hack into his Tesla cameras to identify other vehicles that are like often nearby him.[00:22:56] So he's basically building his own custom license plate recognition, and he just wanted like, keep, like, keep tabs of like, when he drives by his friends or when he sees like regular sorts of folks. And so he was doing like automated license plate recognition by tapping into his, uh, camera feeds. And by the way, Elliot's like one of the like OG hackers, he was, I think one of the very first people to like, um, she break iPhones and, and these sorts of things.[00:23:14] Mm-hmm. So yeah, the project that I want, uh, that I'm gonna work on right now for my new place in San Francisco is. There's two doors. There's like a gate and then the other door. And sometimes we like forget to close, close the gate. So like, basically if it sees that the gate is open, it'll like send us all a text or something like this to make sure that the gate is, is closed at the front of our house.[00:23:32] That's[00:23:32] really cool. And I'll, I'll call out one thing that readers and listeners can, uh, read out on, on your history. One of your most popular initial, um, viral blog post was about, um, autonomous vehicle data sets and how, uh, the one that Udacity was using was missing like one third of humans. And, uh, it's not, it's pretty problematic for cars to miss humans.[00:23:53] Yeah, yeah, actually, so yeah, the Udacity self-driving car data set, which look to their credit, it was just meant to be used for, for academic use. Um, and like as a part of courses on, on Udacity, right? Yeah. But the, the team that released it, kind of hastily labeled and let it go out there to just start to use and train some models.[00:24:11] I think that likely some, some, uh, maybe commercial use cases maybe may have come and, and used, uh, the dataset, who's to say? But Brad and I discovered this dataset. And when we were working on dataset improvement tools at Rob Flow, we ran through our tools and identified some like pretty, as you mentioned, key issues.[00:24:26] Like for example, a lot of strollers weren't labeled and I hope our self-driving cars do those, these sorts of things. And so we relabeled the whole dataset by hand. I have this very fond memory is February, 2020. Brad and I are in Taiwan. So like Covid is actually just, just getting going. And the reason we were there is we were like, Hey, we can work on this from anywhere for a little bit.[00:24:44] And so we spent like a, uh, let's go closer to Covid. Well, you know, I like to say we uh, we got early indicators of, uh, how bad it was gonna be. I bought a bunch of like N 90 fives before going o I remember going to the, the like buying a bunch of N 95 s and getting this craziest look like this like crazy tin hat guy.[00:25:04] Wow. What is he doing? And then here's how you knew. I, I also got got by how bad it was gonna be. I left all of them in Taiwan cuz it's like, oh, you all need these. We'll be fine over in the us. And then come to find out, of course that Taiwan was a lot better in terms of, um, I think, yeah. Safety. But anyway, we were in Taiwan because we had planned this trip and you know, at the time we weren't super sure about the, uh, covid, these sorts of things.[00:25:22] We always canceled it. We didn't, but I have this, this very specific time. Brad and I were riding on the train from Clay back to Taipei. It's like a four hour ride. And you mentioned Pioneer earlier, we were competing in Pioneer, which is almost like a gamified to-do list. Mm-hmm. Every week you say what you're gonna do and then other people evaluate.[00:25:37] Did you actually do the things you said you were going to do? One of the things we said we were gonna do was like this, I think re-release of this data set. And so it's like late, we'd had a whole week, like, you know, weekend behind us and, uh, we're on this train and it was very unpleasant situation, but we relabeled this, this data set, and one sitting got it submitted before like the Sunday, Sunday countdown clock starts voting for, for.[00:25:57] And, um, once that data got out back out there, just as you mentioned, it kind of picked up and Venture beat, um, noticed and wrote some stories about it. And we really rereleased of course, the data set that we did our best job of labeling. And now if anyone's listening, they can probably go out and like find some errors that we surely still have and maybe call us out and, you know, put us, put us on blast.[00:26:15] The Economics of Annotation (Segmentation)[00:26:15] But,[00:26:16] um, well, well the reason I like this story is because it, it draws attention to the idea that annotation is difficult and basically anyone looking to use computer vision in their business who may not have an off-the-shelf data set is going to have to get involved in annotation. And I don't know what it costs.[00:26:34] And that's probably one of the biggest hurdles for me to estimate how big a task this is. Right? So my question at a higher level is tell the customers, how do you tell customers to estimate the economics of annotation? Like how many images do, do we need? How much, how long is it gonna take? That, that kinda stuff.[00:26:50] How much money and then what are the nuances to doing it well, right? Like, cuz obviously Udacity had a poor quality job, you guys had proved it, and there's errors every everywhere. Like where do[00:26:59] these things go wrong? The really good news about annotation in general is that like annotation of course is a means to an end to have a model be able to recognize a thing.[00:27:08] Increasingly there's models that are coming out that can recognize things zero shot without any annotation, which we're gonna talk about. Yeah. Which, we'll, we'll talk more about that in a moment. But in general, the good news is that like the trend is that annotation is gonna become decreasingly a blocker to starting to use computer vision in meaningful ways.[00:27:24] Now that said, just as you mentioned, there's a lot of places where you still need to do. Annotation. I mean, even with these zero shot models, they might have of blind spots, or maybe you're a business, as you mentioned, that you know, it's proprietary data. Like only Rivian knows what a rivian is supposed to look like, right?[00:27:39] Uh, at the time of, at the time of it being produced, like underneath the hood and, and all these sorts of things. And so, yeah, that's gonna necessarily require annotation. So your question of how long is it gonna take, how do you estimate these sorts of things, it really comes down to the complexity of the problem that you're solving and the amount of variance in the scene.[00:27:57] So let's give some contextual examples. If you're trying to recognize, we'll say a scratch on one specific part and you have very strong lighting. You might need fewer images because you control the lighting, you know the exact part and maybe you're lucky in the scratch. Happens more often than not in similar parts or similar, uh, portions of the given part.[00:28:17] So in that context, you, you, the function of variance, the variance is, is, is lower. So the number of images you need is also lower to start getting up to work. Now the orders of magnitude we're talking about is that like you can have an initial like working model from like 30 to 50 images. Yeah. In this context, which is shockingly low.[00:28:32] Like I feel like there's kind of an open secret in computer vision now, the general heuristic that often. Users, is that like, you know, maybe 200 images per class is when you start to have a model that you can rely[00:28:45] on? Rely meaning like 90, 99, 90, 90%, um,[00:28:50] uh, like what's 85 plus 85? Okay. Um, that's good. Again, these are very, very finger in the wind estimates cuz the variance we're talking about.[00:28:59] But the real question is like, at what point, like the framing is not like at what point do it get to 99, right? The framing is at what point can I use this thing to be better than the alternative, which is humans, which maybe humans or maybe like this problem wasn't possible at all. And so usually the question isn't like, how do I get to 99?[00:29:15] A hundred percent? It's how do I ensure that like the value I am able to get from putting this thing in production is greater than the alternative? In fact, even if you have a model that's less accurate than humans, there might be some circumstances where you can tolerate, uh, a greater amount of inaccuracy.[00:29:32] And if you look at the accuracy relative to the cost, Using a model is extremely cheap. Using a human for the same sort of task can be very expensive. Now, in terms of the actual accuracy of of what you get, there's probably some point at which the cost, but relative accuracy exceeds of a model, exceeds the high cost and hopefully high accuracy of, of a human comparable, like for example, there's like cameras that will track soccer balls or track events happening during sporting matches.[00:30:02] And you can go through and you know, we actually have users that work in sports analytics. You can go through and have a human. Hours and hours of footage. Cuz not just watching their team, they're watching every other team, they're watching scouting teams, they're watching junior teams, they're watching competitors.[00:30:15] And you could have them like, you know, track and follow every single time the ball goes within blank region of the field or every time blank player goes into, uh, this portion of the field. And you could have, you know, exact, like a hundred percent accuracy if that person, maybe, maybe not a hundred, a human may be like 95, 90 7% accuracy of every single time the ball is in this region or this player is on the field.[00:30:36] Truthfully, maybe if you're scouting analytics, you actually don't need 97% accuracy of knowing that that player is on the field. And in fact, if you can just have a model run at a 1000th, a 10000th of the cost and goes through and finds all the times that Messi was present on the field mm-hmm. That the ball was in this region of the.[00:30:54] Then even if that model is slightly less accurate, the cost is just so orders of magnitude different. And the stakes like the stakes of this problem, of knowing like the total number of minutes that Messi played will say are such that we have a higher air tolerance, that it's a no-brainer to start to use Yeah, a computer vision model in this context.[00:31:12] So not every problem requires equivalent or greater human performance. Even when it does, you'd be surprised at how fast models get there. And in the times when you, uh, really look at a problem, the question is, how much accuracy do I need to start to get value from this? This thing, like the package example is a great one, right?[00:31:27] Like I could in theory set up a camera that's constantly watching in front of my porch and I could watch the camera whenever I have a package and then go down. But of course, I'm not gonna do that. I value my time to do other sorts of things instead. And so like there, there's this net new capability of, oh, great, I can have an always on thing that tells me when a package shows up, even if you know the, the thing that's gonna text me.[00:31:46] When a package shows up, let's say a flat pack shows up instead of a box and it doesn't know what a flat pack likes, looks like initially. Doesn't matter. It doesn't matter because I didn't have this capability at all before. And I think that's the true case where a lot of computer vision problems exist is like it.[00:32:00] It's like you didn't even have this capability, this superpower before at all, let alone assigning a given human to do the task. And that's where we see like this explosion of, of value.[00:32:10] Awesome. Awesome. That was a really good overview. I want to leave time for the others, but I, I really want to dive into a couple more things with regards to Robo Flow.[00:32:17] Computer Vision Annotation Formats[00:32:17] So one is, apparently your original pitch for Robo Flow was with regards to conversion tools for computer vision data sets. And I'm sure as, as a result of your job, you have a lot of rants. I've been digging for rants basically on like the best or the worst annotation formats. What do we know? Cause most of us, oh my gosh, we only know, like, you know, I like,[00:32:38] okay, so when we talk about computer vision annotation formats, what we're talking about is if you have an image and you, you picture a boing box around my face on that image.[00:32:46] Yeah. How do you describe where that Monty box is? X, Y, Z X Y coordinates. Okay. X, y coordinates. How, what do you mean from the top lefts.[00:32:52] Okay. You, you, you, you take X and Y and then, and then the. The length and, and the width of the, the[00:32:58] box. Okay. So you got like a top left coordinate and like the bottom right coordinate or like the, the center of the bottom.[00:33:02] Yeah. Yeah. Top, left, bottom right. Yeah. That's one type of format. Okay. But then, um, I come along and I'm like, you know what? I want to do a different format where I wanna just put the center of the box, right. And give the length and width. Right. And by the way, we didn't even talk about what X and Y we're talking about.[00:33:14] Is X a pixel count? Is a relative pixel count? Is it an absolute pixel count? So the point is, the number of ways to describe where a box lives in a freaking image is endless, uh, seemingly and. Everyone decided to kind of create their own different ways of describing the coordinates and positions of where in this context of bounding Box is present.[00:33:39] Uh, so there's some formats, for example, that like use re, so for the x and y, like Y is, uh, like the left, most part of the image is zero. And the right most part of the image is one. So the, the coordinate is like anywhere from zero to one. So 0.6 is, you know, 60% of your way right up the image to describe the coordinate.[00:33:53] I guess that was, that was X instead of Y. But the point is there, of the zero to one is the way that we determined where that was in the position, or we're gonna do an absolute pixel position anyway. We got sick, we got sick of all these different annotation formats. So why do you even have to convert between formats?[00:34:07] Is is another part of this, this story. So different training frameworks, like if you're using TensorFlow, you need like TF Records. If you're using PyTorch, it's probably gonna be, well it depends on like what model you're using, but someone might use Coco JSON with PyTorch. Someone else might use like a, just a YAML file and a text file.[00:34:21] And to describe the cor it's point is everyone that creates a model. Or creates a dataset rather, has created different ways of describing where and how a bounding box is present in the image. And we got sick of all these different formats and doing these in writing all these different converter scripts.[00:34:39] And so we made a tool that just converts from one script, one type of format to another. And the, the key thing is that like if you get that converter script wrong, your model doesn't not work. It just fails silently. Yeah. Because the bounding boxes are now all in the wrong places. And so you need a way to visualize and be sure that your converter script, blah, blah blah.[00:34:54] So that was the very first tool we released of robo. It was just a converter script, you know, like these, like these PDF to word converters that you find. It was basically that for computer vision, like dead simple, really annoying thing. And we put it out there and people found some, some value in, in that.[00:35:08] And you know, to this day that's still like a surprisingly painful[00:35:11] problem. Um, yeah, so you and I met at the Dall-E Hackathon at OpenAI, and we were, I was trying to implement this like face masking thing, and I immediately ran into that problem because, um, you know, the, the parameters that Dall-E expected were different from the one that I got from my face, uh, facial detection thing.[00:35:28] One day it'll go away, but that day is not today. Uh, the worst format that we work with is, is. The mart form, it just makes no sense. And it's like, I think, I think it's a one off annotation format that this university in China started to use to describe where annotations exist in a book mart. I, I don't know, I dunno why that So best[00:35:45] would be TF record or some something similar.[00:35:48] Yeah, I think like, here's your chance to like tell everybody to use one one standard and like, let's, let's, can[00:35:53] I just tell them to use, we have a package that does this for you. I'm just gonna tell you to use the row full package that converts them all, uh, for you. So you don't have to think about this. I mean, Coco JSON is pretty good.[00:36:04] It's like one of the larger industry norms and you know, it's in JS O compared to like V xml, which is an XML format and Coco json is pretty descriptive, but you know, it has, has its own sort of drawbacks and flaws and has random like, attribute, I dunno. Um, yeah, I think the best way to handle this problem is to not have to think about it, which is what we did.[00:36:21] We just created a, uh, library that, that converts and uses things. Uh, for us. We've double checked the heck out of it. There's been hundreds of thousands of people that have used the library and battle tested all these different formats to find those silent errors. So I feel pretty good about no longer having to have a favorite format and instead just rely on.[00:36:38] Dot load in the format that I need. Great[00:36:41] Intro to Computer Vision Segmentation[00:36:41] service to the community. Yeah. Let's go into segmentation because is at the top of everyone's minds, but before we get into segment, anything, I feel like we need a little bit of context on the state-of-the-art prior to Sam, which seems to be YOLO and uh, you are the leading expert as far as I know.[00:36:56] Yeah.[00:36:57] Computer vision, there's various task types. There's classification problems where we just like assign tags to images, like, you know, maybe safe work, not safe work, sort of tagging sort of stuff. Or we have object detection, which are the boing boxes that you see and all the formats I was mentioning in ranting about there's instant segmentation, which is the polygon shapes and produces really, really good looking demos.[00:37:19] So a lot of people like instant segmentation.[00:37:21] This would be like counting pills when you point 'em out on the, on the table. Yeah. So, or[00:37:25] soccer players on the field. So interestingly, um, counting you could do with bounding boxes. Okay. Cause you could just say, you know, a box around a person. Well, I could count, you know, 12 players on the field.[00:37:35] Masks are most useful. Polygons are most useful if you need very precise area measurements. So you have an aerial photo of a home and you want to know, and the home's not a perfect box, and you want to know the rough square footage of that home. Well, if you know the distance between like the drone and, and the ground.[00:37:53] And you have the precise polygon shape of the home, then you can calculate how big that home is from aerial photos. And then insurers can, you know, provide say accurate estimates and that's maybe why this is useful. So polygons and, and instant segmentation are, are those types of tasks? There's a key point detection task and key point is, you know, if you've seen those demos of like all the joints on like a hand kind of, kind of outlined, there's visual question answering tasks, visual q and a.[00:38:21] And that's like, you know, some of the stuff that multi-modality is absolutely crushing for, you know, here's an image, tell me what food is in this image. And then you can pass that and you can make a recipe out of it. But like, um, yeah, the visual question in answering task type is where multi-modality is gonna have and is already having an enormous impact.[00:38:40] So that's not a comprehensive survey, very problem type, but it's enough to, to go into why SAM is significant. So these various task types, you know, which model to use for which given circumstance. Most things is highly dependent on what you're ultimately aiming to do. Like if you need to run a model on the edge, you're gonna need a smaller model, cuz it is gonna run on edge, compute and process in, in, in real time.[00:39:01] If you're gonna run a model on the cloud, then of course you, uh, generally have more compute at your disposal Considerations like this now, uh,[00:39:08] YOLO[00:39:08] just to pause. Yeah. Do you have to explain YOLO first before you go to Sam, or[00:39:11] Yeah, yeah, sure. So, yeah. Yeah, we should. So object detection world. So for a while I talked about various different task types and you can kinda think about a slide scale of like classification, then obvious detection.[00:39:20] And on the right, at most point you have like segmentation tasks. Object detection. The bounding boxes is especially useful for a wide, like it's, it's surprisingly versatile. Whereas like classification is kind of brittle. Like you only have a tag for the whole image. Well, that doesn't, you can't count things with tags.[00:39:35] And on the other hand, like the mask side of things, like drawing masks is painstaking. And so like labeling is just a bit more difficult. Plus like the processing to produce masks requires more compute. And so usually a lot of folks kind of landed for a long time on obvious detection being a really happy medium of affording you with rich capabilities because you can do things like count, track, measure.[00:39:56] In some CAGR context with bounding boxes, you can see how many things are present. You can actually get a sense of how fast something's moving by tracking the object or bounding box across multiple frames and comparing the timestamp of where it was across those frames. So obviously detection is a very common task type that solves lots of things that you want do with a given model.[00:40:15] In obviously detection. There's been various model frameworks over time. So kind of really early on there's like R-CNN uh, then there's faster rc n n and these sorts of family models, which are based on like resnet kind of architectures. And then a big thing happens, and that is single shot detectors. So faster, rc n n despite its name is, is very slow cuz it takes two passes on the image.[00:40:37] Uh, the first pass is, it finds par pixels in the image that are most interesting to, uh, create a bounding box candidate out of. And then it passes that to a, a classifier that then does classification of the bounding box of interest. Right. Yeah. You can see, you can see why that would be slow. Yeah. Cause you have to do two passes.[00:40:53] You know, kind of actually led by, uh, like mobile net was I think the first large, uh, single shot detector. And as its name implies, it was meant to be run on edge devices and mobile devices and Google released mobile net. So it's a popular implementation that you find in TensorFlow. And what single shot detectors did is they said, Hey, instead of looking at the image twice, what if we just kind of have a, a backbone that finds candidate bounding boxes?[00:41:19] And then we, we set loss functions for objectness. We set loss function. That's a real thing. We set loss functions for objectness, like how much obj, how object do this part of the images. We send a loss function for classification, and then we run the image through the model on a single pass. And that saves lots of compute time and you know, it's not necessarily as accurate, but if you have lesser compute, it can be extremely useful.[00:41:42] And then the advances in both modeling techniques in compute and data quality, single shot detectors, SSDs has become, uh, really, really popular. One of the biggest SSDs that has become really popular is the YOLO family models, as you described. And so YOLO stands for you only look once. Yeah, right, of course.[00:42:02] Uh, Drake's, uh, other album, um, so Joseph Redman introduces YOLO at the University of Washington. And Joseph Redman is, uh, kind of a, a fun guy. So for listeners, for an Easter egg, I'm gonna tell you to Google Joseph Redman resume, and you'll find, you'll find My Little Pony. That's all I'll say. And so he introduces the very first YOLO architecture, which is a single shot detector, and he also does it in a framework called Darknet, which is like this, this own framework that compiles the Cs, frankly, kind of tough to work with, but allows you to benefit from the speedups that advance when you operate in a low level language like.[00:42:36] And then he releases, well, what colloquially is known as YOLO V two, but a paper's called YOLO 9,000 cuz Joseph Redmond thought it'd be funny to have something over 9,000. So get a sense for, yeah, some fun. And then he releases, uh, YOLO V three and YOLO V three is kind of like where things really start to click because it goes from being an SSD that's very limited to competitive and, and, and superior to actually mobile That and some of these other single shot detectors, which is awesome because you have this sort of solo, I mean, him and and his advisor, Ali, at University of Washington have these, uh, models that are becoming really, really powerful and capable and competitive with these large research organizations.[00:43:09] Joseph Edmond leaves Computer Vision Research, but there had been Alexia ab, one of the maintainers of Darknet released Yola VI four. And another, uh, researcher, Glenn Yer, uh, jocker had been working on YOLO V three, but in a PyTorch implementation, cuz remember YOLO is in a dark implementation. And so then, you know, YOLO V three and then Glenn continues to make additional improvements to YOLO V three and pretty soon his improvements on Yolov theory, he's like, oh, this is kind of its own things.[00:43:36] Then he releases YOLO V five[00:43:38] with some naming[00:43:39] controversy that we don't have Big naming controversy. The, the too long didn't read on the naming controversy is because Glen was not originally involved with Darknet. How is he allowed to use the YOLO moniker? Roe got in a lot of trouble cuz we wrote a bunch of content about YOLO V five and people were like, ah, why are you naming it that we're not?[00:43:55] Um, but you know,[00:43:56] cool. But anyway, so state-of-the-art goes to v8. Is what I gather.[00:44:00] Yeah, yeah. So yeah. Yeah. You're, you're just like, okay, I got V five. I'll skip to the end. Uh, unless, unless there's something, I mean, I don't want, well, so I mean, there's some interesting things. Um, in the yolo, there's like, there's like a bunch of YOLO variants.[00:44:10] So YOLOs become this, like this, this catchall for various single shot, yeah. For various single shot, basically like runs on the edge, it's quick detection framework. And so there's, um, like YOLO R, there's YOLO S, which is a transformer based, uh, yolo, yet look like you only look at one sequence is what s stands were.[00:44:27] Um, the pp yo, which, uh, is PAT Paddle implementation, which is by, which Chinese Google is, is their implementation of, of TensorFlow, if you will. So basically YOLO has like all these variants. And now, um, yo vii, which is Glen has been working on, is now I think kind of like, uh, one of the choice models to use for single shot detection.[00:44:44] World Knowledge of Foundation Models[00:44:44] Well, I think a lot of those models, you know, Asking the first principal's question, like let's say you wanna find like a bus detector. Do you need to like go find a bunch of photos of buses or maybe like a chair detector? Do you need to go find a bunch of photos of chairs? It's like, oh no. You know, actually those images are present not only in the cocoa data set, but those are objects that exist like kind of broadly on the internet.[00:45:02] And so computer visions kind of been like us included, have been like really pushing for and encouraging models that already possess a lot of context about the world. And so, you know, if GB T's idea and i's idea OpenAI was okay, models can only understand things that are in their corpus. What if we just make their corpus the size of everything on the internet?[00:45:20] The same thing that happened in imagery, what's happening now? And that's kinda what Sam represents, which is kind of a new evolution of, earlier on we were talking about the cost of annotation and I said, well, good news. Annotations then become decreasingly necessary to start to get to value. Now you gotta think about it more, kind of like, you'll probably need to do some annotation because you might want to find a custom object, or Sam might not be perfect, but what's about to happen is a big opportunity where you want the benefits of a yolo, right?[00:45:47] Where it can run really fast, it can run on the edge, it's very cheap. But you want the knowledge of a large foundation model that already knows everything about buses and knows everything about shoes, knows everything about real, if the name is true, anything segment, anything model. And so there's gonna be this novel opportunity to take what these large models know, and I guess it's kind of like a form of distilling, like distill them down into smaller architectures that you can use in versatile ways to run in real time to run on the edge.[00:46:13] And that's now happening. And what we're seeing in actually kind of like pulling that, that future forward with, with, with Robo Flow.[00:46:21] Segment Anything Model[00:46:21] So we could talk a bit about, um, about SAM and what it represents maybe into, in relation to like these, these YOLO models. So Sam is Facebook segment Everything Model. It came out last week, um, the first week of April.[00:46:34] It has 24,000 GitHub stars at the time of, of this recording within its first week. And why, what does it do? Segment? Everything is a zero shot segmentation model. And as we're describing, creating masks is a very arduous task. Creating masks of objects that are not already represented means you have to go label a bunch of masks and then train a model and then hope that it finds those masks in new images.[00:47:00] And the promise of Segment anything is that in fact you just pass at any image and it finds all of the masks of relevant things that you might be curious about finding in a given image. And it works remarkably. Segment anything in credit to Facebook and the fair Facebook research team, they not only released the model permissive license to move things forward, they released the full data set, all 11 million images and 1.1 billion segmentation masks and three model sizes.[00:47:29] The largest ones like 2.5 gigabytes, which is not enormous. Medium ones like 1.2 and the smallest one is like 400, 3 75 megabytes. And for context,[00:47:38] for, for people listening, that's six times more than the previous alternative, which, which is apparently open images, uh, in terms of number images, and then 400 times more masks than open[00:47:47] images as well.[00:47:48] Exactly, yeah. So huge, huge order magnitude gain in terms of dataset accessibility plus like the model and how it works. And so the question becomes, okay, so like segment. What, what do I do with this? Like, what does it allow me to do? And it didn't Rob float well. Yeah, you should. Yeah. Um, it's already there.[00:48:04] You um, that part's done. Uh, but the thing that you can do with segment anything is you can almost, like, I almost think about like this, kinda like this model arbitrage where you can basically like distill down a giant model. So let's say like, like let's return to the package example. Okay. The package problem of, I wanna get a text when a package appears on my front porch before segment anything.[00:48:25] The way that I would go solve this problem is I would go collect some images of packages on my porch and I would label them, uh, with bounding boxes or maybe masks in that part. As you mentioned, it can be a long process and I would train a model. And that model it actually probably worked pretty well cause it's purpose-built.[00:48:44] The camera position, my porch, the packages I'm receiving. But that's gonna take some time, like everything that I just mentioned the
More Than Just Code podcast - iOS and Swift development, news and advice
This week Jaime, Mark and Tim discuss the WWDC 2023 Lottery and what we expect to see at the June 5 WWDC 23 Keynote. The Bitcoin Whitepaper Is Hidden in Every Modern Copy of macOS. Should you enable Apple's Advanced Data Protection for iCloud. Apple Pay is now available in South Korea. Apple introduces Apple Pay Later. Apple Passwords Deserve An App. Ability to change iCloud password with only user's PIN code. Our WWDC 2023 predictions and wish list. iOS 17 Rumored to Drop Support for iPhone X, First-Generation iPad Pro, and More. Picks: 30th Anniversary Mac icons, Awesome newsletters for iOS and Swift developers in 2022, Visually learn Core Data in SwiftUI picture book, Understanding Swift Trailing Closure Syntax, Become A SwiftUI Navigation Pro, Syntax Color - How and why I present code the way I do.
01.11月Markit PMI跌破50 02.密西根大學西費者信心指數表現 03.勞動力市場持續失溫 04聯準會最新會議紀要:上調終端利率預期,適度減緩升息步調。 --- Send in a voice message: https://anchor.fm/u694au6bd4u723e/message
@kmens5 and @DaoChemist are back to talk about Apple's approach to the Metaverse, and how their LiDAR scanner and the updates on their Augmented Reality developer libraries are part of a strategy to be involved and be a massive player in the Metaverse.
Hablamos con Cristo Vega y Alberto Carlier sobre la resaca que ha dejado la última WWDC…@CristoVQ @guaica14@joaquin_rr @AlbertoCarlier @martinguiroy Vente que esto no para!!!Spreakerhttps://www.spreaker.com/show/macilustratedSpotify:https://open.spotify.com/episode/3rAAmYoXAzf9BEqXuczzbq?si=SIFuKfYBRbOb-90QvHaKMQSíguenos en TWICH:https://www.twitch.tv/macilustratedÚnete al chat de TELEGRAM:https://t.me/MACiLustratedAfiliado NORDVPN https://go.nordvpn.net/aff_c?offer_id=601&aff_id=53038&url_id=14078USE COUPON CODE: macilustratedVisita nuestra WEB:www.macilustrated.comContacta con nosotros en:hola@macilustrated.comSíguenos en Twitter:@macilustratedSíguenos en Instagram:@macilustratedDonaciones de apoyo al canal:https://www.paypal.com/paypalme/macilustrated
Voici l'épisode 9 de "la quotidienne iWeek" en ce vendredi 10 juin 2022. Tim Cook sur Canal+ : enfin l'interview qu'on attendait ! Avec le soutien de CleanMyMac X, l'utilitaire tout-en-un pour nettoyer son Mac et le garder aussi rapide qu'au premier jour en quelques clics. Cliquez ici et bénéficiez de 5% de remise ! Vous ferez aussi un bon geste en soutenant l'éditeur ukrainien de CleanMyMac X, MacPaw, qui continue d'assurer le développement et le service client malgré la guerre. Présentation : Benjamin VINCENT (@benjaminvincent) + Fabrice NEUMAN (@FabriceNeuman). Production : OUATCH Audio. Tags : 12, 13, 14, 15 et même 16 ! ; un iPad Pro de 14,1 pouces ? ; direction : Mars ; le puzzle du casque se met en place ; la nouvelle carte d'identité française bientôt intégrée à votre iPhone. Bonne découverte de "la quotidienne iWeek" si vous nous écoutez pour la première fois, parlez de nous autour de vous, retweetez-nous (@iweeknews ), bonne journée, bonne écoute et à lundi ! Benjamin VINCENT & la team #iweekLQI PS : rejoignez la communauté iWeek sur Patreon et bénéficiez de bonus exclusifs !
WWDC22Analizando y comentando lo que ha sucedido en la WWDC22@martinguiroy @jav1chu87 @guaica14@joaquin_rr @Jesus_A_Olmos @DarthRegorVente que esto no para!!!Spreakerhttps://www.spreaker.com/user/macilustratedjj/episodio-con-applelianos-marzoSpotify:https://open.spotify.com/episode/3rAAmYoXAzf9BEqXuczzbq?si=SIFuKfYBRbOb-90QvHaKMQSíguenos en TWICH:https://www.twitch.tv/macilustratedÚnete al chat de TELEGRAM:https://t.me/MACiLustratedAfiliado NORDVPN https://go.nordvpn.net/aff_c?offer_id=601&aff_id=53038&url_id=14078USE COUPON CODE: macilustratedVisita nuestra WEB:www.macilustrated.comContacta con nosotros en:hola@macilustrated.comSíguenos en Twitter:@macilustratedSíguenos en Instagram:@macilustratedDonaciones de apoyo al canal:https://www.paypal.com/paypalme/macilustrated
Wir sind ein bisschen durch den Wind und wissen nicht so recht über was wir reden sollen in der aktuellen Situation. Wir reden über Podcast Empfehlungen, die User Experience beim Spenden von Geld, wie wir mit dem Krieg in der Ukraine umgehen, was wir uns von der Apple Keynote wünschen und über unsere letzten Fahrrad-Gadgets. Viel Spaß beim zuhören Ingmar & Jurek Hier gehts zu den Spendenorganisationen Weitere Shownotes: Spendenorganisationen Lage der Nation – Der Politik-Podcast aus Berlin mit Philip Banse und Ulf Buermeyer Streitkräfte und Strategien Podcast Sony Vlog-Kamera ZV-1 Opal Camera Dell UltraSharp Webcam iOS 13 FaceTime ‘correction' uses ARKit 3 to make eyes look straight ahead ShockStop Suspension Stem – Redshift Sports Garmin Varia™ RTL516 - Fahrradradar mit Rücklicht GPS-Fahrradcomputer für Radfahrer und Radrennfahrer - Wahoo Fitness
Ok, we are really spinning our wheels now getting a new app idea pinned down, but the upshot is there are a lot of interesting subjects touched upon this week, including the "confirmation" of RealityOS, how people occlusion works in ARKit, a tangent about the history of Web API technologies, and much more. Plus, our Not a Sponsor this week could help you keep your food from spoiling! ## Topics Discussed: - RealityOS is Real! - How ARKit People Occlusion Works - What makes a good AR experience, according to Apple - AR Goggles Pricing and Design - A Tangent on XML, JSON, gRPC, and Web APIs - Ray casting and ray tracing - Not a Sponsor: GroceryTimer.app Intro music: "When I Hit the Floor", © 2021 Lorne Behrman. Used with permission of the artist.
El CEO de Apple, Tim Cook, dice que el metaverso tiene mucho potencial y que su empresa está invirtiendo en consecuencia. “Es muy interesante para nosotros”, señaló. Los bancos de inversión globales Morgan Stanley y Goldman Sachs han pronosticado que el metaverso podría ser una oportunidad de 8 billones de dólares. Apple Inc. respondió una pregunta sobre el metaverso durante su llamada de ganancias del primer trimestre de 2022 la semana pasada. Se le preguntó al director ejecutivo Tim Cook: "¿Cómo piensa acerca de la oportunidad del metaverso y el papel de Apple en ese mercado?" “Somos una empresa en el negocio de la innovación”, respondió el CEO de Apple. “Así que siempre estamos explorando tecnologías nuevas y emergentes. Y he hablado mucho sobre cómo esta área es muy interesante para nosotros”. Cook elaboró: "En este momento, tenemos más de 14,000 aplicaciones ARKit en la App Store, que brindan experiencias increíbles de AR [realidad aumentada] para millones de personas en la actualidad", y enfatizó:Vemos mucho potencial en este espacio y estamos invirtiendo en consecuencia. Varias personas han estimado que el tamaño potencial del metaverso es multimillonario. Los bancos de inversión globales Goldman Sachs y Morgan Stanley han estimado que el metaverso es una oportunidad de mercado de 8 billones de dólares. En diciembre, el estratega de Bank of America, Haim Israel, dijo que el metaverso es una gran oportunidad en la que las criptomonedas se utilizarán ampliamente como monedas. “Definitivamente creo que esta es una oportunidad enorme, enorme”, opinó.
Kirin Sinha is the co-founder and CEO of Illumix, a company building an AR-first mobile gaming platform. You may be familiar with Illumix if you're a fan of the horror franchise, Five Nights at Freddy's. The Illumix team has already found a lot of success with their first title, Five Nights at Freddy's AR: Special Delivery.Prior to founding Illumix, Kirin was the founder and Executive Director of Shine for Girls, whose mission is to transform the lives of middle school girls by cultivating a passion for mathematics through a program that incorporates both math and dance. Kirin has a BS in Theoretical Math and Computer Science from MIT as well as three Masters degrees spanning mathematics, machine learning, and business from Cambridge, The London School of Economics, and Stanford.In this conversation, Kirin shares how she thinks about creating compelling stories and gameplay for mobile devices where AR is a central component.We go to talk about how the Five Nights at Freddy's franchise is a great fit for AR, and also why the Illumix team needed to go beyond AR Kit, AR Core, and Unity in order to deliver their vision for a compelling AR-first mobile experience.Kirin talks about her broader ambitions and also has some amazing advice for building and maintaining self-confidence.You can find all of the show notes at thearshow.com.
Antradienį Seimas galutinai apsispręs dėl kitų metų valstybės biudžeto. Valdantieji jį vadina atlyginimų ir pensijų biudžetu. Opozicija stebisi, kad augant ekonomikai nuspręsta dar labiau skolintis, o mokesčių reformai nesiryžtama. Ekonomistai perspėja, kad didesnes pajamas gali suvalgyti infliacija.Ar kitų metų biudžetas iš tiesų yra socialiai jautrus? Laidoje dalyvauja Finansų viceministras Mindaugas Liutvinskas, Seimo nariai Zigmantas Balčytis, Rasa Budbergytė, Mykolas Majauskas, ekonomistas Tadas Povilauskas, BNS žurnalistas Šarūnas Sabaitis.Ved. Marius Jokūbaitis
Welcome to Code Completion, Episode 58! We are a group of iOS developers and educators hoping to share what we love most about development, Apple technology, and completing your code! Follow us @CodeCompletion (https://twitter.com/CodeCompletion) on Twitter to hear about our upcoming livestreams, videos, and other content. Today, we discuss: - Code Completion Club: https://codecompletion.io/jointheclub - Indie App Spotlight, with a new app for you to check out: - Christmas Guide (https://yaacoub.github.io/apps/christmas-guide/) by Peter Yaacoub (https://twitter.com/yaapete) - Tools for Game development - SpriteKit (https://developer.apple.com/documentation/spritekit/) - SceneKit (https://developer.apple.com/documentation/scenekit/) - ARKit (https://developer.apple.com/documentation/arkit/) - Unity (https://unity.com) - GameMaker Studio (https://www.yoyogames.com/en/gamemaker) - Pulp for playdate (https://play.date/dev/) - Games: - Undertale (https://undertale.com) - Frenzic Overtime (https://frenzic.com) - Oceanhorn (https://www.oceanhorn.com) - Geometry Wars (https://www.youtube.com/watch?v=y-_qlaywKBs) - SLUZZULS (https://mochidev.com/apps/sluzzuls) - The Legend of Zelda, Ocarina of Time Beta Showcase by ZFG (https://www.youtube.com/watch?v=AUci0fV7FWQ) - Corridor Crew Bob Ross Challenge (https://www.youtube.com/watch?v=gcUBEWmIJkk) - Mini Review Corner: COVID-19 Booster - Commented Out: - Game and Watch Zelda (https://www.amazon.com/Nintendo-Game-Watch-not-machine-specific/dp/B097B1ZJ5T?ref_=ast_sto_dp) - Game and Watch Mario (https://www.amazon.com/Game-Watch-Super-Mario-Nintendo-switch/dp/B08GZ3DRLW?ref_=ast_sto_dp) Also, join us for #CompleteTheCode, a segment that tests your knowledge on Swift, Apple, and all things development! Your hosts for this week: * Spencer Curtis (https://twitter.com/SpencerCCurtis) * Dimitri Bouniol (https://twitter.com/DimitriBouniol) Be sure to also sign up to our monthly newsletter (https://codecompletion.io/), where we will recap the topics we discussed, reveal the answers to #CompleteTheCode, and share even more things we learned in between episodes. You are what makes this show possible, so please be sure to share this with your friends and family who are also interested in any part of the app development process. Sponsor This week's episode of Code Completion is brought to you by Super Easy Timer. Search for Super Easy Timer on the Mac App Store to give it a try. https://apps.apple.com/app/apple-store/id1525104124?mt=12 Complete the Code How can you make all calls to loadImage() run concurrently, and return images in the same order? ```swift // How can you make all calls to loadImage() run concurrently, // and return images in the same order? func loadImages(_ ids: [UUID]) async { var images: [Image] = [] for id in ids { let image = await loadImage(id) images.append(image) } return images } ``` Be sure to tweet us (https://twitter.com/intent/tweet?text=%23CompleteTheCode%20cc%2F%20%40CodeCompletion&original_referer=https%3A%2F%2Fcodecompletion.io) with hashtag #CompleteTheCode (https://twitter.com/hashtag/CompleteTheCode) if you know the answer!
In this episode of the AllThingsXR podcast, I have a conversation with Neil Mathew. Co-Founder Placenote. Neil Mathew is the co-founder of Placenote, the company that built the first AR Cloud SDK for ARKit. He's a... The post Episode 29 : Neil Mathew – Pivoting from the original idea appeared first on AllThingsXR.com.
In this episode of the AR/VR Magazine Podcast, I review the new Marvel Studios' Eternals: AR Story Experience. Today, as a promotion for Marvel's upcoming November 5th movie release, “Eternals,” Marvel Studios launched its first augmented reality story experience – Eternals: AR Story Experience App for iOS. Yesterday, I had a chat with the team at Marvel Studios, who were kind enough to give me an advanced sneak peek at the app which offers a guided augmented reality / mixed reality tour allowing users to explore the film's characters and storyline. The app, which took 2 years of development, was built using Apple's ARKit and features some pretty impressive volumetric video capture of actress Lia McHugh's character Sprite, which makes her appear in your viewing space. If you are a Marvel fan, you will definitely want to check this one out! Show Notes Eternals Website: https://www.marvel.com/movies/eternals App Website: https://marvel.com/eternalsAR App Store Page: https://apps.apple.com/us/app/eternals-ar-story-experience/id1584342522 App Trailer: https://www.youtube.com/watch?v=e_4mMP5t0qw Today's Sponsor Today's podcast is sponsored by Zencastr – a browser-based platform for high-quality podcast production. We use Zencaster here at Robotspaceship studios and it has been an invaluable tool for recording all of our remote podcasts. Use the promo code “kemweb” to get a 40% discount on the professional package from Zencastr for a period of three months after the 14-day test phase! For more info, go to https://zencastr.com/ AR/VR Magazine Website: https://arvrmagazine.com/ Subscribe and Follow! Be sure to subscribe to our podcast so you don't miss all the weekly episodes. We are currently on Spotify, Apple Podcasts, Google Podcasts & Anchor with support for more podcasts on the way. You can also follow us on all the relevant social media channels. We are on: Facebook, Instagram, Twitter, LinkedIn and YouTube. --- Support this podcast: https://anchor.fm/arvrmagazine/support
More Than Just Code podcast - iOS and Swift development, news and advice
James Thomson joins us to talk about developing apps for Apple platforms. James is the creator of PCalc - the official calculator app of MTJC, Drag Thing and his latest app Dice by PCalc. James has been successfully writing apps longer than the iMac has been a thing, worked for Apple, had Douglas Adams beta test his apps, and has been a successful indie developer since the early 90's. Special Guest: James Thomson.
#spatialweb #spatialcomputing #adobe #projectaero #magicleap #unity #ubisoft #mirrorworld #digitaltwin Jimmy Alamparambil is currently the senior computer scientist at Adobe building & driving the framework for the next computing evolution "The Spatial Computing". He has been part of companies such as Jam City, Ubisoft, Electronic Arts, Unity Technologies & Magic Leap Jimmy is responsible for both ARkit & ARCore integration with Unity & has worked in close collaboration with #Apple and other game developers to develop the Unity ARKit Plugin and Unity ARKit Remote, his vision is to play a role in laying the architecture for the Spatial Web and make #augmentedreality accessible for the #dev #community plus allow the creatives, marketeers & enthusiasts build #extendedreality applications through low or #nocode. https://www.linkedin.com/in/jimmyalamparambil https://twitter.com/jimmy_jam_jam?lang=en https://www.youtube.com/channel/UCDy04e1tAzkpDFknTIUAFOQ/featured
2087ANRワンボタンの声ダウンロードリンク■6/26配信 クックCEOが欧州の新規制はiPhoneのセキュリティーを壊すと主張、20年後のiPhoneや未来の技術についてフランスのオンライン会議でクックCEOが語るインタビュー映像が公開中、swiftのARKitで眼球の位置や向きの情報を取得してiPhone上のWebViewをスクロールする技術、GoogleがAndroid端末同士で紛失したスマホを探し出せる巨大ネットワークを作ろうとしている可能性、全国の民放AMラジオ令..
Live Text en iOS 15, el audio espacial llegando a FaceTime, la compra de Shazam y el desarrollo de ARKit en 2017, las mejoras en mapas… Muchas novedades que apuntan a una gran plataforma de realidad aumentada creada por Apple donde unas gafas serían las protagonistas. *** Loop Infinito es un podcast de Applesfera, presentado por Javier Lacort y editado por Santi Araújo. Contacta con el autor en Twitter (@jlacort) o por correo (lacort@xataka.com). Gracias por escuchar este podcast.
More Than Just Code podcast - iOS and Swift development, news and advice
We are joined by Evan K Stone and Leo Dion as we talk about the WWDC Keynote and the Platform State of the Union sessions. We fact check on Astra Zenica shots, and follow up on Sosumi, Apple product reviews, struggles with Apple Card, noisy audio while running Xcode, and people annoyed that they sold their M1's ahead of WWDC. Picks: Leo Dion's Orchard Nest site, PlayDoh Touch Shapes Studio, JSON Selector Generator, Jordan Morgan's Best In Class iOS App Book, Why There are Now So Many Shortages (It's Not COVID). Special Guests: Evan K Stone and Leo Dion.
More Than Just Code podcast - iOS and Swift development, news and advice
A re-roll of our WWDC 2019 episode - We are joined by Alexis Gallagher and Ricky de Laveaga in the Podcast Studio at WWDC 2019 McEnery Convention Center. Recorded at 11 am Friday June 7, 2019. We fact check on Bobby Orr and the approximate number of active iOS developers. #askMTJC has Namrata Bandekar responding to joining start ups, as well the pronunciation of Dave Verwer IRL. We discuss our impressions of WWDC 2019 — SwiftUI, declarative programing, Combine framework, ARKit 3, Reality Composer, Swift Playgrounds 3, Swift Package Manager, stand alone Watch apps, iPadOS, TestFlight Feedback, Transporter, and Sign In With Apple. Picks: Performance, Pencil Support, Optimizing File Storage, DataFlow for SwiftUI, Combine in Practice, Sign In With Apple, Voice Dream Scanner, ClassKit, What's New In Swift, try! Swift, AltConf. Special Guests: Alexis Gallagher and Ricky de Laveaga.
SAVE with Ting Mobile and get a $25 service credit
On this episode is a deep dive into one of the 2020 Apple Design Award winner's Shapr3D. Shapr3D is a desktop class CAD drawing application for iPad that was showcased at the April 20th event. It is an Apple Pencil first app and now with the trackpad has a special mode designed with the trackpad and keyboard in mind. In this episode is my interview with Istvan Csanady, the CEO of Shapr3D. It was fascinating for me to hear not only about this wonderful app, but also learn about CAD applications, 3D printing, and a bunch of interesting manufacturing topics. Bonus content and early episodes with chapter markers are available by supporting the podcast at www.patreon.com/ipadpros. Show notes are available at www.iPadPros.net. Feedback is welcomed at iPadProsPodcast@gmail.com.Chapter Markers00:00:00: Opening00:01:27: Patreon.com/iPadPros00:02:05: Review the podcast00:02:23: Istvan Csanady00:03:23: The iPad00:06:00: Your background with CAD00:07:19: What is CAD?00:08:29: 3D Printers?00:10:44: The only app you need?00:12:55: Onboarding tutorials00:15:26: 3 Tiers00:16:28: Industry specific modes?00:17:26: Different materials?00:18:14: Double Tap?00:20:24: Evolution of the tutorials00:21:14: Trackpad Support00:27:17: Keyboard Shortcuts00:28:50: Pencil Plus Keyboard?00:30:19: The Mac App00:34:14: Tips and tricks00:35:22: Splitscreen00:36:12: Siemens Parasolid00:40:10: Using Shapr3D In Different Places00:42:10: A Different Paradigm00:45:27: Lost In Translation00:46:58: Importing Images00:47:30: 2D Imports00:49:31: AR Kit00:52:53: Anything Else?00:53:17: Where Can People Find More Info?00:54:22: Closing See acast.com/privacy for privacy and opt-out information.
Roxana is amazing. She's having loads of fun developing iOS apps for Monstarlab. In Dubai. It has been a while since she's seen rain. And she is working hard on creating content online on the topic of AR Kit. Also she is an advocate for inclusivity by leading the charge at Women in Tech Dubai.You can find Roxana online through her website: https://roxanajula.comOn Twitter, her handle there is RoxanaJula Roxana specifically asked me to mention the Borderless Engineering Conference.Please rate me on Apple Podcasts.Send me feedback on SpeakPipeOr contact me through twitterMy website appforce1.netNewsletter, sign up!My book: Being a Lead Software Developer Lead Software Developer Learn best practices for being a great lead software developer.Support the show (https://pod.fan/appforce1)
Kirin Sinha is the co-founder and CEO of Illumix, a company building an AR-first mobile gaming platform. You may be familiar with Illumix if you’re a fan of the horror franchise, Five Nights at Freddy’s. The Illumix team has already found a lot of success with their first title, Five Nights at Freddy’s AR: Special Delivery.Prior to founding Illumix, Kirin was the founder and Executive Director of Shine for Girls, whose mission is to transform the lives of middle school girls by cultivating a passion for mathematics through a program that incorporates both math and dance. Kirin has a BS in Theoretical Math and Computer Science from MIT as well as three Masters degrees spanning mathematics, machine learning, and business from Cambridge, The London School of Economics, and Stanford.In this conversation, Kirin shares how she thinks about creating compelling stories and gameplay for mobile devices where AR is a central component.We go to talk about how the Five Nights at Freddy’s franchise is a great fit for AR, and also why the Illumix team needed to go beyond AR Kit, AR Core, and Unity in order to deliver their vision for a compelling AR-first mobile experience.Kirin talks about her broader ambitions and also has some amazing advice for building and maintaining self-confidence.You can find all of the show notes at thearshow.com.
More Than Just Code podcast - iOS and Swift development, news and advice
We're on Clubhouse as MTJC iOS Development and we follow up on our two Clubhouse events. We follow up with 5 iPhone Hacks like unlocking your iPhone with a face mask. The Apple Card doesn’t actually discriminate against women, investigators say. Apple-funded Stanford study concludes Apple Watch can be used to measure frailty. Apple won’t give Siri a female-sounding voice by default anymore. Nobody designs for small iPhone devices anymore. WWDC21 date has been set and we discuss what we'd like to see. Picks: Free for developers, Xcode tips repo, Updated iOS App Dev Tutorials, Protocol Oriented Programming with Swift 5, CustomStringConvertible, SwiftUI by Tutorials 3rd Edition.
Bienvenue dans le deux-cent-trente-deuxième épisode de CacaoCast! Dans cet épisode, Philippe Casgrain et Philippe Guitard discutent des sujets suivants: AirPods Max - Pour qui? Plans - Maintenant entièrement disponibles au Canada Vidéos Apple - Trois nouveaux vidéos très techniques SwiftUI - Un nouveau tutoriel chez Apple MarkdownUI - Pour faire du markdown en SwiftUI SkipSiriSetup - Plus besoin de désactiver Siri lors d’une mise-à-jour Cloudflare Analytics - Des analytiques pour votre site web qui respectent la vie privée ARKit - On s’amuse à faire un magazine en réalité augmentée Ecoutez cet épisode
Swift News comes out every Monday - Subscribe or follow me on twitter to be notified of new episodes. In this episode we discuss the new Diversity in Swift initiative, Apple releasing more tutorials and videos, the MacStories App Awards and the story of Uber adopting Swift back in 2016 and how it was nearly a tragedy. We also talk about indie app development, ARKit and more. YouTube Video version: https://youtu.be/ObALdJyiPgU Swift News GitHub Repo with Links to Stories: https://github.com/SAllen0400/swift-news More information about my iOS Development courses: https://seanallen.teachable.com/ Link to my book - How I Became an iOS Developer: https://gumroad.com/l/sean-allen-origin Twitter: https://www.twitter.com/seanallen_dev YouTube Channel: https://www.youtube.com/seanallen Portfolio: https://seanallen.co Book and learning recommendations (Affiliate Links): Ray Wenderlich Books: https://store.raywenderlich.com/a/20866/link/1 Ray Wenderlich Video Tutorials: https://store.raywenderlich.com/a/20866/link/24 Paul Hudson's Hacking With Swift: https://gumroad.com/a/762098803 Learn Advanced Swift Here: https://gumroad.com/a/656585843 My Developer & YouTube Setup: https://www.amazon.com/shop/seanallen --- Support this podcast: https://anchor.fm/seanallen/support
Swift News comes out every Monday - Subscribe or follow me on twitter to be notified of new episodes. In this episode we discuss new details for the App Store Small Business Program, Swift Version History, Best Apps of 2020, Spend Stack getting acquired and app pricing models. We also talk about working in bursts, ColorKit, ARKit and more. YouTube Video version: https://youtu.be/ASVNIX-J-zE Swift News GitHub Repo with Links to Stories: https://github.com/SAllen0400/swift-news More information about my iOS Development courses: https://seanallen.teachable.com/ Link to my book - How I Became an iOS Developer: https://gumroad.com/l/sean-allen-origin Twitter: https://www.twitter.com/seanallen_dev YouTube Channel: https://www.youtube.com/seanallen Portfolio: https://seanallen.co Book and learning recommendations (Affiliate Links): Ray Wenderlich Books: https://store.raywenderlich.com/a/20866/link/1 Ray Wenderlich Video Tutorials: https://store.raywenderlich.com/a/20866/link/24 Paul Hudson's Hacking With Swift: https://gumroad.com/a/762098803 Learn Advanced Swift Here: https://gumroad.com/a/656585843 My Developer & YouTube Setup: https://www.amazon.com/shop/seanallen --- Support this podcast: https://anchor.fm/seanallen/support
Developing a pilot or a proof of concept is among the first steps to introducing XR into your industry, but that's only going to provide so much ROI unless you can fully implement that idea. Dave Beck from Foundry 45 discusses how to make that leap. Alan: Hey, everyone, Alan Smithson here. Today, we're speaking with Dave Beck, founder and managing partner at Foundry 45, an immersive technology company that develops enterprise level virtual reality training experiences. They've created over 250 experiences for notable clients such as AT&T, Coca-Cola, Delta, and UPS. We're going to be discussing going from PoCs, pilots, and case studies to full scale deployments. All that and more, on the XR for Business podcast. Dave, welcome to the show. Dave: Hey, Alan, thanks so much for having me on here. Alan: It's my absolute pleasure. I'm super excited. You guys have been doing so much work in the VR training space. First of all, let's just talk about, what is Foundry 45? How did you get into this? And we'll kick it off from there. Dave: I guess first off, it's nice to chat with you again. I went back and checked my email, and it looks like the first time you and I talked was way back in 2016. So a lot's happened in that time, hasn't it? So, OK, we put VR to work by creating virtual reality training experiences for enterprise partners. And we specialize in industrial-- think hard skills type training. I've actually been working in immersive technology for almost a decade now. Initially it was in augmented reality, which was something that we added on the side for a SAS product we built, that was actually our main business during that time. And we did a lot of stuff where you would hold up your phone or a piece of industrial equipment, and it would tell you where to wrench on it or how to change the filter, things like that. It was cool technology, but we pretty quickly realized that no one was going to hold a phone or an iPad over a piece of industrial equipment on an oil rig. They weren't going to set it down and start wrenching on something, and then pick it up with greasy hands. [chuckles] So what we wanted to do was hands-free AR, but the technology just wasn't there. We exited that company in 2014, and we were trying to figure out what we wanted to do when we grow up. Alan: You exited your company in 2014. Most people didn't even know what this technology was when you guys were exiting your first one and getting into the second. Think about that. Dave: Yeah. I mean, we were trying to figure out what we wanted to be when we grew up. And one of my co-founders bought an early innovators edition of Samsung Gear VR. Do you remember that one? Alan: I have the one with a solid strap on top. Dave: Yeah. Did you strap the Android phone into the headset? Alan: Exactly. Dave: Yeah. And you could use that camera on the back of the phone as a pass-through. Alan: Yes. Well, not very well, but yes, you could. Dave: Well, yeah, it's funny. You know where this is going, right? Because we wanted to use it for hands-free AR, but it didn't work at all. Alan: Not without making people very sick. Dave: Yeah, the processor wasn't good enough. It was super laggy, which kind of made it nauseating. So that wasn't going to work. But wow, VR was awesome. That's when we made the decision to start down our current path. Alan: And that was before ARCore and ARKit. So planer tracking really wasn't a thing. Slim mapping, it was not that easy to do. Dave: Yeah. I mean, just
Today's guest got his start in the world of game development. But soon, Arash Keshmirian saw the writing on the wall that XR's current usefulness was better-suited to the worlds of industry, retail, and journalism. Arash and Alan discuss how he made that transition. Alan: Hey, everyone, it's Alan Smithson here, the host of the XR for Business podcast. Today we have Arash Keshmirian, co-founder of Extality. His personal goal is to create powerful content that delivers results. We're going to dig into using Magic Leap and Hololens and mixed reality headsets as a tool for business. So all that and more, coming up next on the XR for Business podcast. Arash, welcome to the show, my friend. Arash: Thank you for having me. Great to be here. Alan: It's my absolute pleasure. You guys have done some pretty cool stuff. I was on your website playing with a shoe. What is Extality? Arash: Were a lot of things to many people. So we built Extality out of a long, 10 year experience in the games industry, building mobile games. Did a lot of games, including Zombie Gunship, which ended up being this kind of worldwide sensation of shooting zombies from an airplane. That company -- Limbic -- we ended up doing a lot of XR stuff. And kind of around 2016, 17, 18 we built a game for ARKit, called Zombie Gunship Revenant. And that ended up being a huge hit across the app store. Apple featured it a whole bunch of times. It was one of the 2017 games of the year. And it spread ARKit to a lot of people, trying new things on their new iPhones. And we later did a project called Zombie Guns Raptor with Oculus and Oculus Go, Gear VR. But really kind of around that time -- 2017 -- we started to feel like it was getting way too crowded in the games business, and we were starting to look around and try to figure out what we could do with our experience in high-performance graphics and making cool experiences, immersive experiences. I started talking to a guy named Ryan Peterson, who's the founder of a CEO called Finger Food out in Vancouver. And he was telling me about all these exciting opportunities in AR and VR for enterprises. He was talking about how they'd saved millions and millions of dollars for a truck company that was looking to move their design to virtual reality from using clay models. And this got our head scratching, we were like, "You know, maybe there's an opportunity to use all of our games experience, to help big companies and do more than just give people an entertaining hour on their phones." So we founded a new company called Extality. And we set out to essentially discover companies that really wanted to explore XR, be it on their phones, on headsets, iPods -- every type of XR -- and leverage our background in doing just really hard graphics problems, building scalable global servers and connectivity, all those hard things that you learn how to do making games, we quickly realized that we're super, super applicable to building enterprise solutions as well. Alan: Actually, I know Ryan very well from Finger Food, really great guy. And they've done some amazing work in the space. What are some of the highlights that you've done for enterprise? And first of all, I just want to say that having a flying zombie shooter game? Pretty awesome. Arash: [chuckles] Thank you. Alan: The fact you guys had a hit with ARKit is pretty amazing, because there's not too much out there leveraging the power of ARKit yet. Arash: Yeah. I mean, if you want to talk about games for just a second, it's an interesting thing. I mean, it gives people a totally different experience using their phone as the controller and running around the room. We have all these videos during our user tests
We live in a three-dimensional world, and according to today’s guest — You Are Here Labs president John Buzzell — our computers are finally starting to catch up with that. John shoots the proverbial breeze with Alan on how spatial computing is going to fundamentally change our relationship with computers, and thus, our relationship with the world. Alan: My name is Alan Smithson, your host for the XR for Business Podcast. Today’s guest is a good friend, John Buzzell from You Are Here Labs and You Are Here Agency. John is an award winning 28 year veteran of the digital industry, creating interactive experiences across augmented reality, virtual reality, video games, mobile apps and numerous high volume websites. To learn more about You Are Here Labs and You Are Here Agency, visit yahagency.com. John, welcome to the show. John: Thanks, Alan. Good to be with you. Alan: And of all the people we’ve had on the show, you have a lot of experience in this field. I mean, you built the AR Porsche visualizer where you could drop a Porsche right in your living room and I actually have a photo of a Porsche in my living room from your app. John: [laughs] That’s great. You know, that was an interesting project, because we started off on the Hololens and it was a really interesting project. But at some point, Porsche said this is a little too future for us at the moment and we need something that the dealers and the salespeople can use without fear. And so when ARKit popped up from Apple and they said surprise, now everybody with an iPhone 6 and above and use augmented reality, it really changed the game. And we very quickly converted that experience from the Hololens to the humble iPad and it took off from there. So we were really excited to have one of the first ARKit apps that was really connected to a major company or brand. And I’m glad you liked it, too. That’s cool. Alan: It was really special. Can people download it now still? John: Well, no, they can’t. That was about two years ago that we did it. And for all of us in technology, who knows how fast it moves. Porsche is a global company and they were very impressed with the innovation. And I think they were excited to kind of pull it back to HQ and see what they could do globally with it. And also our clients left for jobs at other companies simultaneously. [laughs] So– Alan: That’s the challenge in technology, you’re working on a project with somebody, you’re all in it, and then they leave. [laughs] John: I mean, I think that’s one of the neat things about emerging tech is, is it really can help vault peoples careers into the next dimension, in the sense that these technologies are so profound and they will affect the work that we do and the way we live our lives for so long in the future, that people that have this experience, it’s really great for them individually. Alan: You’ve been doing this a while longer than myself, but I’ve been in early VR since 2014. And I’ve noticed that a lot of the people that were just building demos and stuff like that, now are running huge companies. HP and Microsoft, they’re running huge departments in this, just because they were early and learned how to do it. And they learned in a time when there was no YouTube video on how to make AR, you had to just kind of guess. John: Yeah. I mean, my career resembles that, in the sense that I got started doing interactive marketing on diskettes before CD-ROM. Our friend Cathy Hackl says, “Don’t talk about that, it makes you sound old!” but I think the experi
A Netflix hack lets you feel the action in a scene by vibrating your phone Netflix Hack Day, the company's internal hackathon, has a habit of producing some amazing gems — like a brain-controlled interface, a Fitbit hack that shuts off Netflix when you fall asleep, a Netflix app for the original NES, and a way to navigate the Netflix app with Face ID and ARKit, to name a few.
An Interview with Lalit Vijay, Curator of Laravel Live India and Co-Founder ov StyleDotMe Lalit on twitter StyleDotMe Masters of Scale Reply All The Knowledge Project Inside Intercom Transcription sponsored by Larajobs Editing sponsored by Tighten Matt Stauffer: Welcome back to The Laravel Podcast, season three. Today I'm talking to Lalit Vijay, the original founder of Laravel Live India, the co-creator of some great meet-ups there, and much more, stay tuned. Matt Stauffer: Alright, welcome back to The Laravel Podcast, season three. Today I'm gonna be talking to Lalit Vijay, who is known in a lot of different ways. But interestingly, just like some of my favorite guests, a lot of you probably have never heard of him before, and a lot of you think he's the most amazing person on the planet and can't imagine why anybody wouldn't have heard of him. Matt Stauffer: And that's my favorite thing, where there's a community who knows him deeply and votes for him hundreds of times to come on the podcast. And then there's some of you who say, well who's that? So I'm excited for a new opportunity to share with you somebody who, who you didn't know about before, and afterwards, you're glad you had the chance. So first of all, introduce yourself. And when you meet somebody in the grocery store, what do you tell them that you do? Lalit Vijay: So, hi first to the whole audience of the Laravel Podcast. I have been following it, and it's a kinda great pleasure for me to be over here. Thank you Matt for that opportunity. And for me, I generally introduce myself as a backend lead and operation manager at StyleDotMe. And along with it, I curate meet-ups in India for the Laravel community because I want this thing to grow and reach to, across India in a really, really big way. Matt Stauffer: So if you meet somebody in the grocery store, and they say, what do you, and you say, oh I'm the backend lead of blah, blah, blah, StyleDotMe, do they say I don't know what that is, or because it's a product, do they more say well, I don't know what that is, but what's StyleDotMe? Are you usually able to kind of skip around the conversation of what you do by talking about what you're doing it for? Lalit Vijay: Fun fact, what happened in my day-to-day routine is since we are the founding members of our startups right, so we get really bogged up, and 80% of time may consumes with either my teammates or meeting new clients and handling the backend stuff at the company. All my grocery and all that stuff is actually delivered online so I just roll with it. Matt Stauffer: Okay, so do you go, I'm trying to think of a separate context. Do you go to the gym? Do you go to the coffee shop? Where do you actually randomly meet people who aren't in tech? Lalit Vijay: Okay so, at airports, whenever I'm traveling across India. Matt Stauffer: Perfect. Lalit Vijay: And at that point of time, I start mostly I talk around my product at StyleDotMe, what you do. And it's like we build augmented reality applications, SnapChat virtual lens or that's a business and application and then people start and then I show them the product and actually make them try it on themselves. So yeah, that's yeah. Matt Stauffer: Okay. So is StyleDotMe, will you talk about StyleDotMe because I'm sure it'll come up again. Is it more something that your primary people you're selling to is the retailer and then the retailer, Lalit Vijay: Right. Matt Stauffer: Do they get a white labeled version of it? Lalit Vijay: No. Matt Stauffer: So they're having their clients use StyleDotMe but then pick them in StyleDotMe or something. Lalit Vijay: Right, right. Matt Stauffer: Okay, got it, okay. So you said you're the backend lead. Lalit Vijay: Yes. Matt Stauffer: So what I assume is that it's a primarily mobile app that's consuming probably something Laravel-ish. What does your tech stack look like in general? Lalit Vijay: So at Laravel, we use very different like multiple stack. It's not just Laravel over there. So at StyleDotMe, the primary application runs on IRIS. And where the real, our Machine Learning model runs, and so it detects a face, it figure outs your exact ear points, your neck points and overlay the items on that. Now to make it happen, what we use is a, we use a file base for real time data communication across all the devices. What we use Laravel for is like primarily backend tasks for uploading all the inventory data, managing those inventory data and making sure that what should go live, what should not go live. So, whatever the things which our admin panel controls, this is basically in the Laravel. Apart from that, we do a lot of data processing, image processing and all that happens in Python. Matt Stauffer: Okay. Lalit Vijay: Yeah, so it's like a bit of diverse. Laravel is one sort of part of it. Matt Stauffer: Okay, and obviously I want to ask more questions about that, but usually what I want to dig into is who you are as a person. But again, like I said, since some people don't know who you are as a well-known person, I at least want to lay the groundwork a little bit. So, that's your day to day work. And you said you're a founding member of the startup, so, how much of your work is coding and how much of your work is organizational and people-related? Lalit Vijay: Okay, so that's interesting. Initially, it was a lot of coding. Matt Stauffer: Right. Lalit Vijay: Initial two years was a lot of coding time. But now, I think 80% coding and 20% operations and managing people. Matt Stauffer: Yep, yeah, totally. Okay, and then other thing that you're actually probably more known for at least in Laravel world is that you're the organizer. Are you the organizer or co-organizer? Are you the primary person? Of Laravel Live India. Lalit Vijay: So I started it, but now what I always wanted from the community is that everybody's part of it. And whoever each volunteer, each participant is actually organizer for me. So, whether it is Fahad this year, Rishalla is putting a lot of effort. So, all these people are the building blocks of the community. It's not something which I say that okay, this is what I'm doing. This is my community's doing, and they're helping me out. Matt Stauffer: I love it, that's a good attitude, man. So, you are the original founder and now one of many organizers of Laravel Live India, which is a very large, and it's in its third year now, right? Lalit Vijay: Yes. Matt Stauffer: The Laravel conference. Lalit Vijay: Yes. Matt Stauffer: So tell us a little bit about, to somebody who's never heard of it before, tell us a little bit about the conference. Lalit Vijay: Alright, so for Laravel Live, it started because it was just one reason that I didn't have enough time to visit Laravel EU or US, and I wanted those awesome speakers over here so that more Indian people can interact with them. And conferences not only just give you space for knowledge setting but also meeting new people, which helps you expand your view of the community and help you grow in very different ways. So that was the key thing, the motivation and one day I decided that someone has to do it so, why not me? So, let's do it. And then we did the first version of it, and the response was pretty good. And a few people got job via that conference. And once I heard that that helped me feel motivated further, for it that yeah someone is getting benefited out of it. That's awesome, let's do it again. And now, after two years, this year it's pretty nice now. We selected venue based on community vote. Our people selected for Mumbai for this year. And we are doing this on third of March, 2019. Matt Stauffer: Oh, that's coming soon man. Lalit Vijay: Yeah, yeah, so, we have announced our speakers. We are preparing for it, and hopefully we'll see a lot of people especially people, Freep is there. Then Nuno is there, then Rumpel is there. So, these are a few people from the community which a lot of people know. And then there are a lot of developers within India who are actively working out and, it's pretty fun to see and be part of this whole community. Matt Stauffer: Very cool. So, one of the things that I think blew a lot of folks' minds was hearing about Laravel Nigeria being as many people as it was. Do you have an estimated count of what the attendance for Laravel Live India's gonna look like this year? Lalit Vijay: It's, so this year we are for doing 150 fixed. Also a number of places expect to-- Matt Stauffer: Got it. Lalit Vijay: Yeah. Matt Stauffer: And then you also are connected to, and I don't know exactly what the story is, but a series of meet-ups as well. Could you tell us a little bit about those? Lalit Vijay: Yeah so with this, before this conference, I started it as a meet-up. And the first meet-up was Laravel Live Delhi. And that was, actually the first meet-up got only five people. Oh yeah, five people. So we started that small, and over the period of time, we have grown very much. And recently we did a meet-up in Ahmedabad. Now the first meet-up in there was an attendance of 70 people. Matt Stauffer: Wow, that's awesome. Lalit Vijay: Right, so it's the meet-up which started with five people has grown to a 70 people meet-up. And in terms of conference, we on the first year we had 60 people turn out, second year it was 110, and we are doing 150 this year. So yeah, it's going pretty good. Matt Stauffer: Now is there, in any of the areas that you're doing this, do you have a big PHP community as well that's much larger, or is Laravel kind of really the main space where any of this work is happening in terms of community organization? Lalit Vijay: So I think with Laravel Live, now the Laravel community is growing. And how I see is that it's not just Laravel community which is growing, it's actually the whole coding community growing, right. People, we need to learn new things and the whole PHP space is growing overall. The biggest event I have seen in India with PHP domain is WordCamp for the WordPress. Matt Stauffer: Yeah, that seems to be the case in most places. Lalit Vijay: Yeah, so recently it happened in Ahmedabad with over 1,000 people of audience. Matt Stauffer: Wow. So what is the biggest tech stack around you? Is it Laravel if people are doing the type of work you're doing or there are other tech stacks that more folks are focusing on? Lalit Vijay: I think I see a lot of people around me working around Python. So, Python is kind of the, and that one kind of biased with me is I work well with a lot of people who are into image processing, Machine Learning and all that stuff. So, I find people who are mostly working in that domain. And website development kind of people are like not my core sort of thing when we look at the main R&D at StyleDotMe happens on Machine Learning and image processing, which is basically either CC++ and Python. Matt Stauffer: I've got lots more questions about that, but we've got to pause because at this point in the podcast, I've got to learn about you. So, tell me a little bit about you. When was it that you first used a computer, and when did you first start realizing you were into coding? Lalit Vijay: So, in fact the first time I got an opportunity to use my computer was in my school. I think I was in grade second or yeah, I was in grade second. Matt Stauffer: Okay. Lalit Vijay: At that time, we went to school, our teacher asked us to, this is computer? And at that time, we used to have that bulky computer system with bulky monitors and all that stuff. And, so from class two to class sixth, it was just a object of fascination where whenever you go there, you love it. Matt Stauffer: Yeah. Lalit Vijay: Alright, it's something cool and what I used to do at that time is only play one game called Dave, which I remember right now. So after that, my real interest started into the computers was after class seventh. Matt Stauffer: Okay. Lalit Vijay: I started learning things, I made friends of my school teachers and then I started skipping my lunch breaks and gained experience into the computer classes. Matt Stauffer: Very cool. Lalit Vijay: So, I used to sneak into, but there was just one challenge. 'Til that point time, I didn't have access to internet. It was computer without an internet. So the place where I live is one of the like remotest place in India. Matt Stauffer: Oh really? Lalit Vijay: Yeah, so my hometown is a place called Kordoma in Chakan. And it's like surrounded by 30 kilometer of forest all around the middle of the place. Matt Stauffer: Wow. Lalit Vijay: So, finding internet connection was a big challenge. But then I actually got in touch with one person who used to tution me, and tutor for my subjects. And he got in a job at the district center of the place and they had the internet connection there. The government there had this connection. And then I kind of ask him that can I spend an hour or something on that? That gave me access to good internet connection. But after his transfer from that place, I came back to the same point, no internet access. Matt Stauffer: Right. Lalit Vijay: And during 2008 and 2009 and thereabout really I grew kind of big, I got personally an internet connection where I was getting a 2KBPS, 3KBPS kind of speed. Matt Stauffer: You're kidding. Lalit Vijay: Yeah, and I started learning from that. Matt Stauffer: That's enough for like Telnet, and that's about it. What are you gonna do with that? Lalit Vijay: Yes, so at that point, I was like super happy that I have my own internet connection having 3 Kbps of internet. In fact, I remember one incident where I used it. I had taken screenshots of when this net speed was like 6 Kbps, like yay, I got 6 Kbps of internet speed. Matt Stauffer: Did you say 2008 or 2009 was when that was happening? Lalit Vijay: Yes, yes. Matt Stauffer: That's very recent for you to have almost no functional internet. Lalit Vijay: Right because that's a really remote place in India. Matt Stauffer: Yeah. Lalit Vijay: That point I then again try to make more friends with the government people. Matt Stauffer: Right. Lalit Vijay: Got a high speed internet connection again, spent a lot of time on YouTube, and then I started building website for freelancing. And that was for me, grade, I was in high school at that time. Matt Stauffer: Okay, how'd you learn? Lalit Vijay: YouTube. Matt Stauffer: Really? Like you'd just search on YouTube for how do I make a website and people add tutorials there? Lalit Vijay: Yes, yes, and so I'm self-learner. So from my education background I'm electronics and communication engineer. Right, but coding has always been kind of fascinating. It has always been actually easy, alright. So, that was easy to us to do, so we did this. And after high school, I moved to Delhi for my engineering. Matt Stauffer: Okay. Lalit Vijay: And there, then I experienced good internet connection. Now-- Matt Stauffer: So what year was this then? Lalit Vijay: Current net speed we have in our office is one Gbps connection, and at my home I have-- Matt Stauffer: Okay, I'm sorry, I was saying what year is it, but go ahead though, what do you have at home? Lalit Vijay: Okay so currently I have a 10Mbps connection at my home so that works fine enough to me. I moved to Delhi in year 2012. Matt Stauffer: 2012, okay go it. Lalit Vijay: Yes, so four year of slow internet connection, but after 2012 I did my engineering and during my final year, I started my first startup. We ran it for two years, then moved out of that startup. Now, after that I am working on StyleDotMe from 2016. Matt Stauffer: Okay, so what was the group of people who originally started StyleDotMe? How many of you and was there any funding, or was there just a couple friends started this? What'd that story look like? Lalit Vijay: Okay, so after my first startup got set down, I was complete kind of freeze where I was thinking what next in my life right. So, after starting a company you always try to like, try to find why things happen and whatever, and I met a really awesome girl called Meghna Saraogi. And this girl individually made a small seed funding ground with very little money. I can say you something like, you can say 25 lakh rupees. It's like 30 thousand dollars. With that small money, she came from a different city to Delhi with a prototype application on which she has raised a small ground up funding. The whole team gathered over here. Our current CTO is currently a student, right. He is finally an engineering student, but-- Matt Stauffer: Wait, your current CTO or your original? Lalit Vijay: Yes. Matt Stauffer: He's still a student? Lalit Vijay: Yeah, yes, so-- Matt Stauffer: Okay. Just had to make sure I heard that correctly. Lalit Vijay: Yeah so, he's the founding team member also and he's current CTO, and he started as basically as we all started, then we started giving tags to each other and he's now CTO and I'm handling the operations. So, that guy is like, was a very bright guy. Meghna was super passionate about the product and she lead the kind of vision to the company. Akil is like really the Android developer, and he sold his first company for $100K in 2016 when he was in high school. Matt Stauffer: Okay. Lalit Vijay: And then he started to build multiple applications, around 20, 30 applications and being featured in all the good magazines, and he's doing pretty good right now with us. And he's the kinda key person in building this augmented reality application on the IRIS. Matt Stauffer: Okay so, of your team, what's the breakdown of web application developers versus machine learning type folks versus whatever else? Lalit Vijay: Alright so, at web application we have just an admin panel and I handle that. Now we have added one more developer for that and the rest, Ahkil, Dhruv, and me and Avinash co-develop for the machine learning and the Python part, and Ahkil primarily take care of iOS. Matt Stauffer: Okay cool. So one of the things that I always do when I'm gonna be interviewing somebody is I ask everybody at Tighten, do you have any questions that you have for this person? And sometimes they say oh, I've always wanted to ask them this, and sometimes it's a little bit more, you know, oh I'm just curious about this in general. So, one of the questions that someone asked was: of the folks you know in India, especially in the area around you, who do Laravel, and obviously that's not a lot of your team, but to the folks from different conferences, is it more common for people to be employed full time, or is it more common for there to be freelancers? Is there a big freelance, 'cause we're noticing that that's something that we notice to be different depending on the country. So for example, in the U.S. there's very, very few Laravel freelancers, but we've found a lot in quite a few European countries. So what's like it like in India? And obviously it's gonna be different based on the city. Lalit Vijay: Yeah I think India is a very vast country, right? Matt Stauffer: Yep. Lalit Vijay: So it's pretty different in different places. If you talk about Zanzibar and all the tier two cities, you'll find only the kind of people who are employed working on that. If you find in Dehli or Bangalore, you will find some good amount of freelancers too. Matt Stauffer: Okay, yep, and that was kind of my expectation. It's a little bit like that in the U.S., but not as much as I would've expected. There's less and less freelancers around-- Lalit Vijay: Yeah definitely, it's a challenge, it's a challenge to find good freelancers. Matt Stauffer: And one of the reasons they were asking that is what does it look like when your startup needs to grow, and you can't find enough folks to work? Are you doing training for people? What's that like for you? Lalit Vijay: So currently what we do is we hire people who have at least a year or two year of experience, and then train them based on that basis. Matt Stauffer: Yep, on the job, yep. And the benefit is they get the training, and you get someone who knows the things you want them to know, and yeah, totally understand that. Alright, so one of the things we were curious about knowing was we talked a little bit about how you got into programming, but what was it that first got you into Laravel? Lalit Vijay: So I was doing a lot of freelancing work between my high school to third year of college. So from 2010 onwards to 2013. And during that time I was working with multiple people. And it was mostly working in PHP Code and CodeIgniter. And during that time I was just searching around, saw what's coming up and one day stumbled upon this Laravel. And I just checked it out, how is it. And the first class actually didn't took off, and when I came back, I think it was version 3.8 or nine I guess that I first just liked, And I tried my hand and I felt okay, CodeIgniter is fine enough, it works good for me now. And when I got my hand again on 4.2 it was like completely changed, and it was wow, wow. This is pretty nice. And then I started moving my projects on Laravel, and I build up multiple application for a few five star hotels, for at that time I was working with, it was Ramada and Radisson, yeah, so for them I was working. So I built a few application for their internal kitchen order management system, and that's how my initial Laravel experience, in terms of real development came across. And then with every new version started loving more, because every six month you had something interesting, something nice, and the whole community started. So with CodeIgniter and the code base what I was filling from, 2011 to '14, I feel like the community was going downhill. Every year it was slowing down, slowing down, and there's nothing new coming up in the whole PHP ecosystem. And with this growing Laravel community you felt that yep, again we are getting somewhere. And actually people are talking about things, they are selling stuff and they're building. They are not stuck with one version with the same base of code, and you don't know what next going to come, right? So that excitement took me over, and I completely ditched CodeIgniter, and then I used Laravel for my first startup from scratch. That was 2014, '15, and we built the complete front end and back end on Laravel. That worked out very well for us. And I think after 4.2 they were looking back in terms of it was getting better with everything. Whenever I miss something, mostly like it was going to come in next version. Matt Stauffer: That's cool. So one of the other questions I got that I thought was really interesting was, could you think of any ways that developing Laravel applications in India, specifically with Indian audiences, is different than it might be somewhere else? Is there anything you think that folks outside of India might not know about the context or the audiences? One of the things that someone specifically mentioned, I actually talked to Marcel Plizio, and he mentioned the fact that you had said that you have to think about scale a little bit earlier sometimes, because there's so many people. So that, and anything else, are there any other aspects of developing in India that you think that other folks might not be aware of? Lalit Vijay: So the one thing which people think is, since India is a really diverse place, and there is a lot of dialects, but still the major verbal development happens in English only, and you don't really need localization. I think in going few down years from here now we will be seeing a lot of localization within the Indian community. Because a lot of new people coming on the internet, and the rate of acceleration of growth of newcomers coming on for online consumptions is really, really getting big, it's booming. And with that I think more localization will come into the play. For right now mostly it's the English, and the scale is the one reason, because you hit 10,000 users in very soon. And then. If you have 10,000 users you really don't feel like you've got anything until it's like 100,000, right? So yeah, so I think the first time I felt that was we were doing a really small activity, and I wasn't expecting that how much traffic I will get. And my systems are down, that was completely on Laravel. And the moment I saw what was the reason is my data was site down because number of requests per seconds I was handling was too high. It was like 300 requests per second. And for the activity with one influence, having I think 50,000 followers or something, make everybody bogged up on at the same time, I wasn't expecting that kind of response. So yeah, in India that happens, that you can really hit the numbers really fast. Matt Stauffer: Interesting, yeah. So are there any things that you just think of on every new project that, you know, of the folks without that context, 10,000 sign ups might be a six month goal, or a year goal for some folks, and for you you say well, I might hit that super early. Do you say oh, well here's one thing I do on every project that other folks might not have to think about, or something like that? Lalit Vijay: So with us, we always set up the system with load balancer and all the basic coordinates installation pre-loaded. And with us it has always been the case where we do, and then we start doing some out-of-the-box marketing activity. And for that specific duration, our users sort of grow 10 times, 15 times from the normal use cases, right? And that those cases you really need to be aware. But in 80% of the cases the growth is linear on developments you're not doing. With us, what happened currently is we dealing with a lot of enterprises consumers, right? And so we are currently dealing with, out of top 10 brands we are working with top five. So the moment they start, they start very small, like on few retail stores, and when they grow, your growth is going to be get like 10X once the pilot is done. So you just need to make sure that after a month, or two month you are not going to get stuck because the expansion or number of applications are running simultaneously has grown 10X. Matt Stauffer: So what kinda tools do you use to be aware of when you need to scale? What are you using for monitoring? Lalit Vijay: Okay, so currently I use AWS CloudWatch a lot to drag down all that stuff. And over here, since we had everything is enterprise consumers, we do have really on understanding, right? Because with enterprises you need to do a lot of integration and all that stuff before going live, even after the pilots. So we do know kind of base growth now we are going to have, and that's the kind of benefit of being a SAS company with B2B clients. So you have more predictability in terms of what kind of users you're going to see. Matt Stauffer: Is CloudWatch enough to give you everything that you need? Like let's say you know it's gonna happen, but you don't know, well, X number of users, what kinda resources they need. Can you get all that at CloudWatch, are you using a Blackfire, a New Relic, or an Eyewitness or something like that? Lalit Vijay: So the fun fact about us is that for us, the end people who are going to use Laravel back end is very, very limited. Currently we are just with 50 enterprises consumers, right? But they control almost 30% of the whole market's pie, right? So you exactly know the number of consumers, and they are going to sign up. So on the back end part, where the main Laravel meat is working, is really not all that traffic insane. The part where we have unpredictable kind of users is the end-consumer application which is installed in the retail stores. That is completely not on Laravel at all, that's on Firebase. And the machine learning model is within the application only, right, which we train on separate with the application. Matt Stauffer: Oh okay, so is Firebase taking the majority of that? So well the machine learning, is that running on your own servers, or is that in something like Lambda? Lalit Vijay: No, so we train our model on our own systems, and once the model is generated we separate along with the application. Matt Stauffer: Oh, okay, that makes more. Oh, so when you say the application, you mean the actual iOS application has all that embedded. Lalit Vijay: Yes, yes, yes. Matt Stauffer: Okay, so the actual calls from the front end user-facing application to the back end primarily hit Firebase? Lalit Vijay: Yes. With the Firebase even, so since we are working with retailers with a lot of different places where internet reliability is not constant, right? So we work in a way where you have offline storage of everything. So from the last point of internet connectivity you have everything there, and the application will run perfectly fine for you. The moment we got connected with a proper internet connection, we just sync the latest data for them. So number of request we've finally made to our servers is very, very, we try to limit them, because we need to make sure that it runs offline perfectly. Matt Stauffer: What is the tech stack that you're using to generate your iOS, are you using Swift, or? Lalit Vijay: No, it's a Native-C, Objective-C. Matt Stauffer: Okay, got it, I guess that makes sense since you were talking about using C and C++ for your machine learning, okay. Off the top of your head, is there one piece of technology that you predict is just gonna get huge that you're really excited about? Lalit Vijay: AR, yep. Matt Stauffer: Okay, tell me more, I mean as your average developer thinks about that, what should they be prepared to be learning and thinkin' about? Lalit Vijay: So in front-end development, I think AR will change the way currently people are solving, right? And if you see all the big players across the globe are playing and trying things to do in the right way, right? And in India what we see is all these retailers, the reason even after being a very small company in number of head counts we call, and the kind of startup we are, the kind of companies we are working with is like the biggest brand of the country, right? And the reason of that is the kind of innovation we are bringing on the table. So currently the product we have is the only product in this world which can do real-time augmented reality for the jewelers, with such high precision. So a lot of time we find that our model works better than what currently SnapChat has. And we have filed patents for that now. Matt Stauffer: That's very cool. Lalit Vijay: Yeah, so the kind of effort we are putting in in terms of building the fine product for the end consumers, and the kind of response we are getting from the end consumer is really fabulous, right? So just now imagine, today you are sitting there and you have to buy something for you wife, right? And let's say you're giving a surprise to her. What you will do? You will go to a store and you will try to see, this might look good, right? But how are you going to try on her? What we do there is you just take her picture, and put item on her. Matt Stauffer: I was just gonna ask, can I just hold a picture up in front of the camera? Lalit Vijay: Yes, yes, yes, so you just hold up a picture of her and see her wearing the jewelry which you wanted to buy for her. And then you can decide it much better. And this stuff is gradually, I see in a big way, everybody's asking us please give us the web version, but we are not doing it because the kind of quality which we are getting on the web version is not up to the mark, the kind of quality we are developing on the iOS native application, right? So I see a lot of demand in terms of AR, and every sort of company, from Amazon, to this Tiffany, to this L'Oreal Paris, all kind of beauty, jewelry, all domains are using crazily. Matt Stauffer: That's really cool. Lalit Vijay: Yeah. Matt Stauffer: Did all the work that Apple did recently to improve AR in the most recent versions, did that really make a big difference in the possibility for it to be big in the future? Lalit Vijay: We were very excited about ARKit, that that might help us a lot by reducing our work. But it didn't help it that much. It still requires a lot of work right now. The kind of output is not for the enterprises grade right now. Matt Stauffer: Got it, so you think in a couple years it might be different, but right now, for someone to do something at your level, you still have to be doing most of the work on your own. Lalit Vijay: Yes, yes, yes. Matt Stauffer: Okay, yeah. Yeah, I've definitely had that same perception. Alright, let me look at a couple of these other questions, 'cause we're runnin' short on time and I wanna make sure I get everything. If you get a day free, and all the sudden there's no work, and for some reason you can't work, the internet's down at work, whatever, what are you gonna go do with your time? Your favorite thing to do. Lalit Vijay: Okay, so I spend a lot of time while traveling or anything is listening podcast, and reading books. And if not that, then most likely I do not get enough time to spend with my girlfriend, so I do that, yeah. Matt Stauffer: If you don't mind me asking, what would your favorite thing to do with her? If time and money were no constraint, what would you wanna do? Lalit Vijay: Just sitting in a silent place with a mountain with a nice view. Matt Stauffer: Okay, I like that, cool. What are your top five podcasts? Lalit Vijay: Currently, the one which I really love is one, since I'm kind of startup guy, I spend a lot of time on Master of Scales. The other one is Laravel Podcast. So Master of Scale is from Reid Hoffman. Matt Stauffer: Okay, I didn't know he had a podcast. Lalit Vijay: Yeah, yeah, and that's a really nice podcast, especially for the startups. The kind of insights we get is really nice. And now let me just stop into my podcast. Okay, and then this is really nice. You might have heard this, Reply All. Matt Stauffer: Oh yeah, yeah, yeah. Lalit Vijay: Yeah, yeah, I love that, then there is a podcast by a company called Intercom, they have a nice podcast. Matt Stauffer: Yeah, definitely. Lalit Vijay: And then there is called The Knowledge Project, yeah. Matt Stauffer: Okay, I don't know The Knowledge Project, I'll make sure these are all linked in the show notes to everybody. But I can't believe that I didn't know that Masters of Scale existed, I'm just reading through the site and it looks really fascinating. Lalit Vijay: Yeah, it's a really nice podcast. Matt Stauffer: Okay, I think I'm gonna ask you one last question before we're done for the day. And my last question is: is there any either entrepreneur or technological person, or any startup where you say that's who I wanna be like, those are the people I look up to. Whether it's a single human being who's an entrepreneur, or a single human being who's a technologist, or we're at this startup and you say they're doin' it right. I wanna look to them for how to learn how to do it right. Lalit Vijay: I think for me, the kind of two persons to me personally. I take half trait from one person, and half from another, and I really just get inspired by both of them. One is kind of Elon Musk in terms of kind of vision he sets for himself, and another one is Mark Zuckerberg. And for him, the reason for that person is kind of, he know how to be in the business. He know how to beat the competition state out of. You have seen SnapChat, right? Matt Stauffer: Yeah, yeah, no, I get that. Yeah, he definitely knows what he's doing. I've often said, people say well why are they spending that money that way? And I says well you know what, if you've got that much fake money, you know, that's just purely based on your valuation, go do things that are gonna turn into real money. And they made some good decisions there for sure. Okay, so if somebody is super interested in everything you told us about, obviously they're gonna go check out StyleDotMe.com. I'll link it in the show notes if anybody gets lost finding it like I did. But how can they follow you, how can they keep up with you, and is there anything else you wanna plug while we're on the podcast? Lalit Vijay: So for me, I personally love to be on Twitter only. I do not tweet much, but I mostly love seeing how competition do. And the reason I do not tweet much is I really spend really little time on social media, because currently we are in a kind of growth phase of the startup, and we are very, very focused on that, and that's currently like life to us. So a lot of time goes over there. Matt Stauffer: Yep. Lalit Vijay: The next thing, people can follow me LalitVijay on Twitter handle, it's simple, it's LalitVijay. And what I wanted to know is yeah, people do check out Laravel Live India. It's really nice growing community. And if possible, just visit it and give it a try. You will love it, and I'm sure for that. Matt Stauffer: Well that's awesome. Well Lalit, thank you so much for your time, it was a total pleasure gettin' to know you a little bit, and I really do hope that I'm gonna be able to come see you guys there one day. I hear such amazing things about it that I'm lookin' forward to being able to do it one day. And thank you so much for your time today. Lalit Vijay: Sure, thank you so, and I think I will try to get you next year on Laravel Live. Matt Stauffer: Alright, fingers crossed.
Kayak's new AR feature will tell you if your carry-on bag fits the overhead bin Popular travel app Kayak has put augmented reality to clever use with a new feature that lets you measure the size of your carry-on bag using just your smartphone. Its updated iOS app now takes advantage of Apple's ARKit technology to introduce a new Bag Measurement tool that will help you calculate your bag's size so you can find out if it fits in the overhead bin – you know, before your trip.
There was a lot of hype about VR ad then it seemed to go pretty quiet. So where are we right now? Bigscreen founder Darshan Shankar and a16z general partner Chris Dixon take the pulse on VR, AR, and mixed reality -- especially where it's going the next 24 months -- in this episode of the a16z Podcast. The conversation surveys some of the key platforms and devices -- from ARKit to the various headsets from various players -- to where we are in hardware, software, functionality, immersive experience, and perhaps most importantly, content. Are these destined to be just fun gadgets, or will they become new tools that demand continuous use and engagement? When will VR finally have its "iPhone moment"? The views expressed here are those of the individual AH Capital Management, L.L.C. (“a16z”) personnel quoted and are not the views of a16z or its affiliates. Certain information contained in here has been obtained from third-party sources, including from portfolio companies of funds managed by a16z. While taken from sources believed to be reliable, a16z has not independently verified such information and makes no representations about the enduring accuracy of the information or its appropriateness for a given situation. This content is provided for informational purposes only, and should not be relied upon as legal, business, investment, or tax advice. You should consult your own advisers as to those matters. References to any securities or digital assets are for illustrative purposes only, and do not constitute an investment recommendation or offer to provide investment advisory services. Furthermore, this content is not directed at nor intended for use by any investors or prospective investors, and may not under any circumstances be relied upon when making a decision to invest in any fund managed by a16z. (An offering to invest in an a16z fund will be made only by the private placement memorandum, subscription agreement, and other relevant documentation of any such fund and should be read in their entirety.) Any investments or portfolio companies mentioned, referred to, or described are not representative of all investments in vehicles managed by a16z, and there can be no assurance that the investments will be profitable or that other investments made in the future will have similar characteristics or results. A list of investments made by funds managed by Andreessen Horowitz (excluding investments and certain publicly traded cryptocurrencies/ digital assets for which the issuer has not provided permission for a16z to disclose publicly) is available at https://a16z.com/investments/. Charts and graphs provided within are for informational purposes solely and should not be relied upon when making any investment decision. Past performance is not indicative of future results. The content speaks only as of the date indicated. Any projections, estimates, forecasts, targets, prospects, and/or opinions expressed in these materials are subject to change without notice and may differ or be contrary to opinions expressed by others. Please see https://a16z.com/disclosures for additional important information.
This has been a crazy week for us between the release of iOS 11, new iPhones, AR Kit, and so … Continue reading "iOS 11, iPhone 8, and a Mega-Week of Game Releases – The TouchArcade Show #324"
Saludos a tod@s!!Que hacéis leyendo esto y sin actualizar a iOS11???? Ah!!! Que ya habéis actualizado?... Vaaaale... Jejeje. Con este audio os presento mis opiniones y experiencias con iOS11GM, Betas, version final y demás... Un poco de ARkit y un poco del explorador de archivos nuevo: la app "archivos".Espero que os guste.
This week was full of great news. Apple announced their new iPhone's which resulted in more details on ARKit such as a cool augmented reality game called The Machines. They also announced an Apple exclusive from thatgamecompany called "Sky." We also had the Nintendo Direct which revealed the name for Kirby as Kirby Star Allies. We also have Doom and Wolfenstein 2 coming to the Switch and more. In our games segment, we talk more on Destiny 2 such as strikes, adventures and more. We also get our hands on the upcoming Square Enix game, Project Octopath Traveler. It's a 2D-HD game with a unique art style. In our discussion, we talk about what happens when a game doesn't deliver for a franchise we so adore. Many franchises have done this to us such as Halo, Mass Effect, Assassin's Creed and more. How do we deal with this? How does it even happen? Show Notes: 01:22 - Project Octopath Traveler 07:58 - Destiny 2 22:05 - Gaming News 48:04 - Video Games that Hurt a Franchise 1:10:13 - Upcoming Video Game Releases The Inner Gamer is a podcast built for the casual gamer. Your weekly dose of video game news, reviews, opinions and discussions every Tuesday. Like what you hear? Share our podcast with your friends! Also be sure and subscribe to our podcast on iTunes and leave us a review! You can find all of our social channels at www.theinnergamer.net. If you have any questions or suggestions please reach out to us at hello@theinnergamer.net. CREDITS "Blue Groove Deluxe" by BlueFoxMusic on audiojungle.net Woman Announcer - Arie Guerra; Actress
In this episode of The PE Geek Podcast we explore the disruptive technology of Augmented Reality & how it differs from Virtual Reality which was explored in the previous episode. Throughout the episode, we explore the applications it has in today's PE classrooms & the implications it has for education in the years beyond. Resources mentioned in this episodeStarWalk & Pokemon GoAnatomy 4D, Virtuali-tee, AurasmaApples upcoming ARKit
There's something sort of cool in the next version of Apple's iOS. [It's call ARKit](https://developer.apple.com/arkit/—basically, it's a part of Apple's developer package to help programmers create awesome augmented reality apps. Like, maybe a program that adds dancing hotdogs to your screen so that they look like they are there in real life. Or better yet, something useful like an app that measures distances by just looking at stuff through your phone camera.
A Apple tem um histórico interessante sobre popularização de tecnologias. Ela nem sempre inventa os recursos, mas é conhecida por levá-los para a grande massa e fazer com que a roda gire. Hoje discutimos a possibilidade da revolução da Realidade Aumentada com o impulso desse poder da Apple. -> Interessado em ter uma estrutura para gravar o seu podcast? Mande um e-mail para podcast@loopstudio.tv! -> Sigam-me os bons! Twitter e Instagram: @marchwill -> Mande a sua história! podcastmarchwill@loopinfinito.net -> Made with ARKit: http://www.madewitharkit.com/ -> Convidado: Junior Nannetti http://www.twitter.com/juniornannetti
I am excited to share the great and varied conversation I had with David Brown. David is the Education Technology Integrator at St Mary's Anglican Girls' School located in Karrinyup in Perth Western Australia and is passionate about using technology to improve student learning. He has been at SMAGS since 2015 and his main role is to develop and assist staff in enhancing pedagogical teaching practices with the use of technology. He also teaches digital technology classes which is where he has been using Xcode and Swift since 2015. I would like to thank David for taking time out of his busy school, teaching, running, and blogging (I especially love the podcasting posts) activities to speak to me on the podcast. David's Site - https://superdavey.com Twitter: @superdavey - https://twitter.com/superdavey Show links St. Mary's Anglican School - http://www.stmarys.wa.edu.au/ Lego Mindstorms - https://en.wikipedia.org/wiki/Lego_Mindstorms Arduino - https://www.adafruit.com/category/17 Apple's AR Kit - https://developer.apple.com/arkit/ Ole Begemann - Playground: What's new in Swift 4 - https://oleb.net/blog/2017/05/whats-new-in-swift-4-playground/ Swift language - https://swift.org Swift Evolution - https://github.com/apple/swift-evolution Swift Unwrapped - https://spec.fm/podcasts/swift-unwrapped Swift Playgrounds - https://appsto.re/us/eHUj2.i Learn to Code 1 & 2 - https://itunes.apple.com/us/book/swift-playgrounds-learn-to/id1118578018?mt=11 Learn to Code 3 - https://itunes.apple.com/us/book/swift-playgrounds-learn-to/id1173709121?mt=11 Python - https://www.python.org/ Intro to App Development with Swift curriculum Teacher - https://itunes.apple.com/us/book/app-development-with-swift/id1118577558?mt=11 Student - https://itunes.apple.com/us/book/app-development-with-swift/id1118575552?mt=11 App Development with Swift Teacher - https://itunes.apple.com/us/book/app-development-with-swift/id1219118093?mt=11 Student - https://itunes.apple.com/us/book/app-development-with-swift/id1219117996?mt=11 Favorite Podcasts Accidental Tech Podcast - http://atp.fm Connected - https://www.relay.fm/connected Cortex - https://www.relay.fm/cortex The Talk Show - https://daringfireball.net/thetalkshow/ Hello Internet - http://www.hellointernet.fm/ Science Versus - https://gimletmedia.com/science-vs/ Join the Swift Teachers Slack Group - mailto:brian@swiftteacher.org You can find also find the show notes and other information on my blog: http://www.swiftteacher.org/podcast
Neste episódio o papo inclui a utilidade do Google Home, os riscos de instalar um beta do iOS, as novidades do ARKit do iOS 11, e a compra da Whole Foods.