POPULARITY
Large language models (LLMs) pretrained on vast source code have achieved prominent progress in code intelligence. However, existing code LLMs have two main limitations in terms of architecture and pretraining tasks. First, they often adopt a specific architecture (encoder-only or decoder-only) or rely on a unified encoder-decoder network for different downstream tasks. The former paradigm is limited by inflexibility in applications while in the latter, the model is treated as a single system for all tasks, leading to suboptimal performance on a subset of tasks. Secondly, they often employ a limited set of pretraining objectives which might not be relevant to some downstream tasks and hence result in substantial performance degrade. To address these limitations, we propose ``CodeT5+'', a family of encoder-decoder LLMs for code in which component modules can be flexibly combined to suit a wide range of downstream code tasks. 2023: Yue Wang, Hung Le, Akhilesh Deepak Gotmare, Nghi D. Q. Bui, Junnan Li, Steven Hoi Ranked #1 on Code Search on CodeXGLUE - AdvTest https://arxiv.org/pdf/2305.07922v1.pdf
Application development has become very community driven and open source modules are commonplace to build fast powerful apps. However, there is a security risk when downloading others' code. This episode talks about a recent revelation of malicious packages in PyPI. Source - https://research.checkpoint.com/2022/cloudguard-spectral-detects-several-malicious-packages-on-pypi-the-official-software-repository-for-python-developers/ Be aware, be safe. Support the show and get access to behind the scenes content as a patron - https://www.patreon.com/SecurityInFive *** Support the podcast with a cup of coffee *** - Ko-Fi Security In Five Mighty Mackenzie - https://www.facebook.com/mightymackie Where you can find Security In Five - https://linktr.ee/binaryblogger Email - bblogger@protonmail.com
“Many people make open-source software because programming is like a creative thing, just like making music or something for most programmers who do in their spare time, not because they have some idealistic mission or something, it's just, I just want to put something out there, and I want people to see it, and I want to feel good about people liking it” - Adam Wathan Today Adam Wathan joins me to unpack the concept of open source software as a thing on the internet. What it means to publish open source, contribute to OSS projects, and what it looks like to manage a massively popular and fast-growing project such as TailwindCSS.Watch the video of this conversation on YouTube.In this conversation:Adam Wathan:Adam's company, Tailwind CSSAdam on Twitter: @adamwathanAdam's personal siteBrian Casel:Brian's company, ZipMessageBrian on Twitter: @casjamThanks to ZipMessageZipMessage (today's sponsor) is the video messaging tool that replaces live calls with asynchronous conversations. Use it for free or tune into the episode for an exclusive coupon for Open Threads listeners.Quotes:“Many people make open-source software because programming is like a creative thing, just like making music or something for most programmers who do in their spare time, not because they have some idealistic mission or something, it's just, I just want to put something out there, and I want people to see it, and I want to feel good about people liking it.” - Adam Wathan“But a lot of the time fixing something is a one-line fix, and you just kind of have to find where it is.” - Adam Wathan“The more popular a tool is, the more inexperienced people start using it. So the quality of issues and the quality of requests, actually like goes down as a tool gets more popular.” - Adam Wathan
Sejam bem-vindos ao milésimo quingentésimo octogésimo primeiro Spin de Notícias, o seu giro diário de informações científicas... em escala sub-atômica. E nesse Spin de Notícias falaremos sobre...Tecnologia! *Este episódio, assim como tantos outros projetos vindouros, só foi possível por conta do Patronato do SciCast. Se você quiser mais episódios assim, contribua conosco!*
Click here to register for my FREE Masterclass: https://autc.pro/TSSeng-pod?sl=POD-49013297
Hey Anonymous.fm listeners! Let me introduce you to an awesome guest, Jess! Jess and I got to know each other by a friend of ours who runs a community I belong to. As I was started to be interested in the work of DevRel, I got a chance to try out
Toby Wise is a postdoc at UCL and Caltech. He uses computational modelling and neuroimaging to study the mechanisms underlying anxiety and depression. I first encountered Toby when he and I published separate preprints on PsyArXiv on the same topic (risk perception for COVID-19) within a few hours of each other.In this conversation, we talk about doing research about COVID-19: why we decided to do it, practical considerations, and differences and similarities between our studies. We also talk about open science practices.BJKS Podcast is a podcast about neuroscience, psychology, and anything vaguely related, hosted by Benjamin James Kuper-Smith. New conversations every other Friday. You can find the podcast on all podcasting platforms (Apple/Google Podcasts, Spotify, etc.).Timestamps0:00:11: The origin of Toby's research project on risk perception about COVID-190:13:18: What Toby would do differently if he could go back in time0:20:45: Criticism of COVID-19 research0:29:17: How to do good science during natural experiments0:44:09: Open Code, (Jupyter/RMarkdown) Notebooks, and Python1:07:43: Comparing COVID responses across and within countries1:27:36: Practicalities of doing research on COVID-191:34:19: External validity of psychological research1:48:30: Toby's acute awareness of how unimportant his research is2:06:32: Simulations to ensure your study actually does what you want it to do2:14:34: Comparing Toby and Ben's COVID studiesToby's linksWebsite: https://tobywise.com/Twitter: https://twitter.com/toby_wiseGoogle Scholar: https://scholar.google.co.uk/citations?user=_PD-jwIAAAAJ&hl=enPodcast linksWebsite: https://bjks.buzzsprout.com/Twitter: https://twitter.com/BjksPodcastBen's linksWebsite: www.bjks.blog/Google Scholar: https://scholar.google.co.uk/citations?user=-nWNfvcAAAAJReferences/papers mentionedCamerer, C. F., Dreber, A., Holzmeister, F., Ho, T. H., Huber, J., Johannesson, M., ... & Altmejd, A. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour.Levitt, S. D., & List, J. A. (2007). What do laboratory experiments measuring social preferences reveal about the real world?. Journal of Economic perspectives.Korn, C. W., Sharot, T., Walter, H., Heekeren, H. R., & Dolan, R. J. (2014). Depression is related to an absence of optimistically biased belief updating about future life events. Psychological medicine.Kunz, L., Schröder, T. N., Lee, H., Montag, C., Lachmann, B., Sariyska, R., ... & Fell, J. (2015). Reduced grid-cell–like representations in adults at genetic risk for Alzheimer's disease. Science.Kuper-Smith, B. J., Doppelhofer, L. M., Oganian, Y., Rosenblau, G., & Korn, C. (2020). Optimistic beliefs about the personal impact of COVID-19. PsyArXiv.Shah, A. K., Mullainathan, S., & Shafir, E. (2012). Some consequences of having too little. Science.Shah, A. K., Mullainathan, S., & Shafir, E. (2019). An exercise in self-replication: Replicating Shah, Mullainathan, and Shafir (2012). Journal of Economic Psychology.Wise, T., Zbozinek, T. D., Michelini, G., Hagan, C. C., & Mobbs, D. (2020). Changes in risk perception and self-reported protective behaviour during the first week of the COVID-19 pandemic in the United States. Royal Society Open Science.
In this episode, we are talking about code and the benefits of making your code available in a peer review process and having it checked. Our guest is Dr. Stephen Eglen from the department of Applied Mathematics and Theoretical Physics at the University of Cambridge. Together with Dr. Daniel Nüst, from the University of Münster, he has created Codecheck – an open-science- initiative to facilitate the sharing of computer programs and results presented in scientific publications. The host of this episode is Erik Lieungh.
Qarib Kazmi and frequent contributor to Startup Magazine, Farah Samuels of Code For Pakistan sat down to talk about how the event went, its importance and what the future holds for CFP. For further details on Code for Pakistan’s civic […] The post Podcast – Open, Code for Pakistan, and Jazz present goals for SDGs appeared first on Startup Magazine.
We’re talking with Gina Helfrich the Communications Director for NumFOCUS about their story and history, the impact of open code on science, the difference between sponsored and affiliated projects, corporate backing, the back story of their education and events program PyData, and the struggles of storytelling and fundraising.
We’re talking with Gina Helfrich the Communications Director for NumFOCUS about their story and history, the impact of open code on science, the difference between sponsored and affiliated projects, corporate backing, the back story of their education and events program PyData, and the struggles of storytelling and fundraising.
This week we talked about “Open Science: What, Why, and How” from Spellman, Gilbert, and Corker. You can find the paper on OSF https://osf.io/gv6r4/ 0:14 Sophia is leaving Oxford :( (But the Podcast will continue) 0:48 This week’s focus: Open Science What Why and How; few in the JC read it but the discussion was awesome https://osf.io/gv6r4/ 2:15 Shoutout to Matt Jaquiery @MJaquiery 2:40 Broad Meaning of Open Science -- what do we mean; potentially misleading to include things beyond Open? 5:10 The Centre for Science that’s Actually Science 6:05 Focussing on Open Data as “open signalling” 7:30 What even is Open Data? Criteria for Open Data; How it can go wrong 10:25 Open vs Usable Data 11:10 FAIR Guidelines -- Findable Accessible Open Source Interoperable Reusable 12:20 (Advantages of) Open Code 15:30 Why is Open Science just Science Done Right? 16:00 Answer Sam: Open Code -- Show Your Working 17:00 Answer Amy: Work cumulatively in order to avoid waste of taxpayers’ money 18:20 Answer Sophia: being open about subjectivities; slightly tautological argument of Open Science just is Science 21:10 Better system for citing code! 23:20 Not sharing data? Is it selfish? 27:30 BREAK 29:00 Shoutout to Remi Gau; Amy will be singing for you 29:40 Amy and Sophia compete for supremacy in the Table 2 challenge - what are the problems and solutions at each stage of the research process? 31:10 Challenging Two Psychologists Four Beers to the Crossover Event 5 Psychologists 50 Shots 32:00 Competition Begins: 1. Research Planning 34:35 AMY IS THE QUEEN 35:00 Competition part 2. Data Collection and Methods Reporting 36:30 Sam has a picture of James Heathers next to his bed (aka. Amy and Sophia try to make Sam look like a creep) 37:45 Competition part 3. Data Analysis and Reporting 38:54 https://jasp-stats.org 39:25 Competition part 4. Publication Process 41:30 Open Peer Review -- Do you have any good or bad experiences of this? 42:40 Competition part 5. Storing and Archiving 44:10 Why do we give publishers the chance to adapt to openness, when we should just get rid of them? 49:55 Amy wins 14-10, but is also the kindest
How do you start implementing the Clear and Open code in your business and your life? In this final episode of a four-part series, we hear examples of how the Clear and Open Code can be applied in both a workplace setting or management situation and your personal relationships.
EMC: The Source Podcast Episode #16: Clouds, Code, Containers, Open Source, DevOps and EMC? Yes – and EMC! The EMC {code} movement has created a tremendous following in the open source community. Free Software, Free and Open Code and a development community, this isn’t your grandfather’s EMC. I spent some time at VMworld 2015 with Matt Cowger (@mcowger) before his breakout session: “Containers on VMware Infrastructure”, Containers on VMware? What does that mean? Find out this week on “EMC The Source”. Looking for more details? Check out www.emccode.com Don’t miss “EMC The Source” app in the App Store. Be sure to subscribe to The Source Podcast on iTunes or Stitcher Radio and visit the official blog at EMC The Source Blog EMC: The Source Podcast is hosted By Sam Marraccini (@SamMarraccini)
Tracklist: 01.V4Ns - No Way 02.Anthony Granata & Ted Ganung - Alchemical Rebirth (Duoscience Remix) 03.Etherwood - Souvenirs (feat. Zara Kershaw) 04.In-Deed - Overnight 05.Marcus Tee - Summer Rain 06.Motional - Nova 07.Msdos - Feel It In My Soul 08.Paul Sg - A Closer Look 09.Pierce Fulton - Kuaga (Lost Time) (S.P.Y Remix) 10.Legion & Logam - Afterthought 11.Reynar - Love and Happiness 12.Midnight Request & Spective Pixel - Sky Full of Stars 13.Radicall - Cosmopolis 14.Variants - The Story Ends 15.Jazzatron - Eugenio Credit 16.Dirt Bag - Out of Time 17.Planetary Secrets - Wormhole (Silence Groove Remix) 18.Toez - RocknRoll 19.Seba, Paradox & Robert Manos - Lie to Me 20.Open Code & Blue Motion - I Want To Fly
Ben Holmes, a web developer for the Oxford IT Services, talks about the relevance of Open Code for the University’s WebLearn platform, the Mobile Oxford App, and his own involvement in GitHub.
Researchers and Academics at Oxford share their experiences with sharing their data openly and the projects, collaborations and opportunities Open Data makes possible.
January 23 2013 - First Air Date