Podcasts about apache zookeeper

Send us a Text Message.How does the invisible architecture of the internet keep everything running smoothly? Prepare to have your mind blown as we unravel the mysteries of the Domain Name System (DNS) in this episode of Learn System Design. We'll guide you through the intricate process of how your browser finds the correct IP address for a domain name, likening DNS to an enormous, sophisticated key-value database. Discover the essential components that make DNS work seamlessly, from DNS servers and resource records to caching mechanisms. We break down the DNS hierarchy, explaining the pivotal roles of recursive resolvers, root name servers, and top-level domain servers.But that's not all—we're also diving deep into the world of service discovery patterns. Which is better: client-side or server-side discovery? We'll weigh the pros and cons of each, spotlighting real-world examples like Netflix's Eureka and AWS Elastic Load Balancer. Learn why a service registry is crucial for maintaining an updated list of services and how heartbeat checks fit into this ecosystem. Finally, we explore three popular service discovery methods—DNS-based, Apache Zookeeper, and sidecar services—giving you an in-depth look at their benefits and limitations. This episode is your ultimate guide to building robust and efficient systems, so tune in and elevate your system design knowledge!Learn more about the different types of DNS Records (Zone files)Support the Show.Dedicated to the memory of Crystal Rose.Email me at LearnSystemDesignPod@gmail.comJoin the free Discord Consider supporting us on PatreonSpecial thanks to Aimless Orbiter for the wonderful music.Please consider giving us a rating on ITunes or wherever you listen to new episodes.

Guillermo Rauch is the CEO of Vercel, a frontend-as-a-service product that was valued at $2.5b in 2021. Vercel serves customers like Uber, Notion and Zapier, and their React framework - Next.js - is used by over 500,000 developers and designers worldwide. Guillermo started his first company at age 11 in Buenos Aires and moved to San Francisco at age 18. In 2013, he sold his company Cloudup to Automattic (the company behind WordPress), and in 2015 he founded Vercel. — In today's episode we discuss: Guillermo's fascinating path into tech Learnings from building Cloudup and selling the company to Automattic (the company behind WordPress) Vercel's origin story and path to product market fit How to make an open source business successful Vercel's unique philosophy on developer experience Insights and predictions on the future of AI — Referenced: Algolia: https://www.algolia.com/ Apache Zookeeper: https://zookeeper.apache.org/ Apache Kafka: https://kafka.apache.org/ AWS: https://www.aws.training/ C++: https://www.techtarget.com/searchdatamanagement/definition/C Clerk: https://clerk-tech.com/ Cloudup: https://cloudup.com/ Commerce Cloud: https://www.salesforce.com/products/commerce/ Contentful: https://www.contentful.com/ Debian: https://www.debian.org/ Fintool: https://www.fintool.com/ Figma: https://www.figma.com/ GitLab: https://about.gitlab.com/ IRC: https://en.wikipedia.org/wiki/Internet_Relay_Chat KDE: https://kde.org/ Linux: https://en.wikipedia.org/wiki/Linux Mozilla: https://www.mozilla.org MooTools (UI library): https://mootools.net/ Next.js: https://nextjs.org/ React Native: https://reactnative.dev/ Red Hat: https://www.redhat.com/ Redpanda: https://redpanda.com/ Resend: https://resend.com/ Rust: https://www.rust-lang.org/ Salesforce: https://www.salesforce.com Servo: https://servo.org/ Shopify: https://www.shopify.com/ Socket.io: https://socket.io/ Symphony: https://symphony.com/ Trilio: https://trilio.io/ Twilio: https://www.twilio.com Vercel: https://vercel.com/ V0.dev: https://v0.dev/ — Where to find Guillermo: Twitter/x: https://twitter.com/rauchg LinkedIn: https://www.linkedin.com/in/rauchg/ Personal website: https://rauchg.com/ — Where to find Todd Jackson: Twitter: https://twitter.com/tjack LinkedIn: https://www.linkedin.com/in/toddj0 — Where to find First Round Capital: Website: https://firstround.com/ First Round Review: https://review.firstround.com/ Twitter: https://twitter.com/firstround Youtube: https://www.youtube.com/@FirstRoundCapital This podcast on all platforms: https://review.firstround.com/podcast — Timestamps: (02:35) Becoming an “internet celebrity” at age 11 (08:30) Guillermo's first company: Cloudup (11:09) Biggest learnings from Cloudup and WordPress (15:06) The insights behind starting Vercel (17:11) Sources of validation for Vercel (20:29) How Vercel formed its V1 product (23:25) Navigating the early reactions from competitors and users (25:58) The paradox of developers and how it impacted Next.js (31:20) Advice on finding product market fit (34:48) The forces behind a trend towards "Front-end Cloud” (38:35) Why people now pay so much attention to the front-end (40:06) How to make an open source business successful (44:54) Insights on product positioning and category creation (48:52) Vercel's journey through becoming multi-product (51:44) Guillermo's take on the future of AI (53:43) Heuristics for building better product experiences (55:49) AI insights from Vercel's customers (57:37) How AI might change engineering in the next 10-20 years (62:43) Guillermo's favorite advice (65:45) Guillermo's advice to himself of 10 years ago

What follows is the most important news for the week! Linux-y news! Retro computer news! Alternative OS news! You know… the stuff that matters!The Free Software Foundation is 37 years old!On October 4th, 1985, Richard Stallman founded the Free Software Foundation.Weird thought: On October 3rd, 1985, the Free Software Foundation didn't exist.After all these years, it's almost hard to imagine a world where the FSF wasn't around.A physical, retro-Hard-Drive sound simulator: HDD ClickerThis mad genius got tired of the silence of his flash based hard drives. He longed for the days when his bit, magnetic hard drives made all of those awesome “hard drive noises”.So he did something about it: He build a small device that made that noise when his flash drives are accessed..Check out the video demos he gives. Turn the sound up. Just lovely.I want four.Canonical launches Ubuntu Pro as free service for individualsCanonical is now offering an “Ubuntu Pro” service for individuals… for free.“Anyone can use Ubuntu Pro for free on up to 5 machines”And then, naturally, companies and big organizations will need to purchase a subscription plan for the Ubuntu Pro service. Makes sense. And, really, is a model I quite like: Businesses and Enterprise customers are helping fund the development and support… which directly benefits the individuals. Nice.The primary purpose of Ubuntu Pro looks to be “ten years” of security updates for the core OS plus “23,000” other packages:“Ubuntu Pro (currently in public beta) expands our famous ten-year security coverage to an additional 23,000 packages beyond the main operating system.Including Ansible, Apache Tomcat, Apache Zookeeper, Docker, Drupal, Nagios, Node.js, phpMyAdmin, Puppet, PowerDNS, Python 2, Redis, Rust, WordPress, and many more...”Honestly, this seems like the way to go for folks using Ubuntu. Better support, longer lifespan of updates in the repository… if I were running Ubuntu, I'd probably jump on that. Especially considering the fact that it's free. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit lunduke.substack.com/subscribe

Apache Kafka® 3.3 is released! With over two years of development, KIP-833 marks KRaft as production ready for new AK 3.3 clusters only. On behalf of the Kafka community, Danica Fine (Senior Developer Advocate, Confluent) shares highlights of this release, with KIPs from Kafka Core, Kafka Streams, and Kafka Connect. To reduce request overhead and simplify client-side code, KIP-709 extends the OffsetFetch API requests to accept multiple consumer group IDs. This update has three changes, including extending the wire protocol, response handling changes, and enhancing the AdminClient to use the new protocol. Log recovery is an important process that is triggered whenever a broker starts up after an unclean shutdown. And since there is no way to know the log recovery progress other than checking if the broker log is busy, KIP-831 adds metrics for the log recovery progress with `RemainingLogsToRecover` and `RemainingSegmentsToRecover`for each recovery thread. These metrics allow the admin to monitor the progress of the log recovery.Additionally, updates on Kafka Core also include KIP-841: Fenced replicas should not be allowed to join the ISR in KRaft. KIP-835: Monitor KRaft Controller Quorum Health. KIP-859: Add metadata log processing error-related metrics. KIP-834 for Kafka Streams added the ability to pause and resume topologies. This feature lets you reduce rescue usage when processing is not required or modifying the logic of Kafka Streams applications, or when responding to operational issues. While KIP-820 extends the KStream process with a new processor API. Previously, KIP-98 added support for exactly-once delivery guarantees with Kafka and its Java clients. In the AK 3.3 release, KIP-618 offers the Exactly-Once Semantics support to Confluent's source connectors. To accomplish this, a number of new connectors and worker-based configurations have been introduced, including `exactly.once.source.support`, `transaction.boundary`, and more. Image attribution: Apache ZooKeeper™: https://zookeeper.apache.org/ and Raft logo:  https://raft.github.io/  EPISODE LINKSSee release notes for Apache Kafka 3.3.0 and Apache Kafka 3.3.1 for the full list of changesRead the blog to learn moreDownload Apache Kafka 3.3 and get startedWatch the video version of this podcast

Was haben die Methoden der Feuerwehr zur Bekämpfung von Großschadensereignissen mit dem Incident Management von IT-Systemen gemeinsam? Diese Frage klären wir in der folgenden Episode. Wolfgang, als Mitglied der freiwilligen Feuerwehr, gibt einen Einblick in das Prozedere, wenn die Feuerwehr ausrückt. Andy vergleicht dies mit dem Incident Management von Cloud-Systemen. Wir klären wie man den Schaden eines Incidents misst, was dies mit dem Vertrauen von Kunden zu tun hat, wie ordentliche Prävention aussehen kann und warum es dafür wenig Ruhm gibt, was man unter War- und Peacetime versteht, wie ein moderner “Schreiberling” aussieht, wie dreist Presseleute sein können und was eine kleine Konferenz in Kalifornien damit zu tun hat.Bonus: Was Gartenschläuche und Stahl-Hochöfen damit zu tun haben und wieso Kaffee holen doch eine Strategie sein kann.Feedback an stehtisch@engineeringkiosk.dev oder via Twitter an https://twitter.com/EngKioskLinksDatenverlust bei 1.500 Snapshots von Hetzner Cloud: https://www.golem.de/news/trotz-redundanz-datenverlust-bei-1-500-snapshots-von-hetzner-cloud-2204-164628.htmlCeph Storage: https://ceph.io/Inside the Longest Atlassian Outage of All Time: https://newsletter.pragmaticengineer.com/p/scoop-atlassianAtlassian stoppt den Verkauf von On-Premise Lizenzen: https://www.atlassian.com/migration/assess/journey-to-cloudauditd: https://linux.die.net/man/8/auditdrsyslog: https://www.rsyslog.com/Incident.io: https://incident.io/5-Why-Methode: https://de.wikipedia.org/wiki/5-Why-MethodePostmortem “Roblox Return to Service 10/28-10/31 2021”: https://blog.roblox.com/2022/01/roblox-return-to-service-10-28-10-31-2021/Postmortem “The Discovery of Apache ZooKeeper's Poison Packet”: https://www.pagerduty.com/blog/the-discovery-of-apache-zookeepers-poison-packet/Postmortem “etcd: v3.5 data inconsistency”: https://github.com/etcd-io/etcd/blob/main/Documentation/postmortems/v3.5-data-inconsistency.mdPostmortem: “Gocardless: Incident review: API and Dashboard outage on 10 October 2017”: https://gocardless.com/blog/incident-review-api-and-dashboard-outage-on-10th-october/Postmortem: “Monzo,Outage, 29. July 2019”: https://monzo.com/blog/2019/09/08/why-monzo-wasnt-working-on-july-29thSammlung von verschiedenen Postmortems: https://github.com/danluu/post-mortemsOpsGenie: https://www.atlassian.com/de/software/opsgeniePagerDuty: https://www.pagerduty.com/Buch “Incident Management for Operations”: https://www.amazon.de/Incident-Management-Operations-Rob-Schnepp/dp/1491917628Sprungmarken(00:00:00) Intro(00:01:21) Wie viel Feuerwehr-Leute gibt es in Deutschland?(00:02:58) Was ist Incident Management im DevOps/Infrastruktur-Bereich(00:07:33) Firmen-Interne Incidents können ebenfalls richtig teuer werden(00:09:14) Wie wichtig ist Prävention und Monitoring?(00:10:26) Wie agiert ein Unternehmen bei einem IT-Incident? Chaotische Hilfe(00:12:33) Inwieweit kann ein IT-Incident mit einem Großschadensereignis verglichen werden?(00:14:14) Was ist ein Großschadensereignis?(00:15:57) Wie bekommen denn alle mit, dass ein Incident gerade eintritt? Und welche Strukturen sind notwendig?(00:17:43) Wer übernimmt die Rolle des (Incident) Commanders?(00:19:21) Was beinhaltet denn die Übernahme eines Incidents?(00:21:23) Vergleich von der Übernahme eines Incidents zwischen der Feuerwehr und einem IT-System(00:23:43) Strategie der Feuerwehr bei Incidents und Hierarchien(00:26:14) Ist der Einsatzleiter ein aktiver Teil des Incidents? Und welche Rollen gibt es noch?(00:30:09) Kommunikationsstrukturen in IT-Incidents(00:33:01) Der aktuelle Atlassian-Incident(00:34:44) Die Rollen von Logistik und Administration in der Feuerwehr und in der IT(00:37:16) (Essens)-Logistik bei Remote-Incidents(00:40:19) War-Rooms: Anti-Pattern oder Must-Have + Pro-Aktive Kommunikation(00:43:26) War- und Peace-Time(00:44:19) Incident Commander, Rollen und Rollen-Rotation im IT-Bereich(00:45:53) Die Rolle des Protokollführers / Schreiberlings(00:50:46) Post Mortems und Nachbesprechungen: Warum machen die Sinn?(00:54:21) Vorbereitungen, Prävention und Training in der Friedenszeit(00:57:51) Lernen aus Incidents und die Post Mortem-Struktur(01:00:09) Employer Branding mit Post Mortems(01:01:45) Happy-Path in Post Mortems(01:02:35) Nachbesprechung bei der Feuerwehr und Post Mortem Conferences(01:06:45) Web-Ops / Fire-Ops-Conference(01:09:40) OutroHostsWolfgang Gassler (https://twitter.com/schafele)Andy Grunwald (https://twitter.com/andygrunwald)Engineering Kiosk Podcast: Anfragen an stehtisch@engineeringkiosk.dev oder via Twitter an https://twitter.com/EngKiosk

Apache Kafka® 3.0 is out! To spotlight major enhancements in this release, Tim Berglund (Apache Kafka Developer Advocate) provides a summary of what's new in the Kafka 3.0 release from Krakow, Poland, including API changes and improvements to the early-access Kafka Raft (KRaft). KRaft is a built-in Kafka consensus mechanism that's replacing Apache ZooKeeper going forward. It is recommended to try out new KRaft features in a development environment, as KRaft is not advised for production yet. One of the major features in Kafka 3.0 is the efficiency for KRaft controllers and brokers to store, load, and replicate snapshots into a Kafka cluster for metadata topic partitioning. The Kafka controller is now responsible for generating a Kafka producer ID in both ZooKeeper and KRaft, easing the transition from ZooKeeper to KRaft on the Kafka 3.X version line. This update also moves us closer to the ZooKeeper-to-KRaft bridge release. Additionally, this release includes metadata improvements, exactly-once semantics, and KRaft reassignments. To enable a stronger record delivery guarantee, Kafka producers turn on by default idempotency, together with acknowledgment delivery by all the replicas. This release also comprises enhancements to Kafka Connect task restarts, Kafka Streams timestamp based synchronization and more flexible configuration options for MirrorMaker2 (MM2). The first version of MirrorMaker has been deprecated, and MirrorMaker2 will be the focus for future developments. Besides that, this release drops support for older message formats, V0 and V1, as well as initiates the removal of Java 8 and Scala 2.12 across all components in Apache Kafka. The universal Java 8 and Scala 2.12 deprecation is anticipated to complete in the future Apache Kafka 4.0 release.Apache Kafka 3.0 is a major release and step forward for the Apache Kafka project!EPISODE LINKSApache Kafka 3.0 release notes Read the blog to learn moreDownload Apache Kafka 3.0Watch the video version of this podcastJoin the Confluent Community Slack

Welcome to our 3nd episode. This is the second part of a two part series where we walk through a stateful distributed system. Join us as we take apart the famous Apache Kafka so as to look under the hood and understand more of the amazing engineering and computer science that has gone into building it. In this part we'll talk about Apache Zookeeper the best kept secret in a lot of open source distributed systems. We'll also touch upon clients, atomic broadcasts and things that can hurt availability. Hope you enjoy the ride as we walk the route taken by messages through Apache Kafka. Remember to subscribe for more interesting, deep tech conversations. Follow us on Twitter @dosco @strlen Links ZooKeeper: Wait-free coordination for Internet-scale systems ZooKeeper's atomic broadcast protocol: Theory and practice PacificA: Replication in Log-Based Distributed Storage Systems Bigtable: A Distributed Storage System for Structured Data The Chubby lock service for loosely-coupled distributed systems

In this messaging themed episode of AWS TechChat, Pete is back, and more so in person. They started the show reminiscing about messaging history, going back, looking at where we came from and how we arrived at the position we are today. More importantly, why do we use messaging and the benefits you can derive in decoupling your architecture. They then pivot to event streams, which cover both Amazon Kinesis and Amazon Managed Streaming for Apache Kafka, (Amazon MSK). They are both designed to process or analyze streaming data for specialized needs. Next, they moved to a more traditional message bus - Amazon Simple Queue Service (SQS) and Amazon MQ (Managed message broker service for ActiveMQ), both a durable pull-based messaging platform. Amazon SQS being lightweight and tightly integrated to the AWS Cloud platform and Amazon MQ supporting a variety of protocols making it a great choice for existing applications that use industry-standard protocols. Finally, they talked about push-based messaging with Amazon Simple Notification Service (SNS) and the Message Broker for AWS IoT. Both publish/subscribe (pub/sub) platform that enables you to build fan out architectures with hundreds of thousands to millions of subscribers. You now have more than a hammer to build your applications, Maslow would be proud. Speakers: Shane Baldacchino - Solutions Architect, ANZ, AWS Peter Stanski - Head of Solution Architecture, AWS Resources: Amazon CloudFront announces new Edge location in Shenzhen, China https://aws.amazon.com/about-aws/whats-new/2019/09/amazon-cloudfront-shenzhen-launch/ What is Pub/Sub Messaging? https://aws.amazon.com/pub-sub-messaging/ Amazon Kinesis Data Streams https://aws.amazon.com/kinesis/data-streams/ Amazon Managed Streaming for Apache Kafka (Amazon MSK) https://aws.amazon.com/msk/ Apache ZooKeeper https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-zookeeper.html Amazon Simple Queue Service https://aws.amazon.com/sqs/ Amazon Simple Queue Service Released https://aws.amazon.com/blogs/aws/amazon_simple_q/ Amazon MQ https://aws.amazon.com/amazon-mq/ Amazon Simple Notification Service https://aws.amazon.com/sns/ MQTT - AWS IoT https://docs.aws.amazon.com/iot/latest/developerguide/mqtt.html Message Broker for AWS IoT https://docs.aws.amazon.com/iot/latest/developerguide/iot-message-broker.html AWS Events: AWS re:Invent https://reinvent.awsevents.com/ AWSome Day Online Series https://aws.amazon.com/events/awsome-day/awsome-day-online/ AWS Modern Application Development Online Event https://aws.amazon.com/events/application/modern-app-development/ AWS Innovate on-demand https://aws.amazon.com/events/aws-innovate/

Distributed systems are complex to build and operate, and there are certain primitives that are common to a majority of them. Rather then re-implement the same capabilities every time, many projects build on top of Apache Zookeeper. In this episode Patrick Hunt explains how the Apache Zookeeper project was started, how it functions, and how it is used as a building block for other distributed systems. He also explains the operational considerations for running your own cluster, how it compares to more recent entrants such as Consul and EtcD, and what is in store for the future.

Camille Fournier is the head of Platform Engineering at Two Sigma, a financial company in New York City. Prior to joining Two Sigma she was the Chief Technology Officer of Rent the Runway, a transformative brand that offers unprecedented access to designer fashion, disrupting the way millions of women get dressed. She is an open source contributor and project committee member for both Apache ZooKeeper and the Dropwizard web framework. Prior to working for Rent the Runway, Camille served as a software engineer at Microsoft, and most recently, spent several years as a technical specialist at Goldman Sachs, creating distributed systems for managing risk analysis and firm-wide infrastructure. She has a BS in Computer Science from Carnegie Mellon University and an MS in Computer Science from the University of Wisconsin-Madison. Camille is a well-respected voice within the tech community, speaking on a variety of topics such as engineering leadership, distributed systems, scaling teams, and technical architecture. In 2017 she released her book, “The Manager’s Path: A Guide for Tech Leaders Navigating Growth and Change.” Contact Info: Twitter: @skamille Medium: https://medium.com/@skamille  Camille Talk: http://www.camilletalk.com/ Show Notes: Thanks for the Feedback: The Science and Art of Receiving Feedback Well Harvard Business Review Turn the Ship Around!: A True Story of Turning Followers into Leaders What Got You Here Won't Get You There: How Successful People Become Even More Successful The Effective Executive: The Definitive Guide to Getting the Right Things Done The Five Dysfunctions of a Team

KafkaApache Kafka Goes 1.0https://www.confluent.io/blog/apache-kafka-goes-1-0/Getting Started Analyzing Twitter Data in Apache Kafka through KSQLhttps://www.confluent.io/blog/using-ksql-to-analyse-query-and-transform-data-in-kafkaStories from the Front: Lessons Learned from Supporting Apache Kafkahttps://www.confluent.io/blog/stories-front-lessons-learned-supporting-apache-kafka/Apache ZooKeeper and Apache Kafka on Kubernetes StatefulSets & DaemonSetshttp://blog.kubernetes.io/2017/09/kubernetes-statefulsets-daemonsets.htmlIntro à Kubernetes http://blog.affini-tech.com/tag/kubernetes/index.htmlJavaJava 9 Release Now Available!https://blogs.oracle.com/java/java-9-release-now-availablehttps://www.oracle.com/java/java9-screencasts.htmlThe G1 GC in JDK 9https://www.youtube.com/watch?v=OhPGN2Av44E&feature=youtu.beNew Project: Z Garbage Collectorhttp://mail.openjdk.java.net/pipermail/announce/2017-October/000237.htmlGoogle Cloud PlatformExtending per second billing in Google Cloudhttps://cloudplatform.googleblog.com/2017/09/extending-per-second-billing-in-google.htmlAnnouncing Google Cloud IoT Core public beta https://cloudplatform.googleblog.com/2017/09/announcing-Cloud-IoT-Core-public-beta.htmlhttps://www.gcppodcast.com/post/episode-101-iot-core/Scheduling and sampling arrive for Google Cloud Dataprephttps://cloud.google.com/blog/big-data/2017/11/scheduling-and-sampling-arrive-for-google-cloud-dataprepCreating Custom Interactive Dashboards with Bokeh and BigQueryhttps://cloud.google.com/solutions/bokeh-and-bigquery-dashboardsGoogle Colaboratoryhttps://research.google.com/colaboratory/unregistered.htmlSparkDatabricks Delta: A Unified Data Management System for Real-time Big Datahttps://databricks.com/blog/2017/10/25/databricks-delta-a-unified-management-system-for-real-time-big-data.htmlTESTER DU CODE SPARK : 1- LA THÉORIEhttp://blog.xebia.fr/2017/01/06/tester-du-code-spark-1-la-theorie/TESTER DU CODE SPARK – 2 – LA PRATIQUEhttp://blog.xebia.fr/2017/09/19/tester-du-code-spark-2-la-pratique/Apache Spark : Utilisation des UDF et Curryinghttp://blog.affini-tech.com/apache-spark-utilisation-des-udf-et-currying/Lisez le blog D'affini-Techhttp://blog.affini-tech.com-------------------------------------------------------------http://www.bigdatahebdo.com https://twitter.com/bigdatahebdoVincent : https://twitter.com/vhe74Alexander : https://twitter.com/alexanderdeja Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )On recrute ! venez cruncher de la data avec nous ! écrivez nous à recrutement@affini-tech.com

KafkaApache Kafka Goes 1.0https://www.confluent.io/blog/apache-kafka-goes-1-0/Getting Started Analyzing Twitter Data in Apache Kafka through KSQLhttps://www.confluent.io/blog/using-ksql-to-analyse-query-and-transform-data-in-kafkaStories from the Front: Lessons Learned from Supporting Apache Kafkahttps://www.confluent.io/blog/stories-front-lessons-learned-supporting-apache-kafka/Apache ZooKeeper and Apache Kafka on Kubernetes StatefulSets & DaemonSetshttp://blog.kubernetes.io/2017/09/kubernetes-statefulsets-daemonsets.htmlIntro à Kubernetes http://blog.affini-tech.com/tag/kubernetes/index.htmlJavaJava 9 Release Now Available!https://blogs.oracle.com/java/java-9-release-now-availablehttps://www.oracle.com/java/java9-screencasts.htmlThe G1 GC in JDK 9https://www.youtube.com/watch?v=OhPGN2Av44E&feature=youtu.beNew Project: Z Garbage Collectorhttp://mail.openjdk.java.net/pipermail/announce/2017-October/000237.htmlGoogle Cloud PlatformExtending per second billing in Google Cloudhttps://cloudplatform.googleblog.com/2017/09/extending-per-second-billing-in-google.htmlAnnouncing Google Cloud IoT Core public beta https://cloudplatform.googleblog.com/2017/09/announcing-Cloud-IoT-Core-public-beta.htmlhttps://www.gcppodcast.com/post/episode-101-iot-core/Scheduling and sampling arrive for Google Cloud Dataprephttps://cloud.google.com/blog/big-data/2017/11/scheduling-and-sampling-arrive-for-google-cloud-dataprepCreating Custom Interactive Dashboards with Bokeh and BigQueryhttps://cloud.google.com/solutions/bokeh-and-bigquery-dashboardsGoogle Colaboratoryhttps://research.google.com/colaboratory/unregistered.htmlSparkDatabricks Delta: A Unified Data Management System for Real-time Big Datahttps://databricks.com/blog/2017/10/25/databricks-delta-a-unified-management-system-for-real-time-big-data.htmlTESTER DU CODE SPARK : 1- LA THÉORIEhttp://blog.xebia.fr/2017/01/06/tester-du-code-spark-1-la-theorie/TESTER DU CODE SPARK – 2 – LA PRATIQUEhttp://blog.xebia.fr/2017/09/19/tester-du-code-spark-2-la-pratique/Apache Spark : Utilisation des UDF et Curryinghttp://blog.affini-tech.com/apache-spark-utilisation-des-udf-et-currying/Lisez le blog D'affini-Techhttp://blog.affini-tech.com-------------------------------------------------------------http://www.bigdatahebdo.com https://twitter.com/bigdatahebdoVincent : https://twitter.com/vhe74Alexander : https://twitter.com/alexanderdeja Cette publication est sponsorisée par Affini-Tech ( http://affini-tech.com https://twitter.com/affinitech )On recrute ! venez cruncher de la data avec nous ! écrivez nous à recrutement@affini-tech.com

Stefan Tilkov talks to Camille Fournier about the challenges developers face when building distributed systems. Topics include the definition of a distributed system, whether developers can avoid building them at all, and what changes occur once they choose to. They also talk about the role distributed consensus tools such as Apache Zookeeper play, and whether […]

Flavio Junqueira is the author of Zookeeper: Distributed Process Coordination. Flavio and Jeff Meyerson begin by defining ZooKeeper and talking about what ZooKeeper is and isn’t. ZooKeeper can be thought of as a patch against certain fallacies of distributed computing: that the network is secure, has zero latency, has infinite bandwidth, and so on. With […]

Apache Zookeeper, Distributed Systems, Open Source and more with Camille Fournier