Anton McConville
Digital Designer & Developer
Kubecon North America

Writing this from San Diego, at the end of another intense KubeCon conference. I was here as part of IBM’s staff, to present a couple of sessions at the mini theatre, and to take a shift at the IBM booth, but when not taking my turn at the booth, I attended as many talks as I could. Here are my notes …

General themes - use of service ServiceMesh ( mostly Envoy from the talks I was able to attend ), economics of cloud services, and machine learning - both in terms of devops, and in terms of building ML on Kube.

Measuring and optimizing ML Workloads at Lyft

The first talk I attended, and I think the most inspiring one that I attended … definitely has me thinking about a lot of different things.

The essence of the session was about how at Lyft they’ve begun using Machine Learning to understand their infrastructure bill better. They build on AWS. Estimating, and justifying cloud usage fascinates me. From this talk I feel we’re still at the finding a way of accounting, and navigating the economics of cloud computing.

Themes that stood out to me - attribution schedules, allocation of resources, versus efficiency of use. Different workloads have different needs, at different times.

Aside from the content of the talk, the presenter was outstanding - although just a recent hire, his clarity of communication, and depth of understanding of this topic was super impressive.

How Spotify Migrated Ingress HTTP Systems to Envoy

There seemed a lot of talks about Envoy this conference. I’m personally still trying to understand the differences/similarities between Envoy and Istio

I loved hearing these insights from some of the companies that serve millions of users …

Spotify serve 8 million requests per second. Their system serves 79 markets, 248 million monthly users and is built on 1200 microservices - almost all on Google Cloud.

This was a well delivered talk that walked through the problems they were attempting to solve, why they chose Envoy to solve them.

Before switching to Envoy, they felt their old gateway Was

  • underinvested
  • had service discovery headaches
  • had high operational conversations

With Envoy …

  • a cloud native perimeter
  • vibrant community
  • service discovery

They implemented and moved in a way where product teams needed to understand as little as possible about the switch. They built gradually, with minimum disruption to their dev teams and end users. They facilitated a quick fallback in case of problems.

Moving from Legacy Infrastructure to the Cloud in a Government Organization - Chris Carty, City Of Ottawa

Happy coincidence for me that a senior engineer from my own city’s municipal government was presenting their story of evolution to the cloud.

He did our city proud, with his talk too - very well presented and organized story - a checklist of considerations for any government or any organization in moving from mainframe based solutions to kubernetes.

In Ottawa’s case the city employees 17,000 people, has 120 lines of business ad 400 apps to support ( Java, DotNET and Perl ). Some of the mainframes are end of life, and rather than renew them, they’ve begun migrating solutions to Microsoft Azure.

I recommend watching his talk, or asking for his slides - he has really beaten a path for others to follow if they’re embarking on a similar journey.

One point of interest for me, and I raised a laugh in asking, tongue in cheek … was what this means for me as a tax payer. I am curious about how they evaluate costs … so they are no longer paying for mainframes, but does that mean they work with the same budget for cloud resources? Have they modeled or estimated their use. Is this a net savings, or a net add? The presenter said they were not there yet - in estimating or projecting.

Flyte: Cloud Native Machine Learning & Data Processing Platform - Ketan Umare & Haytham AbuelFutuh, Lyft

I’d heard about Flyte and wanted a bit more insight.

Lyft wanted a way to build reliable, scaleable, reproducable models … especially when it came to reporting on business results internally every quarter. They had lost a key data scientist who had a lot of intellectual property on their own laptop, and had been the only data scientist using it at the time.

This talk was a walkthrough. I am super interested in machine learning, and really want to get into it, but have far too many interests, and now that I’m managing a team, still creating case studies, and still learning more about the cloud, I need to be selective about where I invest my time and how. I’m not sure Flyte is my entry point … I want to learn more about the basics of tensorflow and models. However, I think this is a good overview if yoy want to learn more check out the video when it is up.

How Yelp Moved Security From the App to the Mesh with Envoy and OPA - Daniel Popescu, Yelp & Ben Plotnick, Cruise

A really well presented talk about Yelp’s adoption of a service mesh to improve security of their apps. Really well presented :)

Takeaways - moving from a 15 year old monolith to microservices for authentication and authorization. Respecting developers who would consume Yelp through integrations - always considering the restful service pains they would need to suffer with any architectural decisions they made.

Again Yelp adopted Envoy in their solution for this. Although one of the engineers began the talk by wishing that Istio existed before they started their migration of services. I wanted to ask why he would have preferred that. Maybe I’ll send a message to him.

Things to look up from this talk: Open Policy Agent

Executive notes:

  • Security in service mesh makes Yelp services secure by default
  • Work incrementally ( same approach as talk above from Spotify )
  • Automate migrations
  • The use case is the north started

Security Beyond Buzzwords: How to Secure Kubernetes with Empathy? - Pushkar Joglekar, Visa

Another wonderful talk - I loved how well organized the presentation was. He based it around an acronym of security considerations - a threat model

Spoof Tamper Repudiation Information Disclosure DOS Elevation of Privileges

Where he explored what each of those meant for Kubernetes and encouraged an exploration of them as a graph.

I kind of want to follow this idea for GDPR.

Great talk.

Tutorial: From Notebook to Kubeflow Pipelines: An End-to-End Data Science Workflow

This was a very slick 90 minute tutorial from Google … the most impressive part for me was how well executed it was, in setting up Kube resources, installing Kubeflow, the data model etc.

It introduced a tool called Kale which attempts to simplify kubeflow pipelines.

It all worked well, I was able to get to the end of the tutorial - deploy a pipeline, work through the sample data … but it isn’t what I really want, which is to understand tensorflow and work from first principles with my own data.

I need to do that work myself. Otherwise - impressive tutorial and technology :)

Fine Grained Mesh Metrics for Better Visibility With Native Performance - Mandar Jog & Kuat Yessenov, Google

This session served to open my eyes to the idea of mesh metrics rather than educate me about a specific implementation - mostly because my brain was getting kind fried this late in the week, and after the kubeflow tutorial earlier in the day.

All in all, I feel inspired to learn more about mesh, build more examples with it, and personally to dig into tensorflow/kubeflow in 2020. I also have a swath of ideas about exploring the economics of cloud usage - have discussed with a colleague to collaborate with in 2020 too.

Adventure Of A Lifetime

It feels doubly lucky for me this month to fulfill a dream in traveling to Colombia, South America, AND sharing a passion project with the developer community there at JSConf Colombia, Medellín. I’m going to present some project work that visualizes the psychology of an artist’s lyrics, while experimenting with an emerging CSS and Javascript technology known as Houdini.

A couple of years ago I saw Coldplay perform live in New York. I was blown away by the concert so much, that I booked to see them again a few weeks later on the same tour. The combination of color, light and sound made the concert very different from any I’d been to before. Each person in the crowd had a gadget called a ‘Xyloband’ on their wrists that lit up and pulsated various colors and patterns in sync with the music. When scaled across 60,000 people in a dark stadium, it amplified emotions and felt intoxicating.

The concert inspired me to doodle Coldplay throughout their career, for each album, and explore their lyrical changes ( like I did with David Bowie’s lyrics a few years ago ).

I find it really interesting relating the psychology of the lyrics to life events of the artist, while also looking for clues as to why the music connects with me so much. It is fascinating to see the influence of life events in Coldplay’s music too.

This time I wanted to stretch myself, and find a fresh angle with my design. Coldplay shower confetti at certain points when they perform. I wondered if I could visualize data with confetti in some way.

This blog post is just a preview of some of the things I’ll be talking about at the JS Conf Colombia. I’ll save the details, and my github repo for attendees, before writing more about it.

My talk is made up of a few parts - lyric mining with Node and Watson, drawing with SVG and layout with Flexbox, exploring and integrating with CSS Houdini.

As a taster, for now I will share my basic confetti Houdini paint repo. I used this repo to figure out how to make a custom confetti css class. During my presentation, I’ll talk through how it works, and show how I use it in the project that I put together.

I look forward to sharing more on this soon :)

How I Became Vegan

My emerging journey to veganism began as a four year old boy, on a sunny summer day, running around the perimeter of a rented holiday cottage in Donegal, Ireland.

Turning a corner, I splashed into a puddle of red water, trickling towards a drain. My dad was hosing clean a gutted silver coloured fish, that he had caught earlier in the day. I haven’t eaten seafood since.

My stance on seafood was an enduring nuisance. Ireland is an island, where fresh fish and seafood from the surrounding waters of the Atlantic Ocean, and Irish Sea are part of the fabric of life. Back then we didn’t even have a supermarket chain in our town - we had an outdoor market - and fish was a big part of it - fish was a tradition on Fridays and fast days for my Irish Catholic family. So my parents were reminded of my feelings at least once a week. I am grateful to them that they accepted my feelings, when I was so little. Although my dad never stopped gently asking me about it. I think he may have felt guilty for what happened.

As a parent I can look back and admire my parents handling of this. They accepted it, and I think even saw the funny side of it. They never forced the issue, my mom didn’t have the internet to find interesting alternatives - I ate an egg and fries on Fridays, and loved it. Even as a child, I acknowledged it meant more work for my wonderful mom. Today, most of all I am grateful that they supported me, even as a four year old boy, with this quirky outlook, in troubled Northern Ireland.

In the UK during the 80s there was an outbreak of CJD, traced back to very questionable farming techniques where, in an effort to limit costs, and maximize animal growth, cows, who are naturally vegan themselves, were being fed derivatives of other cows. They were being turned, unknowingly into cannibals. This introduced mad cow disease to the animals, which then leapt into humans. I stopped eating beef because of this.

If I was truly compassionate as a 4 year old, I would have realized that fish are no different to any other animal. But it took more than 30 years for me to reach that conclusion. If I am honest, I didn’t become a vegetarian because of my feelings towards the animals. Ultimately it was through some health struggles of my own, that fresh plant based food helped me overcome.

Until this year, I continued to eat eggs and cheese. I really like cheese. Irish cheese especially is so rich and creamy. A tipping point for me was reading Sapiens by Yuval Noah Harari. In the book he explains how dairy cows are kept pregnant for most of the year, yet their own children are denied the milk they make for them, often in barbaric ways, and on a monumental scale. The calves themselves are held in crates and slaughtered for veal. This is pretty messed up. Egg farming has its own set of barbaric practices too.

So I am on a new adventure as a vegan. I have learned that at its extremes, veganism doesn’t stop at what you eat, but at what you wear, what you furnish your home with … what consumer choices you make in general. I have a long way to go, to give up on some of the things that I love … little things like my favorite aftershave is likely tested on animals.

In my next post, I’ll talk more about what I’m learning.