[QCon 2019] State of Serverless Computing

Chenggang Wu – Berkley

For other QCon blog posts, see QCon live blog table of contents

General

  • 2000 students in intro class at Berkley last year. Put them in concert hall
  • How make them more productive so can work on cheap machines like Chromebooks
  • Hosted infrastructure/cloud
  • Companies dedicated to making serverless easy

FaaS (Function as a Service)

  • Run code and pay for only what use
  • ex: AWS Lambda
  • Optimized for simplicity
  • Good at
    • embarassingly parallel tasks – video processing, translation
    • workflow orchestration
  • Limitations
    • Limited execution time – AWS increased from 1 minute to 5 minutes and then again to 15 minutes
    • No inbound network connection
    • IO is a bottleneck
    • Doesn’t support specialized hardware
    • Not designed for functional programming because real applications share state. Also, no natural way to chaining/composing functions. Using hacks to get around that introduces latency. AWS Step Functions even slower than hacking with S3 or Dynamo.

BaaS (Back End as a Service)

  • ex: AWS Athena
  • more specific

Storage

  • Want both autoscaling and low latency
  • In practice, improving one makes the other worse.
  • Autoscaling systems also provide poor consistency guarantees

Berkley’s work

  • Platform for serverless computing
  • working on supporting state
  • Anna – data store used in place of S3. Chenggang worked on for PHD
  • Fluent – FaaS over Anna. Working on new name since already a project named Fluent. Use Anna for both storage and communication reduces crossing network boundary.
  • Cache data to increase performance
  • Lattice – data structure that accepts incoming data. Preserves associate, community and idempotent properties.
  • Casual consistency – strongest consistency level that doesn’t require coordination

My impressions

Good end to the sessions for the day. The material was well laid out and easy to understand. The snails were cute when highlighting slowness! I like that most of it wasn’t specific to the research project at Berkley. The Berkley work was interesting, but less applicable.

[QCon 2019] Liberating Structures

Greg Myers from Capital One

For other QCon blog posts, see QCon live blog table of contents

General

  • Few meetings include engagement
  • Many tech managers consider meetings for their staff
  • Can help with white elephants – the things we don’t normally talk about
  • There are 33 defined liberating structures http://www.liberatingstructures.com
  • Retain more info because face to fact and involved
  • Planning poker is a diversity initiative. It’s about the discussion, not the #

Liberating Structure #1

  • Write down a worthy but elusive goal. Share with a neighbor.
  • Energy went up
  • Repeat with a new neighbor
  • Goal gets clearer with iteration
  • Liberating: permission to talk to someone don’t Know
  • Structured: rules, time constraints
  • Write on paper:: introverts can express self. Extroverts have time to think

Liberating Structure #2

  • Write down why hard to make progress on worthy but elusive goal
  • Troika Consulting
  • Explain problem. Ask clarifying questions
  • Turn around and listen as other two talk about problem
  • Shake hands at end and say thank you
  • Then let it go

Liberating Structure #3

  • 15% solution. What’s one thing you could do ow, totally within your control that would get you closer to your goal. We didn’t do this exercise so there was time for questions.

Liberating Structure #4

  • 1-2-4-all
  • Everyone writes a question
  • Partner to improve question
  • Merge groups (we ran out of time so didn’t get that far)
  • Asked partner who heard a good question and got some. Showed energy higher and more questions

Meeting Elements

  • Invitation – Common negative “invitations” are “listen to me” and “tell me what I want to hear”
  • How space is arranged – want to signal and reinforce activity
  • How participation is distributed – how invite. Want to belong and not just be tolerated
  • Sequence of steps and time allocation – think about what whole group needs

My impression

I like that he started with two liberating structures. I would have liked to experience more. I thought there was actually going to be a Q&A when he asked if we’d rather ask questions. That said, this session did motivate me to buy the book (because I have re time to read offline). It was a good session, but I wanted more!

[2019 QCon] Using Bets, Boards and Missions to inspire Org Wide Agility

Speaker: John Cuttler @johncutlefish

For other QCon blog posts, see QCon live blog table of contents

Goal: want to be a change agent and see what works. Want teams to see more impact i their work. Want to create nudges

General

  • People seem interested and want to try. Then there is fear and nothing happened. Then people give up.
  • Confusing own needs, continuous improvement and specific ideas
  • It’s hard for everyone.
  • Some companies are healthier than others. Range to get rid of a toxic employee is 12 months to forever
  • Companies thinking they want a magic tool or framework
  • Common Problems: Structural, culture/alignment, strategy, decision, making, revenue pressure, deal closing, feature factory, busyness high utilization, constraints
  • Angst is easy to trigger. People want certainty, impact and coherence.
  • Coherence != agreement. Coherence means understand.
  • Want flow of impactful stories
  • How know if in a feature factory: https://hackernoon.com/12-signs-youre-working-in-a-feature-factory-44a5b938d6a2

Key ideas

  • Product development is a beautiful mess
  • Efforts to simplify/standardize often backfire. If can reflect mess back, becomes a change agent. Mirrors are beautiful. Ad libs for bets: https://dazzling-allen-f0bcd2.netlify.com

Hacks

  • In response to a think doing. Say “oh, well that’s an interesting bet”. Starts conversation about risk and more. Bets can be of any size and risk
  • Work ranges n 1-3 hour/day/week/month/quarter/year/decade range. Make nesting of work more visible 1-3 year bets in PowerPoint so every one sees. Everything in month or less visible in Jira. In between not visible. See if developer can map their tasks to end result in less than 2 minutes.
  • Shift words.
    • Problems/Solutions -> Opportunities/Interventions
    • Projects -> Missions
    • Experiments > Bets
    • ”Done -> Decision point or review and measurement
    • Dependency wrangling > Playing Tetris
    • Debt -> Drag
  • Checklist of what need to know. Ok to not know as long as aware. Key is for list to be a one pager
  • A letter to the future
  • Make a map of work in progress when feels high.. Show impact and why it is terrible. Safe way to talk about anxiety
  • Use a board to show what’s next, what currently focusing on and what is in review. Also includes different levels (time frame) for bets. Board covers multiple teams
  • Weekly learning users – share learning that is consumed by others in last week
  • Broadcasted learnings chart/dashboard/notebook consumed by two people in a week
  • Consumption of learnings – total reach of broadcasted learnings

Q&A

  • What if org not ready? See if can do it on one project.
  • Social dynamics? First 5-10 minutes people think they will be measured and fail based on this. Showing what other companies does helps

My impression

I want a double green button to vote. This was great. It was interesting, relatable, actionable, easy to understand and can apply at many levels. So even if an org isn’t ready for all this, smaller parts can be done.