{"type":"video","version":"1.0","html":"<iframe src=\"https://www.loom.com/embed/be997fb0256b45da8ddca40ee966a053\" frameborder=\"0\" width=\"1920\" height=\"1440\" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>","height":1440,"width":1920,"provider_name":"Loom","provider_url":"https://www.loom.com","thumbnail_height":1440,"thumbnail_width":1920,"thumbnail_url":"https://cdn.loom.com/sessions/thumbnails/be997fb0256b45da8ddca40ee966a053-1716544726235.gif","duration":5015.04,"title":"P&amp;E Townhall May 2024 - How we build products","description":"# How we build products\n####  Product & Engineering town hall\n\n/assets/randy-fath-ymf4_9Y9S_A-unsplash.jpg\nbackground: true\n\n\nWelcome to the first product and engineering town hall.\n\nAs Christine shared, we will do a monthly Product and engineering town hall.\n\nTwice a quarter the content of the town hall is created by you all. \n\nWe will have demos.\n\nTech talks\n\nLearnings from customers\n\nFun.\n\nIt's also a great, safe place to practice public speaking.\n\nOnce a quarter it will be leadership sharing insights and perspectives. This is today.\n\nToday, we will talk about how we build products.\n\nAnd specifically a change in how we build them.\n\nWe need to change how we decide what to build. \n\nWith very limited resources and a huge product context, we must focus on what matters.\n\nWe cannot spend a quarter on something that does not move the business, but we can also not only optimise what we have today. \n\nWe have to learn to balance between now and the future.\n\n\n---\n\n# Let's check in\nBefore we get going, we will do a check-in in brake out rooms of four pepole. See you back in 5 min.\n\n---\n## New concepts:\n\t- Tech Lead\n\t- Product team triad\n\t- Pitches and betting\n\t- Tracking success\n\nToday, I will introduce a handful of new concepts that will change how we work.\n\nA new role in engineering: Tech lead\n\nA new leadership structure in product teams called triads.\n\nA new process for how we talk about ideas and prioritise our efforts with clarity.\n\nAnd how we track success.\n\n---\n## Today will be crazy\n#### Sorry!\nI will share a lot of information today. I was planning to do this as an async Loom video, but the timing lined up to do it in the town hall.\n\nThis will not be the ongoing format for our Product and engineering town halls. They will be a lot more interactive than this massive download of information.\n\nI will talk for almost an hour, and that can be a big drain on our energy. \n\nI encourage you to use reactions and the chat as we go to keep up the energy \nand for me to know that you are still there.\n\nWe are also recording today so you can go back and re-watch, comment etc, on Loom.\n\nAll feedback is welcome!\n\n\n---\n## Questions as we go\n#### Go to Slido.com - enter the code: #3249108\n\nWe will use Slido. Please write questions as we go. In the end, I will do a Q&A with NK facilitated by Lars.\n\n\n---\n## The hardcore facts\nI want to start today by sharing a few hard facts.\n\nThey are facts that we have to change.\n\nAnd luckily, they are in our control.\n\nToday, we will take the first steps to change them.\n\n---\n## We are not growing like we should\n\n/assets/gabriel-tovar-93iTD1IH34I-unsplash (1).jpg\nbackground: true\n\nAs a business, we have hit a plateau.\n\nWe need to get off it.\n\nWe cannot stand still.\n\nWe grow roughly 2% per quater, that is barly okay, but not where we should be.\n\n---\n## Our commercial impact is too low\n\n/assets/kazuo-ota-kjWIILfGkOY-unsplash.jpg\n\n\nProduct and engineering represent roughly 43% of the company, measured in cost.\n\nWe also represent a huge part of our commercial success.\n\nWe are building what we are selling.\n\nBut the impact we have on building the growth of tomorrow is too low. \n\nWe need to reset our conversations to always focus on the commercial impact of the products we build.\n\nCommercial is delivering on tomorrow's growth, we are building next year's growth.\n\n---\n## We should have more developers\n\n\n\n/assets/brian-mcgowan-ggg_B1MeqQk-unsplash.jpg\n\n\n\nI often hear: \"we need more developers\"\n\nI can't agree more with you all.\n\nWe need more developers.\n\nPeriod. Full stop.\n\nBut as you learned in the last town hall, we don't have the economical engine to hire more developers right now.\n\nThe awesome thing is that we sit with the powers to make it happen.\n\nWe have a huge impact on how valuable and impactful our products will be on the business, \n\nand the better business, the bigger the budget \n\nThe more developers.\n\nThe less time we spend on products that we have already built that don't have an impact, \n\nthe more time we have to develop new products that can drive revenue later this year.\n\nThe less time we spend on building new products that turn out not to be impactful, \n\nthe faster we can increase our engineering headcount.\n\nI want us all to be extremely focused on our business impact.\n\nEvery time you see something and think, \"This is a bad use of our time,\" question it, challenge it, and bring it to us.\n\n\n---\n## Impact\n\n/assets/spacex-yJv97tE7GDM-unsplash.jpg\nbackground: true\n\nI believe the feeling of impact is the biggest motivational driver for a product team.\n\nWe all want to be impactful.\n\nI hear a lot of you say that you lack that feeling.\n\nIt's hard to know why we have prioritised what we have.\n\nIt's hard to ship due to complex products.\n\nIt's hard to manage stakeholders, and feedback comes too late.\n\nLet's change this.\n\nLet's have an impact together.\n\n---\n## ==What== is more important then ==how==.\nIt's strange to start a talk on process by stating that the process is not important.\n\nBut the truth is that we can't focus on what we build without changing how we build it.\n\nToday is the first step towards that.\n\n---\n## In our control\n\n/assets/jonathan-borba-ouCLfSjMRdE-unsplash.jpg\nbackground: true\n\n\nAll of the things I just mentioned are within our control to solve.\n\nWe have to take that control.\n\nWe have a massive impact on how fast we as a company grow.\n\nWe can create products with huge commercial impact next quarter, even bigger next year.\n\n---\n## I have done this before\n\nI have been a part of leading the implementation of everything I share today multiple times before\n\nI have even been consulting with other startups and worked directly with Ryan Singer multiple times providing feedback for the upcoming version 2 of shape up, \n\nand I am trained by Marty Cagan.\n\nThis is not just the implementation of something I have read in a book, it's a mixtape of learnings that I have collected over many years.\n\nThis is not to say that I know all the answers allready, but to share with you all that I have seen it succeed multiple times, and I strongly belive that we have the opportinity to move into a new gear.\n\nI also belive that we are in a stronger stating position then most of the companies I have helped in the past.\n\nIt is going to be challanging, but it's also going to be extreamly fun, both to learn, but also to work in a better way together.\n\nI am looking forward to doing this with you all.\n\n---\n## I will fail\n\n\n/assets/igor-omilaev-LdJLgZ0rrvA-unsplash.jpg\nbackground: true\n\n\n\nIt's a strange job to lead a team this size, to facilitate innovation, to drive change.\n\nAnd I will fail.\n\nI will make mistakes.\n\nI will let you down.\n\nNone of it will be due to ill fate. \n\nI want to succeed together with every one of you, but I am often wrong.\n\nI will give you one promise. \n\nI will listen when you think I am wrong. \n\nI can't promise that I will change my mind, but I will be open ears and take in your feedback.\n\nI invite you all to always reach out to me, NK or whoever on the team you wish to give feedback and talk openly and candidly. \n\nThis is how we improve.\n\nI expect it from you, and you can expect it from me.\n\n\n---\n## 5C's\nLets quickly touch on our values in connection to what I want to share today.\n\n---\n### Clear\n\tA clear what and why\n\nOur customers need to clearly understand what we do, and why we do it. \n\nNot only the first time they meet us but every time they touch our products.\n\nThat also means that each thing we build clearly needs to fit together with a tight narrative.\n\nWe also need to ensure that our products communicate all the complicated things they try to achieve in a way that is extremely clear to our users and customers.\n\nWe need to improve our marketing and positioning towards our dealer customers in a close relationship with the marketing team. \n\nToday, it's very hard to understand what we do without talking to a salesperson.\n\n---\n### Courageous\n\tWe need to dare reach for great.\n\nWe should have the guts to try big things, to change what we have today. \n\nWithout courage, we don't move forward.\n\nWe need to dare try things that likely will fail.\n\nWe need to have the courage to change how we work. That is what today is all about.\n\nWe also need to have the courage to have hard conversations about our products, about how we work, about how we each can improve. \n\n---\n### Curious\n\tWe need to talk to users and customers\nWe need to be extremely curious about our users and customers.\n\nOur curiosity for our users needs to be a part of our DNA.\n\nIt is core to our craft that we develop this curiosity even further.\n\n---\n### Committed\n\tAction!\n\nI am asking for one core commitment from all of you; this will not work without it.\n\nWe need to be committed to action.\n\nWithout action, we cannot change, \nwithout change, we cannot get off the plateau.\n\nToday I am starting a lot of action, and I hope you will join me.\n\n---\n### Compassion\n\tChanging together requires compassion and feedback\n\nWe are going through a lot of change right now.\n\nAnd that requires a lot of compassion.\n\nWe need open and honest conversations with each other.\n\nWe need to develop together.\n\nWe need to be open-minded and ready for change.\n\n---\n## Product team roles\n\n\n/assets/saksham-gangwar-YVgOh8w1R4s-unsplash.jpg\nbackground: true\n\n\nWe have to start by discussing what roles are in a product team.\n\nBut first, let's define a product team. \n\nIt's a team focused on building and maintaining customer-facing products, such as the consumer site, OEM products, and dealership products.\n\nWe also have pure engineering teams, which we call Platform teams. Today, that is DevOps and Data Engineering.\n\nToday will primarily be focused on Product Teams, but some roles and workflows will also cover the Platform Teams.\n\nWe also have a purely operational team, and I'm sorry, today, there will not be much input for you. \n\nHowever, please still take an active part, as the collaboration between your team and the product and platform teams is very important.\n\n\n---\n### No people managers\nOn a product team, there are no people managers, and the team structure is flat. \n\nAll people in management sit outside the team, so nobody will sit in the room with their boss when they need to be creative.\n\nWe have some teams where this can not be reality right now, and that is okay, but we will keep this in mind when we make changes over time.\n\nThe lack of managers does not mean that there are no leadership roles, \n\nthe PM is a natural leader of the team, but the leadership mandate is driven by their responsibilities, not by reporting lines.\n\nEqually, the tech lead, who I will come back to is not the manager of the developers on the team, \n\nthey are simply the ones leading the technology.\n\nSo, let's talk about individual roles.\n\n---\n### Product Manager\n\tManages the product, not the project\n\nThe product manager has to possess deep knowledge about a handful of core areas:\n\n- Our Customers and users\n- Our data\n- Our business model\nAnd\n- The market we are in\n\nIn the team, the PM is the representative of all four of those.\n\nWhen you, as a team, are deep in a discussion, the PM needs to bring the perspective of our users, what our data shows, and how it maps to our business and the market we are in.\n\nThey need to be extremely connected with all stakeholders across the company. \n\nThe PM needs to have good working relationships with all members of the SLT and individual team members across all departments.\n\nThe PM needs to understand what drives each stakeholder's goals and how your product can help them achieve their them.\n\nThe PM also needs to understand what the stakeholders see in the market and what customers the PM should connect with.\n\nThe PM is also responsible for product adoption.\n\nThe product manager is also the external spokesperson of the team in town halls, team meetings etc.\n\nLastly, the PM is also responsible for tracking the teams OKRs.\n\n---\n### Product Designer\nThe Product Designer's role overlaps very much with the Product Manager's, but they bring the craft of Design, research, prototyping and UX to the table.\n\nThey interact with users as much as PMs but less with stakeholders.\n\nAs a product designer, you represent the user, not only from a problem standpoint but also from a solution standpoint.\n\nYou work closely with engineers and the tech lead on developing the solutions and perfecting what we deliver.\n\n---\n### Engineers\nEngineers on the team are mainly focused on delivering the product.\n\nHowever, you will also be exposed to customers once in a while and invited to participate in discovery, shaping, and moving the product forward. \n\nYou are not required to participate every time, but you are expected to do so occasionally.\n\n---\n### Tech lead\n\tThey care as much about what they build as they care about how they build it.\nThe Tech Lead is a new role we are introducing today.\n\nWe don't have any tech leads yet, but we will find one for each product team over the next months.\n\nAs a tech lead, you are expected to have a deep interest and care for what we build, \n\nyou have a great product sense, \n\nyou are opinionated, and you consider working on the \"what\" outside your code editor a core part of your craft.\n\nYou will still code, but you will spend half of your time defining the what. \n\n---\n\tGet in front of real customers and watch them interact with your products\n\nAs a tech lead, you thrive with talking to people you don't know. \n\nYou are curious about what you can learn from interacting with users and customers. \n\nYou ask questions to drive clear learnings, and you walk away from these interactions energized.\n\nTalking to users is not seen as a chore but as the main source of inspiration for what we should build.\n\nMost of our innovation will be driven by tech leads.\n\nThey can apply their amazing technology understanding to problems they, together with the PM and designer, are exposed to.\n\n---\n#### Keep track of new technology\n\t\"Is there something that's possible today that solves a problem we've wanted to solve for a long time\" \n\t- Marty Cagan\nThe tech lead is responsible for keeping up with new technologies and working creatively on how we can apply them to business problems \n\nin a way that will drive commercial impact.\n\nThe business and our commercial success is as big a driver for you as the technology.\n\nThis is the epicentre of innovation.\n\n---\n\tProcess is never what's important. \n\nThe tech lead owns the delivery process, not the PM.\n\nYou can only have the bandwidth to own this if you believe in a minimalistic pragmatic process based on the empowerment of the team's engineers.\n\nThe tech leads responsibility is to untangle the team from the process to make sure each engineer can maximise their impact and deliver high quality.\n\nAt the same time, you find working and optimising the process interesting.\n\n---\n### The triad\n\tProduct Manager + \n\tProduct Designer + \n\tTech Lead\n\nI want to introduce a new concept, the triad.\n\nThe product team's triad is the leadership team in charge of leading the product. \n\nThe Product manager, designer, and tech lead form a team that works closely together every day.\n\nLater I will get more into some of the ways the triad work, but for now, you should just know that it consist of the PM, Designer and tech lead.\n\n\n---\n# Brake\nLet's take a 5 min brake before we go into what to build.\n\n---\n# How do we know what to build?\n\n/assets/Untitled.jpg\nbackground: true\n\nNow that we have set the right team, we can move on to the big question: How do we know what to build?\n\nThe truth is that we don't know, but we need to work hard to minimise our bad bets.\n\nWe need to find out that we are wrong as early as possible. \n\nWe will be wrong, and that is okay, but we need to do more work upfront to ensure that we are betting on the right things.\n\n\n---\n## Dual-track agile\nHistorically, we have focused on delivery, the part where we sit down and build. Delivery is very important, but as a company, we only generate value from our delivery efforts if we build the right things.\n\nDual track agile is a simple concept of running both discovery and delivery at the same time. \n\n\n---\n### But what is discovery?\n\n/assets/tittee-parichad-WYIeX_WUGDQ-unsplash.jpg\n\n\nDiscovery is the act of de-risking our bets. \n\nIt is a work track that goes on simultaneously while engineering builds in delivery.\n\nProduct managers, designers, tech leads, and some engineers will spend time shaping ideas, problems, and solutions and finding ways to evaluate their potential and fit with customers.\n\nDiscovery is where we talk to customers, run experiments, write pitches, and draw wireframes.\n\nIt is where we open up the solution space, where we challenge what we could build before forming our bets and getting ready to place them.\n\nIt's all the pre-work that we do to be able to sit down and say, \"This is the right bet for us.\"\n\nSome call it discovery, others call it \"Shaping\"\n\n---\n\n### Shape Up\n\tStop Running in Circles and Ship Work that Matters\n\n\n/assets/Clipboard_1.png\nsize: contain\n\n\nSome of you have already heard of Shape Up, a book by Ryan Singer and Basecamp.\n\nWe will not follow the book word by word, but there are quite a few elements that we will implement and mix with Dual Track Agile and our own learnings.\n\n\n---\n### Pitches\n\nThe Pitch is a core part of Shape Up\n\nA pitch is a document that outlines an opportunity we could bet on.\n\nA pitch describes:\n\n- The problem\n- Our appetite\n- The solution in a low-fidelity\n- What success looks like\n- Any rabbit holes\n- No-gos\n\n---\n#### The problem\n\n\n/assets/jackson-simmer-ZxRHtPacwUY-unsplash.jpg\nbackground: true\n\n\nThe problem outlines what problem a user, company, or customer is experiencing that we could solve. \n\nThe description is fairly short and to the point. \n\nOften backed up with user interviews and data, but sometimes purely described from our subjective experience.\n\n---\n#### Appetite\n\n\n/assets/alexandre-st-louis-6IUz4w_re8g-unsplash.jpg\nbackground: true\n\n\nIn my experience implementing Shape Up, the appetite is one of the most powerful concepts but also the hardest to understand.\n\nFirst, we must understand that Basecamp has a strict culture of being firm on deadlines but flexible on scope. \n\nWe need to build that same culture.\n\nSo when they talk about appetite, it's the investment we are willing to make into a bet. \n\nPutting it in boring business terms: How much money (our time) are we willing to spend on a potential upside? \n\nLet's say we could build a feature on the consumer site that would allow users to evaluate a trade-in offer they received from a dealer.  \n\nThe team writing the pitch would have to sit down and come up with an assumption on how valuable that would be for us to have and how many weeks of manpower they are willing to invest in it.\n\nAs you can see, this is not an estimation of the effort required to build the feature but an assumption of a cutoff point at which it would no longer make sense to invest in it.\n\nOf course, we need to evaluate whether it's realistic to deliver the solution within the appetite. \n\nIf not, it's easy peasy: We don't even have to work more on the pitch; we can archive it.\n\nAppetite is a concept that we will have to learn to work with and adapt to our own style, but when we do, it will guide many of our decisions.\n\n---\n### The solution\n\n\n/assets/ee_breadboard-f576c579fcb3f3865a3004c9e9e53fd0c97fa14e65a7b81af3ec6fbfe7b31832.png\nsize: contain\n\n\nIt's important to get the solution part of the pitch right; the most important thing is to hit the right fidelity. \n\nThis is not a high-resolution Figma design. \n\nIt's hardly a wireframe. \n\nRyan Singer has developed some great tools for expressing solutions in a way that makes it easy to understand the potential but doesn't dictate to the team how the final product should be. \n\nMost importantly, it is not expensive to develop and throw out.\n\nSome of the concepts are fat marker sketches and breadboards but are better described by Ryan directly, so I will not spend too much time here. \n\nThe balance to get right is to foster a shared understanding that can drive a debate without going deep into details.\n\nI encourage you to read chapter 4 of Shape Up, \"Finding Elements\". The chapter covers two great concepts: Breadboards and fat marker sketches.\n\n\n---\n#### What success looks like\n\t- Weekly evaluations\n\t- Clickouts to recommend better deals\n\t- Weekly signups from the flow\n\nWhat success looks like is a part of the pitch format I have added.\n\nBasecamp is running a different business than we are. We need to be more performance-oriented. \n\nHow does our SRP drive click-outs? \nHow many leads are generated by the test drive widgets, etc.?\n\nIn this section, the team will describe what success looks like in raw numbers and how we will track it.\n\nIn the example of the trade-in evaluation tool on the consumer site described before, success could be defined as:\n\n- Weekly evaluations\n- Clickouts to recommend better deals\n- Weekly signups from the flow\n\nThe success criteria depend heavily on the solution, so we should always ensure that we track them well and follow up on them after going live.\n\nThe success needs to be aligned with our OKRs.\n\nWe should also not be blinded by numbers only.\n\nOne of the biggest challenges for a modern product organisation is to balance product sense and data.\n\nIf we always lead by numbers, we can end up over-optimizing. \n\nIf we always lead by-product sense, we can build the wrong things.\n\nWe have to balance the two.\n\n\n---\n### Rabbit holes\n\n\n/assets/mounzer-8yk3kJoGJ7E-unsplash.jpg\nbackground: true\n\n\nRabbit holes are areas we already know have the potential to make the solution more complex, stuff that we need to navigate around to keep it simple and deliver within the appetite.\n\n\n---\n### No-gos\n\n\n/assets/tom-prejeant-eMTLooPQKPU-unsplash.jpg\nbackground: true\n\n\nNo-gos are ideas that we already know about, often great ideas, that we will not include in this pitch. \n\nIt's important to have conversations about the limitations of what we are building. \n\nI have often moved ideas back and forth between the solution and no-gos. \n\nThis is how we keep to our appetite, and become flexible on scope.\n\nThis is where we cut the fat.\n\n\n---\n### The superpower of a pitch\n\n/assets/tk-qJDkJRTedNw-unsplash.jpg\nbackground: true\n\n\nA superpower of a great pitch is the shared understanding across the company created by the pitch.\n\nThe pitch contains everything someone needs to understand what and why we are building a feature.\n\nThe pitch should be a living document that follows the new feature from its inception until it is live and we have evaluated the success criteria.\n\n\n---\n## Betting table\n/assets/carl-raw-7H7KVCihBvI-unsplash.jpg\nbackground: true\nThe Betting table is a meeting for each team before a cycle \n\nstarts. We review the pitches that the team brings forward and evaluate them against our OKRs and our vision. \n\nAt the meeting, we decide what pitches we should bet on.\n\nThe team must bring more pitches than we have time to build, so we don't stack the cards going into the meeting and make sure we have some hard decisions to make.\n\nAt the betting table sits the triad of the product team, Me, NK, and Johan.\n\nFor platform teams will be represented by the team lead.\n\nI am the final decision maker in the meeting, but in my experience, the decisions are clear and easy 95% of the time, and I don't need to drive them.\n\nThe betting table takes place a few days before a new cycle starts.\n\n---\n## OKRs and betting table\nOKRs guide what we should focus on. \n\nThey should not define what we build.\n\nIt's my responsibility at the betting table to make sure we bet on the things I think will have the biggest impact on the key results we are trying to move.\n\n---\n## Cycles\n\n/assets/abdullah-ahmad-uG4VizVyURs-unsplash.jpg\nbackground: true\n\n\nWe will stop doing two-week sprints and change to five-week cycles with one week of cooldown in between. This fits with our goal-setting rhythm of quarterly OKRs.\n\nWe will do this in both product and platform teams.\n\nTwo cycles to each quarter.\n\nWhy longer cycles?\n\nEach cycle or sprint has an overhead of planning. The smaller the cycle, the more planning. \n\nWhat is also true is that the smaller the cycle, the less autonomous the team can be.\n\n\n---\n## Cool-down\n\n/assets/scott-rodgerson-PteeDvACFak-unsplash.jpg\nbackground: true\n\n\nCool-down is a period where we have no planned work. \n\nIn our case, it will be one week right after each cycle.\n\nDuring this time, the triad is fully engaged in planning what to do in the next cycle together with leadership.\n\nEngineers spend the time on bugs, technical debt projects, learning new skills and exploring new ideas.\n\n\n---\n## Are we not solving bugs for five weeks?!\n\n/assets/evgeniy-prokofiev-pWBgujijtGI-unsplash.jpg\nbackground: true\n\n\nBugs that are discovered during a cycle are not default priorities right now.\n\nIf it's a severe bug, fix it.\n\nIf it's a bug you introduced as part of your current work, fix it.\n\nBut if it is an old non-severe bug, don't. \n\nRecord it and get back to your list of bugs doing cool-down.\n\nThe tech lead owns what bugs to fix and when to do so.\n\n---\n## Bi-weekly team check-ins\nEvery two weeks, we will have a check-in with each team, not only product teams.\n\nPresent at the check-ins will be:\n- Me\n- NK\n\nAnd for product teams, Joao will also join.\n\nThe triad will represent product teams, platform teams will only be represented by the team lead.\n\nThe agenda will be:\n\n- Check-in on OKRs and KPIs\n- Demo and status of what's in delivery\n- Run through of what's being shaped in discovery\n- Any team dynamic issues\n- and iterations on how we work.\n\nThe purpose of the meeting is to make sure feedback runs fast between leadership and the team, and that information sharing is not happening in the silo of 1:1s. \n\nIf the team feel the need, they can always invite for a check-in off schedule.\n\n---\n## Tracking success\n\n\n/assets/maxim-hopman-fiXLQXAhCfk-unsplash.jpg\nbackground: true\n\n\nAs I just mentioned, in the bi-weekly meeting, we will discuss metrics, OKRs, and KPIs.\n\n\n---\n### KPIs\n\tHow we know our engine is running\n\nWhat are KPIs?\n\nKPIs are your health score within your team's context. \n\nThey are the dashboard of numbers that you can briefly look at every day and know that everything is fine.\n\nA well-developed set of KPIs for a team gives the freedom to focus on driving a change elsewhere.\n\nFor the consumer team, KPIs could measure things like:\n\n- Click engagement\n- Bounce rate\n- Paid click conversion rate\n\nAnd lots more.\n\nKPIs will always have green, yellow, and red scores.\n\nIf green, do nothing.\n\nIf yellow, do a light investigation and keep an eye on it.\n\nIf the number is red, the team should stop everything they do (including cycle work) and focus on stabilising it.\n\nThe KPIs should always be available for everybody to see.\n\nTobias is leading the effort to develop KPIs across the company before Q3.\n\nEvery team will have to co-create a set of KPIs with NK and me, and all KPIs should be automated as they are not often changing.\n\nThis means that we have to pick up this work now.\n\n---\n### OKRs\n\tThe change we are focused on making\n\nOKRs are the change we are focused on driving right now. \n\nOKRs are a way of expressing the short-term strategy we are working on; they describe what success looks like when we have achieved it.\n\nWe will not achieve all OKRs, and that is fine.\n\nWe will have to change OKRs as we learn, and that is also fine.\n\nSome OKRs will run longer than a quarter, and some will run shorter.\n\nMost OKRs will have to be tracked manually. Do it every Monday and use the information to evaluate what needs to happen this week in the team to make sure we achieve the OKRs.\n\n---\n### Tracking productivity and innovation\nI don't believe that tracking productivity and innovation directly in a product and engineering team is viable.\n\nWe are doing creative work, we are not a factory.\n\nMeasuring lines of code written does not work,\n\nMeasuring time in front of a screen is just plain wrong.\n\nWe do know some of the actions needed to foster productivity and innovation. \n\nActions that are leading indicators for creating a space where productivity and innovation can happen.\n\nWe know that we all need to seek inspiration externally.\n\nWe know that getting in front of customers and talking to them is foundational to innovation.\n\nI don't want a big heavy process to measure this and try to achieve a utopia of perfect data.\n\nI am primarily interested in how we can do our best to create conditions for productivity and innovation.\n\nFor this we will lean on Culture Amp.\n\n\n---\n### Productivity\n\tCurrently: 89%\n\tGoal: 95%\n\n/assets/CleanShot 2024-05-09 at 09.01.22 2@2x.png\nsize: contain\n\nWe ask five questions about productivity. I am primarily interested in the feeling of productivity, but we will track productivity as an overall score.\n\nRight now, that score sits at 89%, that's really good! \n\nMy goal is to get above 95%.\n\nI also know that all the changes I am introducing today will have a short-term negative impact on our productivity as we have to learn something new.\n\nBut I believe we can get productivity even higher when we change how we work.\n\n---\n### Innovation\n\tCurrently: ==77%==\n\tGoal: 90%\n\n/assets/CleanShot 2024-05-09 at 09.06.15@2x.png\nsize: contain\n\nWe also track innovation in CultureAmp with two questions.\n\n\nOne question is focused on our ability to transfer new ideas into reality. Here, we are tracking at 85%, which is acceptable. \n\nI also hope that the journey of changes we start today will improve our skills at this.\n\nWhere we are not doing too well is in how often we spend time seeking inspiration and knowledge, here we only hit 70%.\n\nWe need to do better here. It's a huge part of our job.\n\n\n---\n### Share what you learn\n\t#team-product-and-engineering\n\nI encourage you all to share blog posts, books, podcasts, and YouTube videos in our team channel weekly.\n\nWhen you read something a co-worker shared, add your perspective or even just a reaction to the thread.\n\nThomas and Cristian are great at sharing exciting reads, commenting, and debating in Slack. \n\nI would love to see more of this from all of us.\n\n\n/assets/CleanShot 2024-05-09 at 09.28.25@2x.png\nsize: contain\n\nSeeking inspiration does not come without effort and hard priorities, please find the space need.\n\nI personally start every day reading an article or two, and when I stumble on an interesting read I save it for when I have time to read it.\n\n\n---\n### Talking to customers\n\tDealer team:\n\t\"Most weeks I participate in live conversations with consumers and dealerships\"\n\tCurrently: ?\n\tGoal: 90%\n\n\nI have already spoken quite a bit about the importance of talking to customers. As you can hear, this is close to my heart.\n\nWe will add a team-specific measurement in Culture Amp of customer interactions to all product and platform teams.\n\nFor the deal team the question will be: \n\n\"Most weeks I participate in live conversations with consumers and dealerships\".\n\nI will make sure to write a version of that question adopted to each teams customers.\n\nIn the consumer team, it's talking to consumers and our traffic customers.\n\nThe data team and DevOps is talking to internal customers in Autouncle.\n\nMy goal is to get this score above ==90%==.\n\nEverybody needs to participate in customer conversation, including me, NK, designers, managers, and engineers.\n\nYou don't need to be the one leading the conversation—it is totally fine to sit back and just take notes—but you need to be in the conversation, not just watch a recording.\n\nThis is not a requirement to do every day, but I expect you all to spend a minimum of 30 min every week on this.\n\nPMs, tech leads and designers, it's on your shoulders to ensure that this is possible, invite your team to listen in, make optional invitations and facilitate capturing everybody's thoughts after conversations.\n\nIt's not the first time I am introducing this in an organisation, and I know that it will not be easy, \n\nbut what I have seen before is that it will transform how we talk about what we build\n\nI also know that it will be a huge motivational driver,\n\nYou will experience the impact you have directly.\n\nI don't expect us to get to 90% straight away, my goal is to be there within a year.\n\n\n---\n### Engagement\n\tCurrently: 88%\n\tGoal: 90%\n\n\n/assets/Trend chart for AUTOUNCLE ApS . Check-in survey April 2024.png\nsize: contain\n\nThe three measures I just mentioned are our core metrics, but we don't want to over-index for them.\n\nTo counterbalance it, we will still track the overall engagement score and monitor each sub-category closely.\n\nThe goal for the engagement score is to get above 90%, we are almost there.\n\n---\n### We should not cheat ourselves\n\nI want to stress that the biggest weakness of leaning on CultureAmp data for tracking ourselves is the danger in self-reporting data.\n\nI sit here today and tell you that hitting a specific level on each parameter will require even more from us all in making a real check-in in CultureAmp.\n\nI have one wish: Rather score too low than too high! \n\nNone of us learn and get better if we don't have the right signals. \n\nThe score we end up with is my responsibility, it is not a measurement of your performance.\n\nThis is the feedback I need to navigate the changes with you all.\n\n\n---\n# Rome was not built in one day\n\n\n/assets/caleb-miller-0Bs3et8FYyg-unsplash.jpg\nbackground: true\n\nI don't believe that by me sharing all this information today will lead to us changing everything tomorrow.\n\nIt will take time for us all to develop a process that is both adopted and adapted to our needs and how we want to build.\n\nWhat I shared today is our starting point, not the last itteration. \n\n\n---\n### What happens next week?\n\t- Q3 company OKRs defined by SLT\n\t- First team check-ins\n\t- Start work on KPI dashboard\n\t- First customer conversations with a broader team presence\n\t- Information deck and inspiration shared\n\nNext week the SLT will define Q3 company OKRs.\n\nWith those as input we will have the first team check-ins where we also start to discuss what team OKRs should be for Q3.\n\nWe will also discuss the KPI dashboard and start to develop that.\n\nIn the teams, you must start connecting with customers if you don't already do it. Remember to invite your team members.\n\n---\n### What happens next month?\n\t- June: Pitch writing\n\t- June 24-27th: Betting tables\n\t- July 1th: First cycle starts\n\nIn June we will write the first pitches and give feedback on them. In the last week of june, we have the first betting tables.\n\nThe first cycles will always be rough, there is a lot for us to learn and we have to get used to a new process, this is both expected and fine.\n\n---\n### What happens in Q3?\n\t- Q3: Find tech leads for Consumer and Deal team\n\nDoing Q3 NK, Joao and I will work on selecting tech leads for the consumer and deal team. We will start by writing an in-depth description of the responsibilities and share that broadly.\n\n---\n### Recap\n\t- Tech Lead\n\t- Product team triad\n\t- Pitches and betting\n\t- Tracking success\n\nToday I have introduced a lot of new concepts.\n\nThe tech lead. The person who sits in the intersection between users and technology.\n\nProduct team triads - The three musketeers who are driving discovery in a product team.\n\nPitches and betting - how we are going to communicate ideas and decide what to prioritise.\n\nand lastly, how we track success, leaning on what we already have and adding the measurement of customer interactions.\n\nFrom here we will iterate together adapting all of this to what works for Autouncle.\n\nI can't wait to get my hands dirty together with you all.\n---\n# Book recommendations\n\n\tShape Up by Ryan Singer and Basecamp\n\tInspired by Marty Cagan\n\tTransformed by Marty Cagan\n\tContinuous Discovery Habits - Teresa Torres\n\tDeploy Empathy by Michele Hansen\n\tThe Mom Test by Rob Fitzpatrick\n\tEscaping the Build Trap by Melissa Perry\n\nNext week I will share more inspirations and input, but if you are already hungry for more here is a list of the best books on the topic that I have read.\n\nI think Shape Up is a must-read for us all, it's quick and easy.\n\nIf you have never participated in customer conversations before I would also encourage you to read The Mom Test or Deply Empathy.\n\n---\n# Q&A\n#### Go to Slido.com - enter the code: #3249108\n\n/assets/edwin-andrade-6liebVeAfrY-unsplash.jpg\nbackground: true\n\nLet's take a 5 min brake where you have time to add questions to slido, and then Lars will facilitate the Q&A."}