Monday, June 10, 2024

PlatformCon 2024 Talk: Adobe's CI/CD Evolution: Rapid Adoption to Resilience and Scalability

Adobe's GitOps-based Flex CI/CD platform saw rapid adoption in 2023 leading to stability and scalability challenges. Learn how we're tackling these challenges and ensuring continued adoption. Released in 2022, Adobe Flex CI/CD gained momentum in early 2023. However, rapid adoption revealed challenges in Argo CD and core Kubernetes components, necessitating regulated adoption. Explore our efforts in collaboratively addressing scalability issues, stabilizing Argo CD (10k+ apps), and solidifying the Kubernetes stack for an imminent 5X scale. We'll discuss strategies for achieving widespread adoption, identifying and addressing obstacles alongside client teams, and prioritizing developer-friendly features. Lastly, we'll explore our approach to scaling support by harnessing AI capabilities to manage the escalating workload from client teams, fostering collaborative efforts in the process.

Watch the video below!

Sunday, June 11, 2023

PlatformCon 2023 Talk: Adobe's journey into building an Internal Developer Platform

Adobe began its Cloud-Native journey back in 2015 and has since then expanded to over 200 multi-tenant clusters deployed across multiple regions and geographies. We have an average of >3 million containers with over 200 production deployments each day. All this has been made possible with Adobe's Cloud Platform called Ethos which provides high resiliency, reliability, and robust CI/CD capabilities to Adobe product teams. We are now expanding this platform into an Adobe-wide Internal Developer Platform (IDP) that aims to provide a seamless experience incorporating service creation, deployment, and management to over 5000 developers. The IDP will integrate and provide key capabilities across security, infrastructure provisioning, monitoring, diagnostics and GitOps-based CI/CD tooling using Argo. Adobe is also going through a massive project of modernizing its K8s cluster fleet which will lead to greater resiliency and considerable cost savings each year. 

Watch the video below!

Sunday, January 15, 2023

Key Learnings from a GitOps Based Deployment Product Launch

I recently oversaw the launch of a new GitOps based deployment tool at my company. As a Product Manager working on internal developer tooling, a lot of the products I work on are not commercially available, so some of the learnings may or may not apply to commercial products. Having said that, one theme is constant which is that any Product Manager needs to build products that add value for users (developers in my case) and solve a set of key problems that they face. 

I recently shared about a workshop we conducted around the Adobe IDP, so this product launch provides a solution for two key IDP components which are namely Delivery/Deployment Management and Workflow Orchestration.

Below are some learnings I want to share from this product launch, and I hope some of these points will be applicable to any product launch. 

Focus on Users

  • Users typically have a status quo bias in the set of habits and technologies they use, and our product is no different. It's important to evaluate areas where user behavior may need to change in your current suite of products based on pain points users have shared with you. In our example, we are changing user behavior to move them towards a modern way of doing CI/CD using GitOps as opposed to leveraging a more traditional deployment philosophy.
  • Lighthouse period is golden, use it really well to understand client pain points, their success criteria and to improve your product.

Pre-Mortem Helps

  • Pre-mortems could really help you identify things that could go wrong a few months after launch. I first heard about pre-mortems from Shreyas Doshi where he shared it here. We conducted this session a few months product before launch. I repurposed the original template and created it in Miro, which is a tool we use at Adobe. See this template we used with examples.

Prepare GA Checklist

  • Support/on-call engineers need to be trained on the product well before going GA.
  • Have a GA production launch preparedness/checklist. This checklist should include things which are blockers to GA, which include various aspects around security, scalability and support readiness etc. 
  • Prepare a press release/blog post clearly outlining all product capabilities and communicating benefits it will provide to users and publish it during GA.

Establish Baseline for Success Early

  • Define and emphasize the criticality of KPIs to measure success of the product. If not already done, work with engineering to add tracking on all aspects of the product.
  • Prioritize product bootcamps and trainings. Build a community of power users who will be your advocates and will be willing to contribute features back into the product.
  • Build necessary conversion/migration tooling for users of existing tooling to move them over without causing friction. Remember to proactively communicate any maintenance mode decisions to incumbent users so that they are not left surprised.
  • Scalability and performance of the product are absolutely critical to the success.

Continue to Focus on Simplification

  • Continue to simplify user onboarding and make it a priority whether it's automating repetitive tasks, adding the right level of abstraction or removing friction for users via great documentation. First impression is everything!

Be Prepared to Make Tradeoffs

  • Be willing to pause new feature work temporarily in favor of addressing critical aspects such as scalability, security, support, training etc.
  • Keep a close eye on new feature requests that will enable new client adoption. Prioritize these features and set expectations with those clients accordingly.
  • Avoid building features that add tech debt and be prepared to retire unused features. Always aim to identify alternatives which provide users with the solution to their problem instead of asking engineering to build those features.

Listen to Users and Evaluate Other Offerings

  • Engage with clients continuously to understand their pain points and drive adoption. Listen more and speak less during these conversations.
  • Be willing to evaluate/learn from external offerings (free or paid). There may be a better solutions out there which you could either incorporate or learn from.

Hope these points will be helpful to you. Please share any other points I may have missed.

Monday, October 10, 2022

AdobeDevBlog: ArgoCon Community Learnings from the Adobe IDP Workshop

Adobe was a diamond sponsor of ArgoCon and we hosted a workshop on September 21, 2022, to brainstorm and formalize the definition and capabilities of an Internal Developer Platform (IDP) with the community’s feedback. In this workshop, which was in the spirit of community open discussion, we shared our IDP journey, and brainstormed with other community thought-leaders on making IDP a reality, based on Argo and other open-source projects. In preparation for the workshop, we had shared the following GitHub document where we outlined the key capabilities of an IDP and gathered the community’s thoughts and feedback.

Here is a visual we came up with to formalize key capabilities of an IDP and here's a link to the full blog post.

Tuesday, February 1, 2022

AdobeDevBlog: Building Enhanced Security into Our Container Platform

In this post, we dive deeper into the security controls within Ethos that help safeguard our Continuous Integration/Continuous Deployment (CI/CD) pipelines, which are used to help deploy microservices across the Adobe ecosystem during service creation, onboarding, provisioning, and deployment. Here's a link to the main blog post on Medium.

Friday, November 19, 2021

AdobeDevBlog: How Ethos Powers a Cloud-Native Transformation at Adobe

I recently moved into a product management role at Adobe. This is my first post as a PM published on Adobe's Medium Tech blog about Ethos (the team I work in). Ethos is a cloud-native and cloud-agnostic platform (and principles) that streamlines the development, operation, and consumption of cloud services inside Adobe. Here's a link to it and below is a high-level architecture of Ethos.

Friday, July 16, 2021

Adobe Experience Platform Query Service Video Demo

In this post, I want to share a demo I created working for the Adobe Experience Platform Query Service product team. The target audience are primarily pre-sales and account teams but anyone can use it get a general understanding of how Query Service connects with external tools. Below is what I worked on to create this demo:

  • Identified a common telecom sector customer churn use case
  • Ingested online/offline data into Adobe Experience Platform using AWS S3
  • Mapped the incoming data files to relevant schemas and datasets
  • Used SQL to combine those datasets into one common dataset using a CTAS query
  • Created a simple churn analysis dashboard using Tableau and connected it to Query Service using PostgreSQL. 
    • Here's a link to it. Please note that the dashboard will not populate (due to AEP access requirements) but you can look at the general structure and fields being used.

Adobe Experience Platform Query Service is a powerful serverless tool that allows brands to analyze online-to-offline customer journeys and understand omnichannel attribution. Query service also allows you to join any dataset in the AEP Data Lake and capture the query results as a new dataset for use in reporting, machine learning, or for ingestion into Real-time Customer Profile. It provides customers with a rich set of SQL-based analytic capabilities to provide rich insights on customer data collected from all channels and devices.

In addition, here are some other practical applications of Query Service aside from combining AEP datasets and connecting to external data visualization tools:

  • Leverage Query Service to take a back up of AEP datasets.
  • Run pathing analysis, attribution analysis and sessionize raw data using Adobe defined functions.
  • Create new calculated attributes using existing data like creating a new calculation for Customer Lifetime Value (CLV).

Below is the video which is uploaded on YouTube and a direct link to it.