Skip to content
Assert Digital Ventures
  • About
  • Publications & Media
  • Newsletter
  • Blog

Working on tech skills as a PM

  • October 27, 2022October 27, 2022
  • by Andy

One question I’m often asked by PMs (or aspiring PMs) is how they can go deeper into the tech/engineering side if they don’t have that background. I generally don’t encourage PMs to take an “8 week coding” class to do that as it only teaches you basic engineering skills (e.g. how to write a for loop) you’re unlikely to use.

What’s most important is understanding how systems are designed (architecture) and how to talk to engineers about whether their designs support your product objectives. Unfortunately, there’s no book on this but I recently talked to the founder of a company called Skiplevel who targets this exact need.

She was an engineer at a large tech firm who often was tasked with upskilling non-tech PMs on tech and decided to spin it out into a company (what a great way to find a niche segment/problem and experiment before committing). It might be of interest for some of you and she’s offering a discount if you’re interested:

Is Skiplevel right for me?
Use discount code: ABNYU100 for $100 off (expires 11/30/22)

NOTE: this is not an ad and I’m not compensated in any way for this. Just a recommendation I thought interesting.

“Product Waste”

  • May 25, 2022May 25, 2022
  • by Andy

Good article from Rich Mironov on “product waste” where he compares why building the wrong thing is more expensive and a better place to put attention to versus, say, “engineering waste” (e.g. inefficiency in the build process). I like his comparison to old line, 20th century management thinking that digital product development is like a production line: build what the go-to-market team identifies as quickly and cheaply as possible. We all know that doesn’t work here.

Why 3rd party research should not be a primary…

  • June 13, 2021June 13, 2021
  • by Andy

One mistake I find product managers often make is overuse or over weighting of third party research findings. While 3rd party research has its utility, it a) rarely asks the specific questions about what people need and b) looks backwards when you’re trying to find proxies for the future. Let’s look at an example.

https://flowingdata.com/2021/06/08/seeing-how-much-we-ate-over-the-years

This recent infographic shows changes in food consumption behavior since 1970. There are several interesting insights including how chicken is now the most dominant protein (was beef) and leaf lettuce was non-existent as a concept in 1970. Diving deeper into the vegetable chart, one can see several other interesting changes. If you were a food products company (anywhere in the value chain) thinking about new products or even where capex spend might be applied, this chart might be a tempting input (let’s assume we trust the data source and veracity of the research).

However, while trend lines can be drawn (esp with the underlying data), this chart does not begin to answer “why” these changes have occurred. We could sit around a table and speculate about them: leaf lettuce was not transportable to market in 1970; recent health trends have people eating more salad; potatoes, while still popular, have historically been consumed in fried fashion which is not part of a modern, health conscious diet…and many more. Some of these might be spot on, some wild guesses. However, until we talk to customers about their eating trends (esp those who are older and have a longer history), we cannot accurately create the narrative this data shows, let alone create testable hypotheses as to how predictive these trends our for our new food product.

Data can point to problems or opportunities, qualitative research is how we start the search for solutions (predicting the future) through iterative experimentation.

MBAs “Sprint” to Solutions for The Wall Street Journal…

  • April 28, 2021April 28, 2021
  • by Andy

One of the product management class offerings at NYU Stern we’re experimenting with. Really enjoyed this class and thanks to Lauren Acquista and Helen Hewitt for the amazing support.

The class went even better than expected and the students learned not only about the design sprint approach, but also went much deeper in finding insights than most other consulting type projects would. We pushed them and they delivered things even the clients weren’t expecting (including some direction to completely change where a product was heading).

https://www.stern.nyu.edu/experience-stern/news-events/mbas-sprint-solutions-wall-street-journal-and-rocket-mortgage-with-innovative-new-tech-solutions

NYU Stern launches Tech Product Management specialization

  • September 2, 2020September 2, 2020
  • by Andy

I’m pleased to announce that our Tech Product Management specialization as part of Stern’s MBA program is now officially launched. This program builds on Stern’s roots in strategy, technology and marketing to be, what we believe, is the first MBA program of its kind in the country. Students go deep on product management techniques and real world scenarios as well as tap into the deep well of digital coursework already offered at Stern. Our graduates are well prepared to use user-centric, iterative PM techniques whether in a tech firm or a more traditional industry transition to the tech model.

https://www.stern.nyu.edu/portal-partners/academic-affairs-advising/specializations/tech-product-management-specialization

What comes after Zoom?

  • June 29, 2020June 29, 2020
  • by Andy

That’s not the most interesting question here but “why” people are in video and why they do what they do. When I teach about product, I always tell my students to ask the deeper why — some refer to it as the “5 whys” — to get to the core of why someone does and decides what they do. That’s the interesting question here.

The easiest one is “why do we have mute”? Shouldn’t it sense that I’m not talking and auto-block background noise (admittedly, only one use-case of mute)?

When Snap launched, there were infinite way to share images, but Snap asked a bunch of weird questions that no-one had really asked before. Why do you have to press the camera button – why doesn’t the app open in the camera? Why are you saving your messages – isn’t that like saving all your phone calls? Fundamentally, Snap asked ‘why, exactly, are you sending a picture? What is the underlying social purpose?’ You’re not really sending someone a sheet of pixels – you’re communicating. That’s the question Zoom and all its competitors haven’t really asked. Zoom has done a good job of asking why it was hard to get into a call, but hasn’t really asked why you’re in the call in the first place. Why, exactly, are you sending someone a video stream and watching another one? Why am I looking at a grid of little thumbnails of faces? Is that the purpose of this moment? What is the ‘mute’ button for – background noise, or so I can talk to someone else, or is it so I can turn it off to raise my hand? What social purpose is ‘mute’ actually serving? What is screen-sharing for? What other questions could one ask? And so if Zoom is the Dropbox or Skype of video, we are waiting for the Snap, Clubhouse and Yo. 

https://www.ben-evans.com/benedictevans/2020/6/22/zoom-and-the-next-video

Does your SaaS product stack up?

  • June 24, 2020June 24, 2020
  • by Andy

New SaaS product report for product managers.

Alpha 2020 Product Management Insights Report

  • February 27, 2020February 27, 2020
  • by Andy

Some interesting insights here. The best one being that PMs are now driving most ideas from customer feedback. “Brainstorming” is still far too high but might be conflated with solution ideas for problems/needs to pursue.

However, PMs do not have enough time to talk to customers or run experiments. This takes work and is not the natural orientation of traditional product development teams. Startups have too much to do and not enough resources so this suffers and big companies believe they know what their customers want because they’ve been successful to date. Both lead to bad outcomes for new products.

[Download the full report]

How should Product Managers ask for a raise or…

  • January 28, 2020February 13, 2020
  • by Andy

I get asked about compensation for product managers given their experience quite often by my students and, obviously, by those working for me. Here’s the best advice I can provide based on many conversations on the topic (including my own situations past). Note that much of this is generic to any knowledge worker position so I’ve added a few specific product manager salary tips as well.

Let’s separate the discussion between asking for a raise vs. a promotion. They are linked but not the same thing and the manager will have different considerations and elements under their control based on your ask.

Why are you asking for a raise?

Its always important for you to understand why you want a raise and be honest with yourself as to whether its the right driver:

  • You feel underpaid relative to your peers/market. (can be a good reason)
  • You are not able to pay your bills. (good reason)
  • You just got offered a similar job at a higher wage. (can be a good reason)
  • You saw some job listings that sound like you can get which are higher. (not a good reason)
  • Your peers get paid more. (good reason but have to tread carefully)
  • Your friends get paid more. (not a good reason)
  • You like money. (not a good reason…if its just about the paycheck certainly there are higher paying, less rewarding jobs)
  • You just killed it at work and are producing strong outcomes (not output) and are indispensable for your manager. (the best reason)

Asking for a raise not only takes gumption — so be convinced — but cannot be done often. Anyone who is constantly asking for more money likely will be labeled as one who’s just out for money (remember, its about the company mission, right?) or a complainer. Those are both career limiting.

How do I ask for a raise as a knowledge worker?

First, asking for a raise has a few factors a manager will consider:

  • How long have you been with the company/team? And have you passed the “job hopping” threshold (currently around 18-24 months of tenure)?
  • When (if ever) did you receive your last comp increase?
  • How in-line (or out of) is your comp with your peers?
  • How in-line (or out of) is your comp with the market (including if the company is current recruiting for similar hires)?
  • What are the your concrete accomplishments? Were those notably above and beyond the expectations for your job / performance by your peers?
  • How likely are you to leave and what is the implication of that (more on that below)?
  • Will this comp change improve your happiness/morale/likelihood of staying (assuming we want that) vs. how much it actually costs me?

One thing most people misunderstand — and I know why because its probably the most common reason to deny someone a raise — is that budget is the biggest consideration. That’s rarely the case unless you’re asking for something enormous. Think about it this way: if you make $125k/year and ask for a 10% raise (which is a pretty big jump in any year) that’s just over $1k/mth for the company. Even most small businesses can easily absorb that.

What am I worth?

Ah, the big question. Most established companies have bands of salary ranges for different levels and job types in the organization. Hopefully, most keep to that. Knowledge workers, especially in tech product development, should have wide bands. If your company is not tech heavy, it might not. You should talk with your HR rep to get more information on this first so you don’t go banging up against a wall you cannot surmount.

If you determine there is room, there are a few factors to consider:

  • What do you make now and do you have internal (be careful of using “John told me he makes $X as that will likely get John in hot water) or external facts to support that you’re underpaid?
  • How much of an increase are you asking for? Cost of living is typically around 3% (and hopefully your company is already accounting for that). 10%+ is a big ask unless you have concrete evidence you are underpaid.
  • Tying your comp to a piece of the rev/profits you’re driving is not a good road to go down unless you are solely driving that revenue (e.g salesperson).

What are salary bands based on experience for product managers?

Here’s a rough guide based on my sense of the current market. This is based on being in a tech center with cost of living notably above the mean (e.g. NYC, Boston; note that I’m excluding the fairy-tail land of SV unicorns and some of the big tech as that comp is wildly out of line with the rest of the market) (last updated Jan ’20):

  • Associate Product Manager (entry level / no experience, if those exist): $75-100k (can go higher if coming from a strong background in a related field like eng)
  • Line product manager (only one product), 3-5 years exp: $100-150k
  • Line or Senior product manager, 5-7 years exp: $150-175k
  • Group product manager (multiple products / teams): $175-225k
  • VP, Product: $225k+
  • SVP, Product: $300k (+/- 20%)
  • CPO: * (varies wildly given its C-level but on par with CTO/CIO)

Tenure at the company also can influence this and that is not factored in here. In addition, this does not account for bonus or equity as that’s too variable by company based on their comp philosophy. Use as a rough guide only as many other factors can influence this. Evidence shows that PMs now make more than engineers on average at big tech firms.

How do I ask for a promotion in a flat organization?

Before asking for a promotion, know why you feel like you deserve a promotion:

  • Do you feel bored and unchallenged in your job and want to take on more? Positive spin: have you mastered your job? (good reason)
  • Is there an opening on the team? (might be a good reason)
  • Did someone else on the team you feel is similar or below your abilities/contribution just get promoted? (bad reason)
  • Did you get offered another job which is more senior? (can be a good reason but that means you’re open to staying)
  • Did you lay out a specific career path and you aren’t on it (or your friends are getting promoted and you’re not)? (not a good reason)
  • Your teammates love you? (not a good reason)
  • Are you good “friends” with your manager? (not for long and not a good reason)

Let’s first understand the two general types of promotions (note that “battlefield promotions” aren’t considered here):

  • Merit promotion: You get an enhanced title, a bit more money and responsibility in recognition of the outcomes you have achieved. Generally, this is something a mid-level manager can decide as it has only minor implications on the org and budget. An example of this is going from “Product Manager” to “Senior Product Manager”. You get the recognition but generally have the same relationship with your peers. Your arguments here should focus on your achievements and they should be concrete, irrefutable and above the call of duty.
  • Responsibility promotion: You get significantly more responsibility and authority including changing the relationship with your peers (e.g. becoming a/their manager). These typically happen when a position — backfill or new in the org — opens. This is a larger consideration that might be outside your manager’s sole purview as it likely has broader implications in the organization. There are two considerations here: does the person deserve it (basically an enhanced merit promotion conversation) and can they handle it. The latter is the most nebulous but important aspect. Are you the right person to manage if you haven’t before? You’re so good in your role now, should we disturb that? Will you be happy and effective in your new role? Have you hit your natural maxima in this role/org and you’re not seen as able to take on the next level of responsibility? These considerations tend to influence the decision the most and will be the most difficult for you to get an honest assessment of.

One other thing a responsibility promotion entails is ensuring that the organization has / can create the opening for you. This reasonably might be outside your manager’s control and have broader political implications they’re not willing to go to bat for you on.

Does threatening to quit work?

Almost never and I would not go there. Even if you have another job offer in hand, why would you go back to your employer asking for a promotion or money after going through all the trouble of getting a new job? This isn’t a good strategy to get something from your current employer. They will see through this and might be happier knowing you’re somewhere else.

How indispensable is this person?

All-in-all, here’s the simple way I always look at people on my team at review time or when they ask for raises/promotions (and I know that most senior leaders look at it this way whether they admit it or not):

When managers make comp & promotion decisions they know they are delivering a message. They tend to fall into one of three categories:

  1. “You’re indispensable“: If you leave, how easily can I replace you (i.e. are we screwed)? If so, I’ll make accommodations for you. Even if I’m not immediately able to pay/promote you, I’ll make some informal promises to keep you happy.
  2. “You’re solid but not indispensable“: It will hurt but I can replace you internally or with a relatively painless external hire. I might accede a bit on comp but not likely on promotion if I feel you’re in the right position now (natural maxima).
  3. “You need to go“: I’m not bold enough or want the hassle/morale hit of actually firing you but hope you self-select out. If you’re getting this message, its probably not a good fit and use it as a time to exit gracefully and on your terms (they might pay you to hunt for a job).

This is why, when it comes to review and bonus season, managers — who inevitably have less to give out than they want — have to look at their staff this way. The #1s need to be over indexed on and the #3s need to be starved (so that hopefully they’ll quietly self-select out…and soon). The #2s end up bearing a bit of the brunt if the #1 group needs to pull from their pool. Whichever category you’re in significantly influences your ability to negotiate. First, try to get an honest understanding of that (for another post).

How will this person’s happiness (and remaining with the team) affect morale?

The other factor a manager considers is the potential affect of you not being happy / leaving on the rest of the team. Are you well liked and easy to work with? Do you pick up the slack and cover for others? Do you drive people nuts? Are you not carrying your weight? You not being there could actually improve morale. This is a challenging calculation that good managers have their finger on the pulse of.

How aggressive should I be in asking for a raise and/or promotion?

The simplest advice I can give is that if you’ve been at your job for over 18 months and know you’ve been performing well — and well means above expectations…you don’t get promotions for showing up every day — you should start the conversation. The first response will likely be to put it on the radar and have it formally considered at the next review time or another milestone (unless you’ve already achieved #1 status above). Be patient but hold your manager to this commitment and ask for what you need to do to get this.

How do I interpret my manager’s response?

You need to read between the lines a bit and possibly ask some follow-up questions:

  • No with reasonable justification: “company policy is that we only consider comp changes in Q1” (confirm this is true), “I cannot do anything now but let’s reconvene on this in 1-2 quarters” (make sure this happens), “Deliver that product successfully hitting your KPIs and then we’ll discuss” (get it done and then take it up), “You’re above most/all of your peers so increasing you more would just create a bigger disparity” (could be true; ask for more data and provide market comps as the company might be out of line; doesn’t mean you can’t get more in the future), “You’re not ready, but can be” (get the terms and what you need to do)
  • No with non-answer: “I don’t have any budget” (see above), “You’re at the top of our range for your level/experience” (ask what the ranges of more recently hired peers are; come back with market data if you can)
  • Yes with counter-offer: “I can’t do $10k but how about $5k” (ask for the reasoning)
  • Yes: congrats but use it as an opportunity to understand their expectations of you as they might have reset

Again, I never advise threatening or asking over and over unless you get an a “non-answer” as outlined above. Getting an answer you aren’t happy with is not a non-answer. Just ask for what you need to do to be inline for something.

Don’t put your manager’s back to the wall. That will only strain your relationship. If you already have a strained relationship you don’t think you can repair, you should already be looking for another role/job.

“Social-desirability bias”

  • November 24, 2019
  • by Andy

Pollsters refer to this phenomenon as the “shy Trump” effect, or — in academic parlance — a form of “social-desirability bias.” Studies have affirmed that in races where a candidate or cause is perceived as controversial or otherwise undesirable, voters can be wary of voicing their support, especially to a live interviewer.

https://www.nytimes.com/2019/11/23/us/politics/2020-trump-presidential-polls.html

This is an interesting concept that applies more broadly than elections for interviewing for interest in products as well. There are certainly products which people need/want but are often unwilling to disclose (e.g. certain health, financial or “guilty pleasure” items). When interviewing customers this has to be taken into account or else it might product spurious results similar to asking people “how much would you pay for X?”

It sought to combat the shy Trump effect by asking respondents not only how they planned to vote but also how they thought their neighbors would vote — possibly offering Trump supporters a way to project their feelings onto someone else. The AAPOR report posited that the neighbor question could help overcome shyness among Trump supporters, particularly in phone interviews.

This is an interesting technique. A little bit like Net-promoter Score (NPS) where you’re asking about something a bit disembodied to try and glean better results. The “Well, I have this friend…” effect.

Commentary: ROI is the only KPI

  • August 18, 2019August 18, 2019
  • by Andy

Key Performance Indicators (KPIs) are one of the hottest topics in product management (well, management in general in a well run company). However, many struggle in defining meaningful ones. I assert there’s only one that matters: return on investment (ROI). Using this will help simplify and clarify all your activities and planning. I have found few things that can’t be defined in terms of ROI.

In my work across a variety of companies large and small I typically see one of these situations:

  1. KPIs inherited from what finance/sales (or whomever the revenue generating owner is) says measured as pure P&L and not often reconciled with the total investment (and often missing secondary KPI product and user success measures)
  2. A massive number of intricate measures that no one can get their head around nor really knows how or why each matters for the business/product
  3. Not much at all

In each case, there needs to be a KPI reset. I encourage most teams I work with to have primary and secondary KPIs. Primary are what really defines and measures success. Secondary are more intricate that focus on more detailed aspects of a product or business. I have arrived at the point — after testing this across many different types of products, services and organizations — that ROI (broadly applied) is the one all products should set as their primary KPI.

In my teaching, we discuss these KPI categories:

  • Acquisition: how do customers discover the product
  • Conversion: how to we get them to pay
  • Engagement: how regularly and for how long your product is used
  • Retention: when time to return/renew, do they
  • Satisfaction: how do customers rate the product
  • Defect rates: what is the rate of defect/failure in the product
  • Cost savings: how can this product make the business more efficient

There are a few KPI models but most overlap with these groups. These are excellent secondary KPIs and should be measured in every product. In addition, we always want to measure our KPIs in terms of our customer needs, not just our business interests.

Amazon provides one of the best example here: typically, warehouse logistics would measure success as the time from order received until order shipped. Amazon measures from order received until customer receipt of the package. If they are quick in the warehouse but the shipper is slow their customer still is not satisfied. This is also why you see Amazon taking over the last mile of deliveries more and more.

All traditional KPIs can be translated into ROI. Let’s look at some examples.

Example: Social network engagement

Social networks are all about engagement, right? Well, yes, that’s a key secondary measure: typically daily active users (DAU) over monthly active users (MAU). However, every user and every user interaction has a value. Facebook makes money on ad display and interaction. They know the values of those and a bit of math can peg a value on each user engagement. They then need to know both what are the upfront and ongoing R&D for the service plus other operational costs providing the ROI denominator. That might seem simple and obvious but there’s a knock-on effect: by tracking ROI, they can actually see variations that engagement alone does not show. What if ad rates fluctuate? What about bandwidth or R&D costs? What if we now need to hire 20,000 people to moderate our content? Engagement alone is too simple.

Example: Subscription service retention and LTV

Its less expensive to keep a customer than acquire a new one goes the saying (and the data most often supports this). This one should be pretty straightforward as any good acquisition engine inherently uses ROI to evaluate their marketing spend efficacy. But what about retention? How much are you willing to spend (often in discounts or other incentives) to keep a subscriber? Companies typically know the lifetime value (LTV) of their customers (especially if you’re in the subscription game). Its the average purchase * typical retention period purchases (e.g. $30/mth over 15 months or $450 LTV).

However, are you tracking lifetime net profit (LNP) of your customers? LNP takes LTV and considers margin. Continuing the example above, if we consider that we have a 33% margin on those subscriptions, our LNP is actually $148.50.

Lifetime Net Profit per User 
I. Avg Purchase$30
J. Average Purchases per month1
K. Typical retention (months)15
L. LTV (IxJxK)$450
M. Average Margin33%
N. LNP of a user (LxM)$148.50

When the marketing dept tells customer service that they can spend $200 to incentivize a customer to stay, that might actually be a negative ROI.

Example: Real customer acquisition cost

Any good marketer (esp digital) will track the ROI of all their placements across media buys. Customer Acquisition Cost (CAC) is typically your marketing spend (for a given channel/placement) over your number of conversions. But just looking at CAC might not show the full picture. Consider the example below:

Real Customer Acquisition Cost 
A. Marketing Spend$10,000
B. Clicks2,000
C. CPC (A/B)$5.00
D. Conversion Rate2.5%
E. Conversions (BxD)50
F. CAC (A/E)$200
G. Discount on 1st purchase$50
H. Real CAC (F+G)$250

The conventional CAC does not capture the fact that there’s also an incentive discount of $50 making the real CAC $250.

If you want to take it further, the LTV/CAC ratio is often measured as key to tracking unit profitability. Combining our two examples above, this would be 2.5x ($450/200) under the conventional model. But considering LNP/rCAC, that now is a negative 0.59x ($148.50/250) return. It looks like you have a nice ROI on your marketing spend for your service and a good retention plan, but maybe not.

Thus, using ROI (or its proxy measures) is going to give you a clearer picture of:

  • Is what I’m doing operationally with my product profitable?
  • Is my acquisition funnel profitable?
  • Should I build this?

I now always ask this question and drive to find these ratios when I engage companies on product strategy.

Sign up for the ADV newsletter

  • Terms and Conditions
  • Privacy Policy
Copyright 2018-23 Assert Digital Ventures, Inc.
Theme by Colorlib Powered by WordPress