Thanks for visiting the original Drilling Down web site!  

The advice and discussion continue on the Marketing Productivity Blog and Twitter: @jimnovo

Read the book-
First 9 Chapters: pdf

Get the book at Booklocker.com

Relationship Marketing, Customer Loyalty, and Retention book

Customers Speak Up on Book & Site

Workshops, Project Work: Retail Metrics & Reporting, High ROI
Customer Marketing

Fresh Customer
Marketing Articles

8 Customer
Promotion Tips

Relationship
Marketing

Customer Retention

Customer Loyalty

High ROI Customer
Marketing: 3 Key
Success Components

LifeTime Value and
True ROI of Ad Spend

Customer Profiling

Intro to Customer
Behavior Modeling

Customer Model:
Frequency

Customer Model:
Recency

Customer Model:
Recent Repeaters

Customer Model:
RFM

Customer LifeCycles

LifeTime Value

Calculating ROI

Mapping Visitor
Conversion

Measuring Retention
in Online Retailing

Measuring CRM ROI

CRM Analytics:
Micro vs. Macro

Pre-CRM Testing for
Marketing ROI

Customer
Behavior Profiling

See Customer
Behavior Maps


Favorite Drilling
Down Web Sites

Book Contents

Contact Jim Novo

 

 

Drilling Down

Turning Customer Data into Profits

 with a Spreadsheet

Site and Book topic:

Maximizing marketing ROI with customer behavior analysis

 


Learn Methods, Metrics
(site map)

[ Home ]    [ FAQ ]    [ Download   [ Contact / About / Privacy ]

This is the faster loading site for slow connections.  The "pretty" version of this page is here.


Customer Value : Using Multiple, Related Customer Models
Drilling Down Newsletter # 58: 7 / 2005

Drilling Down - Turning Customer
Data into Profits with a Spreadsheet
*************************
Customer Valuation, Retention, Loyalty, Defection

Get the Drilling Down Book!
http://www.booklocker.com/jimnovo

Prior Newsletters:
http://www.drilling-down.com/newsletters.htm
-------------------------------

In This Issue:

# Topics Overview

# Best Customer Retention Articles

# Using RFM Scores to Predict Profits

Topics Overview

Hi again folks, Jim Novo here.

This month, we're taking a deep look into an actual RFM scoring case from one of your fellow Drillers.  It's a beautiful set-up, and we get to talk about subsidy costs and everything!

OK, I don't get out much...

We also have a couple of great customer marketing article links.  The first finds managers creating KPI's (Key Performance Indicators) that don't really tell them anything new.  Ideally, some KPI's should predict the future, not measure things already being measured in other ways.  The second article speaks to the hidden costs of e-mail blasting, a topic that is finally getting some attention outside of this newsletter.

On to the Drillin'...


Best Customer Retention Articles
====================

Another Look at KPI's
July 1, 2005  DM Review
Some bumps in the road in KPI land.  Apparently, some executive teams are choosing KPI's that are outcomes rather than causes, results rather than drivers of success.  In other words, a lot of stuff they get from other reports already.  If possible, KPI's should really be predictive, not reactive.

To Spam or Not to Spam - That's a Dumb Question
August 1, 2005   CMO Magazine
Ah, now we're getting somewhere.  There is a real hard cost to e-mail blasting untargeted messages, as I have said before.  Delivering the wrong messages at the wrong times has measurable direct costs but there are indirect costs as well.

Questions from Fellow Drillers
=====================

Using RFM Scores to Predict Profits

Q:  Since our last conversation few months ago, we went ahead and tested 3 different promotions using RFM.  

The 1st promotion was the test for RFM method itself to see what patterns emerge for response rate, incremental sales, etc.  The next 2 promotions targeted the customers from RFM cells with the highest incremental lift from the 1st test promotion.  Here is what we saw.  Since the targeted audience were our loyalty card members, they transact and spend at a fairly high level (the data below is modified but the trend is maintained).  For the response rate, we saw a sawtooth pattern:

(Jim's note: RFM is the 3 digit score, Rate is Response Rate).  More on RFM here and here.

RFM  Rate

555 2.8%
554 2.6%
553 2.6%
552 2.8%
551 1.9%
545 1.7%
544 1.7%
543 1.9%
542 2.0%
541 1.8%
535 1.1%
534 1.3%
533 1.5%
532 1.7%
531 1.5%
   etc.
RFM  Rate

455 2.1%
454 2.0%
453 2.3%
452 2.0%
451 2.0%
445 1.4%
444 1.5%
443 1.6%
442 1.6%
441 1.4%
435 0.9%
434 1.1%
433 1.2%
432 1.3%
431 1.4%
   etc.

RFM  Rate

355 1.9%
354 1.5%
353 1.7%
352 1.5%
351 1.5%
345 1.0%
344 1.0%
343 1.3%
342 1.1%
341 1.2%
335 0.7%
334 1.0%
333 1.1%
332 0.9%
331 0.9%
  etc.

A: Yes...

Q:  As you can see, the response rates decline fairly uniformly from 555 to 511, then rise for 455 and decline uniformly to 411, rise again for 355, and so on.  That's what I implied by a sawtooth pattern.  Is the above pattern fairly  normal?  Based on this data, can you tell if RFM is the right sequence of variables for us?  How do you tell if only 2 variables (RF or FM, e.g.) are predictive and throwing in the 3rd variable messes things up?

A:  Well, first let me say, if you are testing a sub-group of the population - loyalty card members - then you may see these kinds of shifts.  Loyalty card holders especially are a unique group, often driven by Frequency as a result of incentives given.  Hard to tell without looking at the program, but it's possible the program is modifying expected behavior.  After all, that's what you do a properly constructed loyalty program for - to modify behavior!  So in your data you might be seeing the footprints of your program at work.

I wouldn't say the data is "messed up", it just follows a slightly different pattern, caused either by the population selection, the loyalty program, or some combination.  As long as this pattern is consistent though, you can still identify and target profitable segments. 

If you would rather see a consistent "parabolic" type response curve, try sorting / scoring the Frequency quintiles *within* each Recency quintile, rather than across the entire population (if you did it this way). This will effectively boost the importance of Frequency in the score and have a smoothing effect.  If you really want to go all out, then also sort Monetary *within* each Frequency quintile rather than across the entire population.  This "sorting within quintiles" approach is a ton of work manually but is in effect the way professional RFM software does it.

The bottom line though is in the ability of RFM to segment customers into groups which behave predictably so that you can maximize profit.  The numerical score is not really an issue; it's how people with a certain score behave.  But if you have a preference as to the way the scores fall, fine.

Q:  Besides these questions, where we really got tripped up was in looking at the incremental lift per customer (sales per targeted customer minus sales per control customer; the test and control group were well matched and went through statistical rigor to ensure that there weren't inherent differences in them).  Here is what we saw:

Jim's note: RFM is the 3 digit score, Profit is the profit per customer for that score)

RFM  Profit

555 $1.65
554 ($0.15)
553 $0.46
552 $0.24
551 $0.38
545 $1.50
544 $0.60
543 $0.94
542 ($0.32)
541 $0.93
535 $1.89
534 $0.13
533 $1.02
532 ($1.16)
531 ($0.51)
   etc.

RFM   Profit

455 ($0.87)
454 $0.53
453 $1.20
452 ($0.41)
451 $0.20
445 ($1.07)
444 ($0.70)
443 ($0.01)
442 $0.12
441 $0.08
435 ($0.41)
434 ($0.48)
433 $0.00
432 $0.16
431 $0.32
  etc.

RFM   Profit

355 $0.47
354 ($0.49)
353 ($0.79)
352 $0.76
351 $0.08
345 $1.95
344 $1.85
343 $0.47
342 $0.06
341 ($0.25)
335 $0.29
334 $0.65
333 $0.18
332 ($0.97)
331 ($0.49)
  etc.


A:  Yes...beautiful thing, isn't it?  Always amazes me to see this data...

Q:  As you can see, the incremental lift is all over the place. Some of the lower RFM cells show up higher in lift while some of the higher ranking RFM cells (e.g., 554, 542, 532, etc.) show negative lift!  While I am showing the  numbers from one mailing, the results are fairly consistent in the other mailing in that some of the mid- and low-ranking RFM cells show the highest incremental lift whereas many of the high-ranking RFM cells show negative lift.  How do you interpret this data?  What do we change?  Any advice you can  provide would be very valuable.

A:  I can see you don't see the "beauty" in this data...yet!  Why do "mid- and low-ranking RFM cells show the highest incremental lift whereas many of the high-ranking RFM cells show negative lift?"

The short answer is that RFM is a response model, not a profit model (though it can be used to construct a profit model, as you have seen).  What you are seeing is normal; response does not always equal profit.

You have just proven this idea with your data but it continues to elude most marketers.  The problem with sending promotions to people who are already highly likely to respond (have high RFM scores) is many would have *bought anyway without the promotion*.  And the profits from low scores?  Direct evidence your promotions are retaining customers and making money.

Did you read Chapter 29, Expense and Revenue You Might Not be Capturing: Subsidy Costs and Halo Effects?  It's late in the book and I have found over the years many people get excited about the implementation and perhaps skip some of the later chapters...

Anyway, your "higher ranking RFM cells show negative lift" is proof positive that subsidy costs exist, and are why it often is a bad idea to do some kinds of promotions to best customers.  You literally decrease their value with each promotion, because the subsidy loss is money they *would have spent anyway* without the promotion.  It is quite common with these high-scoring groups, for example, to see a loss of about $4 with a $5 discount.  That means, on average, 80% of the people with that score would have made the purchase anyway without being sent a $5 off promotion.  You get some lift but it's not enough to cover the cost of the total discount dollars given.

Another way to look at it is like this: say you have a customer segment that spends on average $100 a month.  You send them a $10 off coupon and that month they spend $100 again - minus the $10 off coupon.  So you net $90 in spend and end up with less profits.  You left $10 on the table. 

On the flip side, when you see lower scoring segments making a ton of money, that is cold, hard as steel evidence that your retention program is working.  Literally, this data represents money that was previously left on the table because controls did not spend it and the test group did.

Look at this, the top 10 most profitable scores in the numbers you sent:

345 $1.95
535 $1.89
344 $1.85
523 $1.72
555 $1.65
545 $1.50
225 $1.42
453 $1.20
135 $1.20
425 $1.05

4 of the top 10 money-making segments basically contain defecting customers - RFM scores below 350.  If the top profit driver 345 segment contains 10,000 customers, you grabbed close to $20,000 in sales from this segment that you never would have seen if you didn't do the promotion.  Look at that 135 segment.  These are former best customers, big spenders who have not been active at all for a long time - looks like you have "wakened the dead", so to speak.  If that's not making money with a retention program I don't know what is!  It's a beautiful thing.

Here are the 10 lowest incremental sales (highest subsidy cost) generators in the data:

512 ($0.70)
444 ($0.70)
234 ($0.73)
353 ($0.79)
455 ($0.87)
332 ($0.97)
155 ($1.02)
445 ($1.07)
315 ($1.12)
532 ($1.16)

So, why do some high scores generate profits and others losses?  Why do some low scores generate profits and others losses?

We've discussed some of the potential reasons above.  But this question really is unimportant.  What is important is knowing you can generate $1.95 in sales per customer doing a certain promotion to 345's.  And that you lose $1.16 in sales doing the same promotion to 532's.  

Don't over-think the results, they simply are what they are.  Over time, based on a deep understanding of your business, testing different promotions, and watching the consistent (by score) patterns of profitability provided by the RFM scoring, you will build a theory as to why people in certain scores behave as they do.

Here's a tip: if you must send discounts to high RFM scores with a tendency to create high subsidy costs, try "thresholding" the discount at the average ticket.  In other words, if the average transaction of 532's is $50 a month, then send a "$5 off purchase over $50" discount.  Better yet, customize the offer to the average transaction of each customer for the past 60 days or so.

By using the actual response and profitability behavior of your customers to target offers, you will learn over time what types of promotions drive the highest profits for each RFM score.  Once you crack that code, you are on your way to driving serious profits!

Jim

-------------------------------
If you are a consultant, agency, or software developer with clients needing action-oriented customer intelligence or High ROI Customer
Marketing program designs, click here
-------------------------------

That's it for this month's edition of the Drilling Down newsletter.  If you like the newsletter, please forward it to a friend!  Subscription instructions are top and bottom of this page.

Any comments on the newsletter (it's too long, too short, topic suggestions, etc.) please send them right along to me, along with any other questions on customer Valuation, Retention, Loyalty, and Defection here.

'Til next time, keep Drilling Down!

- Jim Novo

Copyright 2005, The Drilling Down Project by Jim Novo.  All rights reserved.  You are free to use material from this newsletter in whole or in part as long as you include complete credits, including live web site link and e-mail link.  Please tell me where the material will appear. 

What would you like to do now?

Get the book with Free customer scoring software at:

Booklocker.com     Amazon.com     Barnes & Noble.com

Find Out Specifically What is in the Book

Learn Customer Marketing Models and Metrics (site article list)

 

Note: This is the "slow connection" version of the home site.  It's intentionally sparse design allows faster page downloads.  To access this content in what some say is a more visually appealing format, click here.

Questions about any of the concepts on this site?   e-mail me.

What Will I Learn
in the Book?

About the Author
Newsletter Sign-Up

Example of the
Drilling Down Method

See Drilling Down
Results in Action

Relationship Marketing
Customer Retention

Customer Loyalty

Get the Book
with Free Software!
(Booklocker.com)

Fresh Drilling Down
Related Articles

Advanced Customer
Modeling Articles

       [ Home ]    [ FAQ ]    [ Download ]    [ About / Contact / Privacy ]  

Welcome to the original Drilling Down web site;
recent advice and discussion are on the Marketing Productivity Blog and Twitter.

Contact me (Jim Novo) for questions or problems regarding this web site.   
Copyright The Drilling Down Project. All rights reserved.  Privacy Policy.