Content uploaded by Naoki Abe
Author content
All content in this area was uploaded by Naoki Abe on Oct 17, 2014
Content may be subject to copyright.
Cross Channel Optimized Marketing by Reinforcement
Learning
Naoki Abe, Naval Verma and Chid Apte
Mathematical Sciences Dept.
IBM T. J. Watson Res. Ctr.
Yorktown Heights, NY 10598
nabe, nverma, apte@us.ibm.com
Robert Schroko
Database Marketing
Saks Fifth Avenue
12 E. 49th Street, New York, NY 10017
Robert Schroko@s5a.com
ABSTRACT
Categories and Subject Descriptors
General Terms
Keywords
Permission to make digital or hard copies of all or part of this work for
personal or classroom use is granted without fee provided that copies are
not made or distributed for profit or commercial advantage and that copies
bear this notice and the full citation on the first page. To copy otherwise, to
republish, to post on servers or to redistribute to lists, requires prior specific
permission and/or a fee.
KDD’04, August 22–25, 2004, Seattle, Washington, USA.
Copyright 2004 ACM 1-58113-888-1/04/0008 ... 5.00.
1. INTRODUCTION
2. PROBLEM DESCRIPTION
2.1 The business problem
2.2 The cross channel challenge
3. METHODOLOGY
3.1 Cross channel life time value
maximization and MDP
3.2 Q-learning with variable time intervals
3.3 Batch Advantage Updating
4. EXPERIMENTS
4.1 Data
4.2 Evaluation
4.3 Experimental Results
5. CONCLUSIONS
6. ACKNOWLEDGMENTS
7. REFERENCES