Cross Channel Optimized Marketing by Reinforcement
Naoki Abe, Naval Verma and Chid Apte
Mathematical Sciences Dept.
IBM T. J. Watson Res. Ctr.
Yorktown Heights, NY 10598
nabe, nverma, firstname.lastname@example.org
Saks Fifth Avenue
12 E. 49th Street, New York, NY 10017
Categories and Subject Descriptors
Permission to make digital or hard copies of all or part of this work for
personal or classroom use is granted without fee provided that copies are
not made or distributed for proﬁt or commercial advantage and that copies
bear this notice and the full citation on the ﬁrst page. To copy otherwise, to
republish, to post on servers or to redistribute to lists, requires prior speciﬁc
permission and/or a fee.
KDD’04, August 22–25, 2004, Seattle, Washington, USA.
Copyright 2004 ACM 1-58113-888-1/04/0008 ... 5.00.
2. PROBLEM DESCRIPTION
2.1 The business problem
2.2 The cross channel challenge
3.1 Cross channel life time value
maximization and MDP
3.2 Q-learning with variable time intervals
3.3 Batch Advantage Updating
4.3 Experimental Results