Ontology-Aware Classification and Association Rule Mining
for Interest and Link Prediction in Social Networks
Waleed Aljandal Vikas Bahirwani Doina Caragea William H. Hsu
Department of Computing and Information Sciences, Kansas State University
234 Nichols Hall, Manhattan, KS 66506-2302
firstname.lastname@example.org email@example.com firstname.lastname@example.org email@example.com
Previous work on analysis of friendship networks has identi-
fied ways in which graph features can be used for prediction
of link existence and persistence, and shown that features of
user pairs such as shared interests can marginally improve
the precision and recall of link prediction. This marginal
improvement has, to date, been severely limited by the flat
representation used for interest taxonomies. We present an
approach towards integration of such graph features with on-
tology-enriched numerical and nominal features (based on
interest hierarchies) and on itemset size-sensitive associa-
tions found using interest data. A test bed previously devel-
oped using the social network and weblogging service Live-
Journal is extended using this integrative approach. Our re-
sults show how this semantically integrative approach to
link mining yields a boost in precision and recall of known
friendships when applied to this test bed. We conclude with
a discussion of link-dependent features and how an integra-
tive constructive induction framework can be extended to
incorporate temporal fluents for link prediction, interest pre-
diction, and annotation in social networks.
Keywords: ontology-aware classification, association rule
mining, link prediction, interest prediction, social net-
works, constructive induction, annotation
This paper presents an integrative, ontology-enriched
framework for link prediction in social networks that com-
bines previously developed approaches for feature con-
struction and classification. These include: computing to-
pological graph features [HKP+06], shared membership
counts [BCA+08], and aggregates across all shared mem-
berships [AHB+08]. It augments them with an ontology
extraction mechanism based on partitioning and agglomer-
ative hierarchical clustering [BCA+08]. This mechanism
extends our feature construction task to a more general one
of feature extraction, while enabling it to handle diverse
memberships, such as: interests that a user can hold, com-
munities he or she can belong to, etc. Previous work has
focused more on scaling up algorithms for graph feature
Copyright © 2009 Association for the Advancement of Artificial Intelli-
gence (www.aaai.org). All rights reserved.
construction from hundreds of users to thousands
[HLP+07] and applying association rule mining to con-
struct features useful in estimating link probability and
Meanwhile, the ontology-aware classification approach
used by Bahirwani et al. [BCA+08] has incorporated ge-
neric glossaries and other definitional data sources such as
WordNet-Online, the Internet Movie Database (IMDB),
and Amazon Associates’ Web Service (AWS). These me-
thods laid the groundwork for an integrative feature extrac-
tion system, considerably improving the precision and re-
call of link prediction [BCA+08, AHB+08]. There are,
however, several directions where further technical ad-
vances are needed in order to make the classification-based
prediction approach effective within a recommender sys-
tem. These include:
1.Extension of the framework to include interest pre-
diction, based on an itemset size-adaptive measure
of interestingness for association rules generated in
frequent pattern mining [AHB+08]
2.Extension of the framework to incorporate technical
3.Application of the framework to incorporate seman-
tic metadata regarding user profiles: specifically,
schemas describing eligible interests and common
memberships between a pair of candidate users
4.Feature selection, extraction, and discovery methods
that are sensitive to recommendation context and
able to leverage the above metadata
5.Development of data description languages using
description logics that can capture fluents such as
set identity over time
We first define our link prediction framework, then the ho-
listic framework for ontology-enriched classification.
Next, we describe our social network test bed in brief, and
report new positive results after extending the framework
along the first aspect above. Finally, we discuss the data in-
tegration and modeling operations needed to implement the
other four using present-day social networks and Semantic
Web representations such as OWL.
Friendship Networks in Social Networks
Most social networking services include friend-listing me-
chanisms that allow users to link to others, indicating
friends and associates. Friendship networks do not neces-
sarily entail that these users know one another, but are
means of expressing and controlling trust, particularly
access to private content. In blogging services such as
SUP’s LiveJournal or Xanga, this content centers on text
but comprises several media, including: interactive
quizzes, voice posts, embedded images, and video hosted
by other services such as YouTube. In personal photo-
graph-centric social networks such as News Corporation’s
MySpace, Facebook, Google’s Orkut, and Yahoo’s Flickr,
links can be annotated (“How do you know this person?”)
and friends can be prioritized (“top friends” lists) or
granted privileges as shown in Figure 1.
Figure 1. An excerpt of Facebook's access control lists for user
profile components. © 2008 Facebook, Inc.
Some vertical social networks such as LinkedIn, Class-
mates.com, and MyFamily.com specialize in certain types
of links, such as those between colleagues, past employers
and employees, classmates, and relatives. As in vertical
search and vertical portal applications, this specialization
determines many aspects of the data model, data integra-
tion, and user knowledge elicitation tasks. For example,
LinkedIn’s friend invitation process requires users to speci-
fy their relationship to the invited friend, an optional or
post-hoc step in many other social networks.
Friendship links can be undirected, as in Facebook and
LinkedIn (requiring reciprocation, also known as confirma-
tion, to confer access privileges) or directed, as in Live-
Journal (not necessarily requiring reciprocation).
Prediction Tasks: Link Existence and Persistence
Link analysis techniques, such as supervised learning of
classification functions for predicting link existence
[HKP+06, HLP+07] and persistence [HWP08], have been
applied to social networks such as LiveJournal. This ap-
proach inductively generalizes over three types of features:
1.node-dependent: specific to a user u to whom a
friend is being recommended, or to a recommend-
ed user v
2.pair-dependent: based on co-membership of u
and v in a domain-specific set (see below)
3. link-dependent: based on annotation of known
relationships, or aggregation between them in the
entity-relational data modeling sense
Examples of pair-dependent attributes include measures of
overlap among common:
communities, forums, groups
fandoms (fan of), endorsements (supporter of)
institutions (schools, colleges and universities,
Measures of overlap depend on the abstract data type of the
attributes. For interests, communities, fandoms, and en-
dorsements, they are most often simple counts – that is, the
size of the intersection of two users’ membership sets,
computed by string comparison. Overlap can, however, be
a weighted sum of similarity measures between concepts.
Our focus in this paper is the development and application
of concept hierarchies based on such measures. For institu-
tions, the base types for computing overlap can be intervals
– typically, the time periods that two people were both at a
university or company.
Most features for link prediction are node-dependent or
pair-dependent. For example, Hsu et al. derived seven to-
pological graph features and five interest-related features
of potential relevance to link existence prediction in Live-
Journal’s directed friendship network [HKP+06]. They
then used supervised inductive learning over pairs of can-
didate features known to be within two degrees of separa-
tion to find discriminators between direct friends and
“friend of a friend” (FOAF) pairs within a limited Live-
Journal friendship graph, initially containing 1000 users
[HKP+06] that was later extended to 4000 users
[HLP+07]. In later work [HWP08], they extended the
“friend vs. FOAF” task to predicting day-by-day link per-
sistence in a time series of repeated web crawls.
Computation of topological graph features, such as the de-
gree of separation (shortest path length) between a pair of
users, can yield information such as alternative paths as a
side effect. Figure 2 illustrates one use of such information
in the professional social network LinkedIn.
In this paper, we focus on link existence prediction
between users and between interests. The task is formu-
lated as follows: given a graph consisting of all other ex-
tant links, specify for a pair (u, v) known to be within two
degrees of separation, whether v is a friend of u (distance
1) or FOAF (distance 2). Our experiments are conducted
using this directed edge prediction task over a 1000-node
LiveJournal data set created by Hsu et al. We seek to im-
prove the precision and recall of link existence prediction
beyond that achieved using node-dependent and pair-
dependent features on flat interest hierarchies.
Figure 2. Minimal-length paths for a third-degree connected pair
in LinkedIn. © 2008 LinkedIn, Inc.
Link mining refers to the problem of finding and analyzing
associations between entities in order to infer and annotate
relationships. It may therefore require data modeling, inte-
gration, and mining by means of machine learning from
known or putative links. The links can be user-specified,
as for the social networks discussed earlier in this section,
or latent for text information extraction tasks such as that
of McCallum et al. [MWC07], who used the Enron e-mail
corpus to infer roles and topic categories. For a complete
survey of link mining approaches that emphasizes statistic-
al relational learning approaches and graphical models, we
refer the interested reader to Getoor and Diehl [GD05].
Ketkar et al [KHC05] compared data mining techniques
over graph-based representations of links to first-order and
relational representations and learning techniques that are
based upon inductive logic programming (ILP). Sarkar
and Moore [SM05] extend the analysis of social networks
into the temporal dimension by modeling change in link
structure across discrete time steps, using latent space
models and multidimensional scaling. One of the chal-
lenges in collecting time series data from LiveJournal is
the slow rate of data acquisition, just as spatial annotation
data (such as that found in LJ maps and the "plot your
friends on a map" meme) is sparse.
Popescul and Ungar [PU03] learn an entity-relational mod-
el from data in order to predict links. Hill [Hi03] and Bhat-
tacharya and Getoor [BG04] similarly use statistical rela-
tional learning from data in order to resolve identity uncer-
tainty, particularly coreferences and other redundancies
(also called deduplication). Resig et al. [RDHT04] used a
large (200000-user) crawl of LiveJournal to annotate a so-
cial network of instant messaging users, and predict online
times as a function of a users’ degree in the friends graph.
Ontology-Aware Link Mining
Hsu et al. reported a near-baseline accuracy of 88.5% and
very low precision of 4.5 – 5.4% for the LiveJournal link
existence prediction task using shared interests alone.
[HPL+07] They report that adding shared interests to graph
features yielded an incremental improvement of 6.5% in
precision (from 83.0% to 89.5%) for decision trees, which
achieved the best baseline and final precision on cross-
validation data. This illustrates that using literal string
equality to compute “similarity of interest sets” between
two users does not result in effective features for predicting
link existence in the friends’ network of LiveJournal. We
hypothesized that this was due to the semantically limited
similarity measure and that a measure based on an ontolo-
gy, such as a concept hierarchy of interests as depicted in
Figure 3, would yield further improvement [BCA+08].
Figure 3. Concept hierarchy of interests [BCA+08].
By applying unsupervised learning to a complete lexicon
of interest terms, with reference dictionaries as sources of
knowledge about term similarity, we constructed two types
of interest-based features. These are pair-dependent fea-
tures as described in the above section on prediction tasks:
nominal: measured for grouped relationships for
a candidate pair of entities by name (e.g., are u
and v both interested in topics under the category
of mobile computing?)
numerical: interestingness measures that are
computed across these grouped relationships (e.g.,
how many interests that u is interested in does v
share, and how rare are these interests?)
Nominal Features: Abstraction using Ontologies
As in many social networks, the number of distinct inter-
ests in LiveJournal grows in proportion to the number of
users, up to hundreds of thousands. The bit vectors for
shared interests between users become so large and sparse
that for nominal interests it is only feasible to use an ontol-
ogy. Rather than continue to use literal string equality,
which results in this overly stringent and sparse representa-
tion, we clustered interests to form a concept hierarchy and
used the aggregate distance measure between user interests
to more accurately determine users’ degree of overlap.
Figure 4. Procedure for consulting definitional data sources
prior to constructing interest ontology [Ba08].
The actual hierarchy consisted of single-word concepts
formed from individual terms; LiveJournal allows up to
four 15-character terms per interest. The similarity metric
used for clustering was the number of matching terms in a
unified definition set obtained as shown in Figure 4. Each
term of an interest was looked up in WordNet-Online, the
Internet Movie Database (IMDB), and Amazon Associates’
Web Service (AWS). Hierarchical Agglomerative and Di-
visive (HAD) clustering, a hybrid bottom-up linkage-based
and divisive (partitional) algorithm, was used to generate
the hierarchy. The output, consisting of 19 clusters, is
summarized in Figure 5; note that the level of abstraction
can be manually set, as we do in our experiments. We re-
fer the interested reader to Bahirwani [Ba08] for additional
details of the clustering algorithm and documentation on
the data sources consulted.
Our link existence prediction system uses, as a baseline,
the computed graph features specified by Hsu et al.
[HKP+06]. To this we add nominal features: one Boolean
value for each pair of interests in the Cartesian product of
those for a user u and a user v. This is computed by first
clustering single interest keywords to build a concept hie-
rarchy, then mapping each interest of u and v to its abstract
ancestor in the concept hierarchy before computing the
nominal features (a bit vector).
Figure 5. Example of clusters found using Hierarchical Agglo-
merative and Divisive (HAD) algorithm.
Numerical Features: Estimation by Association
Rule (AR) Mining
Interestingness measures are descriptive statistics com-
puted over rules of the form u ? v, which in our application
denotes that “when u holds an interest, then v also holds
that interest”. This allows us to apply algorithms for asso-
ciation rule (AR) mining based on calculation of frequent
itemsets, which by analogy with market basket analysis
denote sets of users who are all interested in one topic.
Each interestingness measure captures one or more deside-
rata of a data mining system: novelty (surprisingness), va-
lidity (precision, recall, accuracy), expected utility, and
comprehensibility (semantic value).
We use the count of common interests, plus eight norma-
lized AR interestingness measures over common interests,
as numerical friendship prediction features. Each measure
is a statistic over the set common interests of u and v, and
expressed as a function of the rule u ? v.
1.The number of common interests:
| Itemsets(u) Itemsets(v) |
Support (u ? v) = Support (v ? u) =
Confidence (u ? v) =
Confidence (v ? u) =
Lift (u ? v) =
Conviction (u ? v) =
Match (u ? v) =
Accuracy (u ? v) =
Leverage (u ? v) =
A normalization step is used to sensitize the AR mining al-
gorithm to the popularity of interests, which is measured
by the sizes of itemsets. Intuitively, it is more significant
for two candidate users to share rare interests than popular
ones, a property which gives itemset size a particular se-
mantic significance in this application domain. For the de-
rivation of a parametric normalization function, we refer
the interested reader to Aljandal et al. [AHP+08].
Combining AR Mining and Interest Ontologies
The same ontology used is also applied to concrete (literal)
interests to generate numerical features for abstract inter-
ests. That is, interests are first generalized as in the preced-
ing section, “Nominal Features”; interestingness measures
are then computed over the abstract interest categories; fi-
nally, the resultant measures are normalized using the size
of each abstract itemset (list of interest-holders).
Link Prediction: 1000-user LiveJournal Data Set
We used the 1000-user data set developed by Hsu et al.
[HLP+07], which includes about 22,000 unique interests
that are shared by at least two users. (Interests held by on-
ly one user are of no interest for link prediction, so single-
ton itemsets are pruned as is often done in frequent itemset
mining.) As mentioned above, these are clustered using
the HAD algorithm to form 19 clusters, resulting in 19 +
19 = 38 nominal features for every candidate pair (u, v).
To these we add the original 7 graph features and the 9
numerical features. This integrated data set incorporates
all of our ontology-enhanced relational features. It is sam-
pled at a ratio of 50% negative (non-friends) to 50% posi-
tive (friends) for training, while the holdout validation data
set has a natural ratio of about 90% to 10%. This follows
the approach used by Kubat, Matwin, and Holte to learn
classifiers for anomaly detection where the naturally ob-
served rate of negative examples was much greater than
that of positive examples [KM97, KHM98].
Interest Prediction: LiveJournal Data Set
We also use the integrated, ontology-enhanced data set to
predict whether an individual user u lists a member of one
of the 19 abstract interest categories, given the fraction of
their friends in the network that also list that category.
Link Existence Prediction
Table 1 and Table 2 show the precision, recall, F-score and
area under the specificity-sensitivity curve (ROC-AUC) for
the three inductive learning algorithms with the highest
ROC-AUC. Each was trained using graph, nominal, and
numerical features. These were computed without the on-
tology for Table 1 and with the ontology for Table 2.
Table 1. Results without ontology-based features.
Precision Recall F-Score AUC
Table 2. Results with ontology-based features.
Precision Recall F-Score AUC
70.0 0.020 0.857 0.038 0.829
We evaluated the nominal and numerical features using
five classifier models and inductive learning algorithms:
support vector machines (SVM), Logistic Classification,
Random Forests, decision trees (J48), and decision stumps
(OneR). Table 3 and Table 4 list the results for SVM and
Logistic Classification, which achieved the highest ROC-
AUC score using all available features. [Ba08] The overall
highest AUC was achieved using numerical features along
with Logistic Classification. Although the precision is still
improved by the inclusion of nominal features.
Table 3. Results using Support Vector Machines.
Table 4. Results using Logistic Classification.
Conclusions and Future Work
We have shown how concept hierarchies learned from in-
terest terms, generic dictionaries, and topical dictionaries
can result in ontology-aware classifiers. These have great-
er precision and recall on link existence and interest pre-
diction than those based only on graph features, nominal
features, and numerical interestingness measures for asso- Download full-text
In future work, we will examine how to extend the frame-
work to incorporate multi-word interests and technical de-
finitions. Other memberships listed in the “Prediction
Tasks” section above may also benefit from ontology dis-
covery – especially fandoms and communities, which have
their own description pages and metadata in most social
networks. The association rule mining approach and the
semantics of itemset size extend naturally to these do-
mains, making these a promising area for exploration of
ontology-aware classification. To be able to account for the
relationship between membership popularity and signific-
ance towards link existence, however, it will be important
for our future discovery methods to capture some domain-
specific semantics of links and itemset membership. For
example, we do not expect that itemset size normalization
methods will apply in all market basket analysis domains,
even though they seem to be effective in some social net-
works. Finally, returning to the LinkedIn example in Fig-
ure 2, an ontology that includes temporal fluents such as
part-of (“Blogger became part of Google in 2004”) and use
them to infer relational fluents (“u and v have been Google
employees since 2004”) will allow us to construct semanti-
cally richer feature sets that we believe will be more useful
for link existence and persistence prediction.
We thank the Defense Intelligence Agency (DIA) for sup-
port and Tim Weninger for implementation assistance and
useful discussions on graph feature discovery.
[AHB+08] Aljandal, W., Hsu, W. H., Bahirwani, V., Caragea, D.,
& Weninger, T. (2008). Validation-based normalization and se-
lection of interestingness measures for association rules. In Pro-
ceedings of the 18th International Conference on Artificial Neural
Networks in Engineering (ANNIE 2008), St. Louis, MO, 09 - 12
[Ba08] Bahirwani, V. (2008). Ontology engineering and feature
construction for predicting friendship links and users’ interests in
the Live Journal social network. M.S. thesis, Kansas State Uni-
[BCA+08] Bahirwani, V., Caragea, D., Aljandal, W. & Hsu, W.
H. (2008). Ontology engineering for social network data mining.
In Proceedings of the 2nd ACM SIGKDD Workshop on Social
Network Mining and Analysis (SNA-KDD 2008), held in conjunc-
tion with the 13th ACM SIGKDD International Conference on
Knowledge Discovery and Data Mining (KDD 2008). Las Vegas,
NV, 24 - 27 Aug 2008.
[BG04] Bhattacharya, I. & Getoor. L. (2004). Deduplication and
group detection using links. In Proceedings of the ACM SIGKDD
International Conference on Knowledge Discovery and Data
Mining (KDD) Workshop on Link Analysis and Group Detection
(LinkKDD2004), Seattle, WA, USA, August 22-25, 2004.
[GD05] Getoor, L. & Diehl, C. P. (2005). Link mining: a survey.
SIGKDD Explorations, Special Issue on Link Mining, 7(2):3-12.
[Hi03] Hill, S. (2003). Social network relational vectors for ano-
nymous identity matching In Proceedings of the International
Joint Conference on Artificial Intelligence (IJCAI) Workshop on
Statistical Learning of Relational Models (SRL), Acapulco,
MEXICO, August, 2003.
[HWP08] Hsu, W. H., Weninger, T., & Paradesi, M. S. R.
(2008). Predicting links and link change in friends networks: su-
pervised time series learning with imbalanced data. In Proceed-
ings of the 18th International Conference on Artificial Neural
Networks in Engineering (ANNIE 2008), to appear. St. Louis,
MO, 09 - 12 Nov 2008.
[HLP+07] Hsu, W. H., Lancaster, J. P., Paradesi, M. S. R., &
Weninger, T. (2007). Structural link analysis from user profiles
and friends networks: a feature construction approach, In Pro-
ceedings of the 1stInternational Conference on Weblogs and So-
cial Media, (pp. 75-80). Boulder, CO, 26 - 28 Mar 2007.
[HKP+06] Hsu, W. H., King, A. L., Paradesi, M., Pydimarri, T.,
& Weninger, T. (2006). Collaborative and structural recommen-
dation of friends using weblog-based social network analysis. In
Nicolov, N., Salvetti, F., Liberman, M., & Martin, J. H. (Eds.),
Computational Approaches to Analyzing Weblogs - Papers from
the 2006 Spring Symposium, pp. 24-31. AAAI Press Technical
Report SS-06-03. Stanford, CA, 27 - 29 Mar 2006.
[KHC05] Ketkar, N. S., Holder, L. B., & Cook, D. J. (2005).
Comparison of graph-based and logic-based multi-relational data
mining. SIGKDD Explorations, Special Issue on Link Mining,
[KHM98] Kubat M., Holte R., & Matwin S. (1998). Machine
learning for the detection of oil spills in satellite radar images.
Machine Learning, 30(2/3):195-215.
[KM97] Kubat, M., & Matwin S. (1997). Addressing the curse
of imbalanced training sets: one-sided selection. In Proceedings
of the 14th International Conference on Machine Learning (ICML
1997), pp. 179-186.
[MWC07] McCallum, A, Wang, X., & Corrada-Emmanuel, A.
(2007). Journal of Artificial Intelligence Research (JAIR),
[PU03] Popescul, A. & Ungar, L. H. (2003). Statistical relational
learning for link prediction. In Proceedings of the International
Joint Conference on Artificial Intelligence (IJCAI) Workshop on
Statistical Learning of Relational Models (SRL 2003), Acapulco,
MEXICO, August, 2003.
[RDHT04] Resig, J., Dawara, S, Homan, C. M., & Teredesai, A.
(2004) Extracting social networks from instant messaging popu-
lations. In Proceedings of the ACM SIGKDD International Con-
ference on Knowledge Discovery and Data Mining (KDD) Work-
shop on Link Analysis and Group Detection (LinkKDD2004),
Seattle, WA, USA, August 22-25, 2004.
[SM05] Sarkar, P. & Moore, A. (2005). Dynamic social network
analysis using latent space models. SIGKDD Explorations, Spe-
cial Issue on Link Mining, 7(2):31-40.