ArticlePDF Available

Ontology-Based Skills Management: Goals, Opportunities and Challenges.

Authors:

Abstract and Figures

Establishing electronically accessible repositories of people's capabilities, experiences, and key knowledge areas is key in setting up Enterprise Knowledge Man- agement. A skills repository can be used for e.g. finding people, staffing, skills gap analysis, and professional development. The ontology based skills management system developed at Swiss Life uses RDF schema for storing ontologies. Its query interface is based on a combined RQL and HTML query engine.
Content may be subject to copyright.
Ontology-Based Skills Management:
Goals, Opportunities and Challenges
Jacqueline R. Reich
(Rentenanstalt/Swiss Life, Switzerland
jacqueline renee.reich@roche.com)
Peter Brockhausen
(Rentenanstalt/Swiss Life, Switzerland
peter.brockhausen@swisslife.ch)
Thorsten Lau
(Rentenanstalt/Swiss Life, Switzerland
thorsten.lau@gmx.net)
Ulrich Reimer
(Rentenanstalt/Swiss Life, Switzerland
ulrich.reimer@acm.org)
Abstract: Establishing electronically accessible repositories of people’s capabilities,
experiences, and key knowledge areas is key in setting up Enterprise Knowledge Man-
agement. A skills repository can be used for e.g. finding people, staffing, skills gap
analysis, and professional development. The ontology based skills management system
developed at Swiss Life uses RDF schema for storing ontologies. Its query interface is
based on a combined RQL and HTML query engine.
Key Words: skills management, ontologies, RDF
Category: H.3, H.4, K.6.1, K.4.3, I.2.4
1 Introduction
The tacit knowledge, personal competencies, and skills of its employees are the
most important resources of a company for solving knowledge-intensive tasks
such as decision-making, strategic planning, or creative design. They are the
real substance of the company’s success [Taubner and Br¨ossler 2000]. Therefore,
establishing an electronically accessible repository of people’s capabilities, expe-
riences, and key knowledge areas is one of the major building blocks in setting
up Enterprise Knowledge Management. Such a skills repository forms the basis
for a Skills Management System, which can be used to expose skill gaps and
competency levels, to enable the search for people with specific skills, and can
influence the requirements for training, education and learning opportunities as
part of team building and career planning processes [Ackerman et al. 1999].
Journal of Universal Computer Science, vol. 8, no. 5 (2002), 506-515
submitted: 4/2/02, accepted: 3/5/02, appeared: 28/5/02J.UCS
By making employees’ experiences, knowledge and skills explicit, it is easier
to find out what people know or to direct people to others who can be of help.
This sharing of information improves the organisational productivity as well as
the individual performance. It supports staffing and enables the planning of pro-
fessional development [Auer 2000, Sure et al. 2000] – or, as Younker phrased it,
“Skills management is a robust and systematic approach to forecasting, identi-
fying, classifying, evaluating and analysing the work force skills, competencies
and gaps that enterprises face” [Younker 1998].
Implementing a Skills Management system is a threefold effort. One has to
address the technical, the content, and the cultural dimension. The technical di-
mension deals with providing the necessary functionality. The content dimension
encompasses the set up of organisational and automatic processes for keeping
the contents up-to-date. The concern of the cultural dimension is to ensure a
climate of trust and openness so that employees are motivated to make their
skills known – to their own and to the company’s benefit. Skills Management
may offer the means to affect a cultural change and instill real change into the
organisational mind-set and value-set [Deiters et al. 2000, Liao et al. 1999].
The outline of the paper is as follows. We start with a description of Swiss
Life’s architecture of a Skills Management application [Section 2]. Section 3
is devoted to the ontology development process. In section 4 we give a brief
description of the querying facilities before we conclude with an outlook on
future work [Section 5].
2 Skills Management at Swiss Life
At Swiss Life we developed a Skills Management system (SkiM) that in its
first version aims at finding people with a certain skills profile. This can either
be used for staffing new projects, or for identifying experts who might help to
solve a certain problem. Employees describe their skills themselves. They are
totally self-responsible in this. However, as the skills are publicly visible within
the company social pressure will work as a corrective, causing employees to be
honest in describing their skills.
Furthermore, participation in SkiM is completely voluntary. Instead of mak-
ing it obligatory we rely on the motivation of employees to become more visible
within the company and thus to increase their career opportunities. SkiM can be
seen as providing an internal job fair. An employee specifies his or her skills by
selecting concepts from a terminology [see Section 3.1] and by indicating a level
for each selected skill. Skills levels range over four steps from “elementary knowl-
edge” to “expert”. Although the skills are visible to every other employee, the
actual skills levels are not, guaranteeing some privacy. However, this is subject to
discussion, among others to better enforce the social pressure mentioned above.
507
Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
Figure 1: A personal home page in SkiM (top part)
Besides the skills more details can be given, like education, former affiliation,
special interests, projects participated in, etc. Finally, from all statements given
a personal home page is generated on the intranet, which can then be searched
[see Fig. 1].
Whenever an employee wants to register with a skill or education type that
is not part of the existing catalogue, she or he can easily extend the catalogue
by forwarding the suggested new term and its supposed place in the hierarchy to
the SkiM administrator who will care for its correct integration. The new term
will be visible to all users as soon as the integration will be completed.
2.1 Architecture of the SkiM System
The SkiM system comprises several components [see Fig. 2]. The Ontology Editor
OntoEdit allows an administrator to edit the ontologies for skills, education, and
508 Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
Figure 2: Architecture of the SkiM System
job functions. OntoEdit enables inspecting, browsing, codifying and modifying
ontologies and therefore supports the ontology development and maintenance
tasks. The ontologies are modelled at a conceptual level and independently of
the formalism of the final representation language. OntoEdit offers views on
conceptual structures, such as concepts, concept hierarchy,relations,oraxioms
[Sure and Studer 2001]. For the early phases of ontology development the tool
MindManager was used to edit the ontologies because it better supports brain-
storming processes [see Section 3.2].
The Web Application part of SkiM allows employees to build their person-
alised intranet home pages by filling in the information categories given by tem-
plates.
Sesame from Aidministrator is an RDF/RDF Schema Storage and Retrieval
system [Broekstra et al. 2001]. Within SkiM Sesame stores the skills ontology as
RDF Schema and the instances of the ontology concepts, namely the association
of skills to employees, as RDF facts. It also stores any additional RDF annota-
509
Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
tions of the home pages which serve to characterise the content of the free text
fields. Sesame supports expressive querying of RDF schema and RDF facts by
means of a query engine for the RQL query language.
The query interface employs RDFferret [Davies et al. 2002] to do a combined
ontology-based and free text retrieval [see Section 4]. RDFferret combines full
text searching with querying RDF facts, in our case the skills data for each em-
ployee stored in Sesame as well as the additional annotations. Full text searching
is provided to offer high recall and coverage of unannotated information, while
precise ontological queries result in a high precision. Of course, a combination
of both query modes is possible.
3 SkiM as an Ontology-Based Approach
3.1 The Underlying Ontology
Within SkiM, three ontologies are defined - for skills, education, and job function.
At the moment, these ontologies are just taxonomies but will be extended to
include structured concepts in order to allow a more advanced functionality of
SkiM [see Section 5]. SkiM forces every skill, education or job description of
employees to be formulated by terms selected from the corresponding ontology.
We thus make sure that the terms used for describing skills, education or jobs
will match with query terms when SkiM users search for information. This will
guarantee a high recall and precision of the result sets. Moreover, the application
of ontologies is a prerequisite for comparing skills descriptions, for generating
a classification of the organisation’s knowledge, and for doing a so-called gap
analysis which identifies skills not sufficiently present in the organisation but
needed.
The skills ontology consists of three rather independent branches which corre-
spond to the three organisational units that were selected for the pilot phase, i.e.
IT, Private Insurance, HR [see Fig. 3, Informatik, Versicherung, HR-Personal].
The ontologies for education and job function are not divided into sub-domains
as the skills ontology. Currently, the skills ontology consists of 700 concepts,
the education ontology consists of 180 concepts, and the job function ontology
comprises 130 concepts.
The concept hierarchies are only that part of the underlying ontology which
a SkiM user sees. The complete ontology additionally includes concepts and
attributes to allow the connection between employees and their descriptions. An
OIL fragment that gives an impression of the whole ontology is shown in Fig. 4.
3.2 Ontology building
The development and maintenance of appropriate ontologies are the main chal-
lenges in building a Skills Management system. The manual ontology develop-
510 Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
Figure 3: Top levels of the Swiss Life skills ontology
ment can be characterised as an iterative, incremental and evaluative process.
In the beginning, we provided the domain experts with a simple top level ontol-
ogy to give a better understanding of the domain to be covered by the ontology.
According to an initial baseline methodology inspired by [Sure and Studer 2002]
we advised the experts to use simple but helpful design rules, such as reducing
the degree of branching by setting a maximum of 5 to 10 branches, or limiting
the maximum depth of the ontology. Then, domain experts independently filled
their specific domain area within this top level ontology.
Using the design rules resulted in an overall reduction of the concepts which
was a welcome side effect. In total, this step resulted in an ontology with more
than 1000 concepts, including many duplicates. We then discussed and freezed
511
Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
class-def Skills
slot-constraint HasSkillsLevel cardinality 1
slot-def HasSkills
domain Employee
range Skills
slot-def WorksInProject
domain Employee
range Project
inverse ProjectMembers
slot-def ManagementLevel
domain Employee
range one-of "member" "head-of-group" "head-of-dept" "CEO"
class-def Publishing
subclass-of Skills
class-def DocumentProcessing
subclass-of Skills
class-def DesktopPublishing
subclass-of Publishing and DocumentProcessing
instance-of GeorgeMiller Employee
related HasSkills GeorgeMiller DesktopPublishing3
instance-of DesktopPublishing3 DesktopPublishing
related hasSkillsLevel DesktopPublishing3 3
Figure 4: A glimpse of the whole ontology
the ontology layer by layer, thereby identifying and eliminating some semantic
duplicates in the ontology. Moreover, parts of the ontologies were restructured
and apparently missing concepts were added.
For the development process we chose the brainstorming and mind mapping
tool MindManager from Mindjet. We created concept hierarchies, reorganised
them using simple drag and drop mechanisms, and applied the export function
to make the ontology public on the web for review purposes. In addition, we
annotated ontology elements with symbols or short notes about decisions that
were made. For instance, a question mark denotes an open topic to be discussed,
while a tick stands for an approved part of the ontology [see Fig. 5]. For group
discussions we made large printouts of the ontologies and put them on the wall.
The group of developers could view the current state of the ontologies with the
meta data describing the state of the discussion. Then the unclarified points
of the ontology were discussed and the ontology was rearranged and completed
step by step. This approach to ontology development proved to be very successful
concerning the outcome, the time required and the satisfaction of the ontology
developers.
The iterative approach as sketched above makes it very difficult to get a
clear versioning of the ontologies. Since most of the decisions are an outcome of
a discussion, part of the changes never physically exist as a version of their own.
512 Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
Figure 5: Meta data for Ontology development (screen shot from MindManager)
It is also very hard to record the arguments that led to a decision without making
a detailed protocol of the discussion. As this is more or less impossible due to the
dynamic nature of the discussions, we only documented the result of a discussion
and the main arguments for the decisions but left out any intermediate parts of
the decision process.
While MindManager is an excellent tool to develop hierarchies in a cooper-
ative brainstorming process, it does not offer real editing functionality. It does
not check for duplicates in the ontology, relations can not be restricted in any
way (e.g. range, cardinality), nor does it distinguish between the identifier for
a concept and its representation. Such a distinction is a prerequisite for the
construction and maintenance of multi-lingual ontologies which are a basic re-
quirement in an international company, such as Swiss Life. All these features are
supported by the ontology editor OntoEdit [Sure and Studer 2001]. Therefore,
a combination of both tools might be close to a perfect ontology development
tool: MindManager for the early development phase while using OntoEdit for
extensions, maintenance, and versioning.
4 Querying Facilities
Searching for employees with certain skills can be done via their skills only, or
can be combined with search terms that aim at the other information categories
513
Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
of a personal home page, like education, special interests, projects worked in,
etc. Query terms for skills are enforced to be from the ontology.
To make sure that search terms are only evaluated in the proper information
category RDF annotations [Brickley and Guha 2000] are introduced in the home
pages so that for each term it is known to which category it belongs. We em-
ploy the search engine RDFferret from British Telecom [Krohn and Davies 2001]
which is capable of combining an ontology-based search (by interpreting RDF
facts) with a free text search. It also allows to confine search terms to certain
information categories of a home page by interpreting RDF statements in a web
page.
In order to achieve a match between search terms for skills with an employee’s
skills description, an up- or down-posting along the concept hierarchy is done.
The results are ranked according to the skills levels specified and the overall
degree of matching between a home page and the query.
5 Evaluation and Outlook
We are currently evaluating the existing version of SkiM in a pilot phase with 150
users. We found them to be very open to such a system and very willing to publish
their skills, provided their skills descriptions are publicly visible in the company.
Most users said that they would not participate if their skills would only be
seen by a few managers and a small group of people in the HR department.
This confirms our hypothesis that employees will voluntarily participate in such
a system if their personal benefit is a higher visibility in the company.
Many users complained that browsing the skills ontology is too cumbersome.
Thus, we will have to look into how to make the ontology better searchable.
We are currently discussing to introduce skills management on the corporate
level, i.e. with a visibility across all subsidiaries and branches of Swiss Life. In
that case we would need a multi-lingual skills ontology because otherwise many
people would feel uncomfortable in using a system with English terms only.
An approach complementary to ours is to identify people with certain skills
by doing text mining on the documents in the intranet [Becerra-Fernandez 2000,
McDonald and Ackerman 1998]. Adding such text analysis functionality to our
system would be ideal for generating suggestions for each employee to extend
his or her skills descriptions, and thus to make sure that skills descriptions once
delivered stay up-to-date.
Acknowledgements
This work has been partially supported by the European Commission research
project On–To–Knowledge (IST-1999-10132), and by the Swiss Federal Office
514 Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
for Education and Science (project number BBW 99.0174). The SkiM system
was initiated and brought into existence by our former colleague Bernd Novotny.
References
[Ackerman et al. 1999] Ackerman, M. S., McDonald, D., Lutters, W., and Marumatsu,
J. (1999). Recommenders for expertise management. In Workshop on Recom-
mender Systems: Algorithms and Evaluation at SIGIR ’99.
[Auer 2000] Auer, T. (2000). Wissens-Sicherung im Kontext mit der Personal-
Entwicklung. Schweizer Arbeitgeber, 10.
[Becerra-Fernandez 2000] Becerra-Fernandez, I. (2000). Facilitating the online search
of experts at NASA using Expert Seeker People-Finder. In Reimer, U., editor, Proc.
of the Third Int. Conf. on Practical Aspects of Knowledge Management PAKM
2000.
[Brickley and Guha 2000] Brickley, D. and Guha, R. (2000). Resource description
framework (RDF) schema specification 1.0 W3C candidate recommendation 27
march 2000. http://www.w3.org/TR/2000/CR-rdf-schema-20000327.
[Broekstra et al. 2001] Broekstra, J., Kampman, A., and van Harmelen, F. (2001).
Sesame: An architecture for storing and querying RDF data and schema informa-
tion. In D. Fensel, J. Hendler, H. L. and Wahlster, W., editors, Semantics for the
WWW. MIT Press.
[Davies et al. 2002] Davies, N., Duke, A., Krohn, U., and Weeks, R. (2002). RDF-
Ferret: Search technology for the semantic web. In Davies, N., Fensel, D., and
van Harmelen, F., editors, Ontology-driven Knowledge Management: Exploiting the
Semantic Web. Wiley. to appear.
[Deiters et al. 2000] Deiters, W., Lucas, R., and Weber, T. (2000). Skill-Management:
ein Baustein f¨ur das Management flexibler Teams. Information Management &
Consulting, 15(3):54–60.
[Krohn and Davies 2001] Krohn, U. and Davies, J. (2001). The search facility rdfferret.
Technical Report Deliverable 11, On–To–Knowledge, EU Project IST–1999–10132.
[Liao et al. 1999] Liao, M., Hinkelmann, K., Abecker, A., and Sintek, M. (1999). A
competence knowledge base system for the organisational memory. In Puppe, F.,
editor, XPS-99: Knowledge-Based Systems - Survey and Future Directions,volume
1570 of LNAI, pages 125–137. Springer Verlag.
[McDonald and Ackerman 1998] McDonald, D. and Ackerman, M. S. (1998). Just talk
to me: A field study of expertise location. In Proc. of the 1998 ACM Conf. on
Computer Supported Cooperative Work (CSCW’98).
[Sure et al. 2000] Sure, Y., Maedche, A., and Staab, S. (2000). Leveraging corporate
skill knowledge - from ProPer to OntoProper. In Reimer, U., editor, Proc.ofthe
Third Int. Conf. on Practical Aspects of Knowledge Management PAKM 2000.
[Sure and Studer 2001] Sure, Y. and Studer, R. (2001). On-to-knowledge ontoedit.
Technical Report Deliverable 3, On–To–Knowledge, EU Project IST–1999–10132.
[Sure and Studer 2002] Sure, Y. and Studer, R. (2002). On-to-knowledge methodol-
ogy. In Davies, N., Fensel, D., and van Harmelen, F., editors, Ontology-driven
Knowledge Management: Exploiting the Semantic Web. Wiley. to appear.
[Taubner and Br¨ossler 2000] Taubner, D. and Br¨ossler (2000). The people make the
project. Pro ject control: The human factor. In Proceedings of ES COM -SCOP E
2000, pages 105–113.
[Younker 1998] Younker, E. (1998). Skills management: The linchpin for IT work force
management. InSide GartnerGroup, pages 2–4.
515
Reich J.R., Brockhausen P., Lau T., Reimer U.: Ontology-Based Skills ...
... Competence evaluation is an action that relates to the process of measuring the capabilities of individuals within both academic and professional spheres. From the point of view of the organization, individual competencies such as knowledge, skill, personality traits, "the most important resources of a company for solution to knowledge of challenging tasks such as decision making, strategic planning or creative design" [16]. These individual competencies (e.g., all employees) may not always be explicit. ...
... The availability and scope of each employee's empowerment can be the process of appreciation as explicit, making it "easier to find out what people know or direct the needed people to the right ones they know. Such sharing of information will increase organizational productivity as well as individual performance" [16]. ...
Conference Paper
Full-text available
Abstract— The need for knowledge management in the BIM environment has been finalized by a proposal of taxonomy, including the structure and form of a proposal describing the competencies of individuals, teams, groups and organizations. It has shown that the basic output of the current investigations is the need to consolidate the knowledge structure in the BIM environment. On the basis of further research of the literature, organizational behavior and individual education schemes, several matrix enumerations describing the general form of human beings as knowledge bearers and derived competences were created as a necessary prerequisite for all activities related to the manipulation of knowledge. Therefore descriptions of the competence of individuals in the form of competencies how to use the appropriate knowledge have also been identified.
... Competency assessment is an action referring to the process of measuring the abilities of individuals within both professional and academic settings. From an organisational perspective, individual competenciesknowledge, skill and personal traitsare the "most important resources of a company for solving knowledge-intensive tasks such as decision-making, strategic planning, or creative design" ( [72], page 506). These individual competenciesof employees for examplemay not be always explicit. ...
... Through assessment, the availability and extent of an employee's competency can be made explicit, rendering it "easier to find out what people know or to direct people to others who can be of help. This sharing of information improves the organisational productivity as well as the individual performance" ( [72], page 507). Fig. 10 below demonstrates how competency items can be used to measure Individual BIM competencies through a dedicated online assessment tool. ...
... In addition, organisations may also need to conduct a skills audit or skill gap analysis. A skill gap analysis is a process used to identify the skills that are needed in a specific job or industry and to compare those needs to the skills that are currently possessed by workers in that field (Hay, 2003;Reich et al., 2002). This analysis can identify any gaps or discrepancies between the skills required for a job and the skills that workers currently have and can help organisations and individuals make decisions about training and development. ...
Article
Full-text available
Aim/Purpose This paper aims to investigate the recent developments in research and practice on the transformation of professional skills by artificial intelligence (AI) and to identify solutions to the challenges that arise. Background The implementation of AI in various organisational sectors has the potential to automate tasks that are currently performed by humans or to reduce cognitive workload. While this can lead to increased productivity and efficiency, these rapid changes have significant implications for organisations and workers, as AI can also be perceived as leading to job losses. Successfully adapting to this transformation will lead companies and institutions to new working and organisational models, which requires implementing measures and strategies to upskill or reskill workers. Organisations, therefore, face considerable challenges such as guiding employees towards the change process, dealing with the cost of training, and ensuring fairness and inclusion posed by age, gender, and cultural diversity. Methodology A narrative review has been conducted to analyse research and practice on the impact of AI on human skills in organisations. Contribution This work contributes to the body of knowledge by examining recent trends in research and practice on how AI will transform professional skills and workplaces, highlighting the crucial role played by transversal skills and identifying strategies that can support organisations and guide workers toward the upskilling and reskilling challenges. Findings This work found that introducing AI in organisations combines many organisational strategies simultaneously. First, it is critical to map the transversal skills needed by workers to mitigate the current skills gap within the workplace. Secondly, organisations can help workers identify the skills required for AI adoption, improve current skills, and develop new skills. In addition, the findings show that companies need to implement processes to support workers by providing ad hoc training and development opportunities to ensure that workers’ attitudes and mental models towards AI are open and ready for the changing labour market and its related challenges. Recommendation for Researchers AI is a complex and multifaceted field that encompasses a wide range of disciplines, including computer science, mathematics, engineering, and behavioural and social sciences. Researchers should take a transdisciplinary approach to enable the integration of knowledge and perspectives from different fields that are essential to understanding the full range of implications and applications of AI. Future Research Further research is needed to understand the impact of AI on human skills and the role of soft skills in the adoption of AI in organisations. Future studies should also consider the challenges presented by Industry 5.0, which is likely to involve the integration of new technologies and automation on an even greater scale.
... However, methods calculating weights from participants' votes are sometimes used in these studies. Skills Management [13], which was proposed by Reimer, Business Operation Systems, and diffused the idea called Know-Who, uses text information such as text on home pages and participants' votes for extracting some persons with skills in an organization. Iwakura and Tsuda studied Know-Who and extracted social networks from peoples' schedules such as information about meetings and relations such as co-authoring reports in an organization [14]. ...
Article
Full-text available
1 Abstract To activate knowledge creation and improve organizational memories in knowledge work as organizational knowledge management, it is important to find key persons from among participants and evaluate their respective contributions. Nevertheless, it has been difficult to analyze the semantic content of comments automatically. This paper presents a method to evaluate participants' contributions to knowledge creation and to identify key persons by analyzing semantic structures that are explicitly represented in terms of discourse and dialogue relations in semantic-authoring-based electronic meetings. This method enables us to discover appropriate key persons by calculating participants' contributions in the records of actual knowledge-creation activity. 2 Introduction From the perspective of knowledge management, continuous improvement of computer-accessible knowledge enables us to activate organizational knowledge creation. These days, organizational knowledge activity, including knowledge work and decision-making in groups, has been performed using internet tools such as web chat, bulletin boards, and intra-company weblogs. Knowledge activity in groups is employed mainly for two reasons [1]. One reason is the expectation that more ideas are obtained from group discussions than from individual deliberations. The other reason is the notion that democratic decisions arise from group discussions. To update or renew knowledge in organizations, it is important to evaluate partici-pants' contributions to activities of creating and improving knowledge in discussions as knowledge activities. Consequently, to activate knowledge creation and improve organiza-tional memory, it is important to discover key persons and to evaluate their contributions. In fact, automatic detection of key persons and analyses of the semantic content of their comments have been difficult. In practice, to calculate the weight of terms, participants have been evaluated using traditional methods of text mining that use co-occurrence in-formation and TF-IDF based on partial information such as the number of comments or reference relations [2]. Nevertheless, we cannot appropriately evaluate participants' con-tributions to knowledge creation because these methods do not use semantic structures of discussion.
Chapter
We introduce a new framework for fast and effective knowledge state assessments in the context of personalized, skill-based online learning. We use knowledge state networks – specific neural networks trained on assessment data of previous learners – to predict the full knowledge state of other learners from only partial information about their skills. In combination with a matching assessment strategy for asking discriminative questions we demonstrate that our approach leads to a significant speed-up of the assessment process – in terms of the necessary number of assessment questions – in comparison to standard assessment designs. In practice, the methods enable personalized, skill-based online learning also for skill ontologies of fine granularity without deteriorating the associated learning experience by a lengthy assessment process.
Preprint
The goal of this paper is to introduce a new framework for fast and effective knowledge state assessments in the context of personalized, skill-based online learning. We use knowledge state networks - specific neural networks trained on assessment data of previous learners - to predict the full knowledge state of other learners from only partial information about their skills. In combination with a matching assessment strategy for asking discriminative questions we demonstrate that our approach leads to a significant speed-up of the assessment process - in terms of the necessary number of assessment questions - in comparison to standard assessment designs. In practice, the presented methods enable personalized, skill-based online learning also for skill ontologies of very fine granularity without deteriorating the associated learning experience by a lengthy assessment process.
Chapter
The synergies between ontology management, competency management, and e-learning have been explored during recent years both on theoretical and practical levels. This chapter describes the architecture, design, and deployment of a system that integrates ontologies with competency management and e-learning, as well as with other human resources functions. Moreover, a detailed description of the supportive methodology and the main lessons learned in technical and organisational areas are presented. This system currently is being deployed for research purposes in a national subsidiary of Microsoft, the information technology (IT) services multinational firm. The objective of this chapter is to provide the reader with an overview of the key concepts in competency-based management, a non-technical methodology for supporting the effective deployment of an ontology-based competency management system and an analysis of the lessons learned during the first deployment phase.
Article
Although many developments have been made in the design and development of learning object repositories (LORs), the efficient use of such systems is still questionable. Without realising the functional use of such systems or considering the involvement of their dynamic users, these systems would probably become obsolete. This study includes both qualitative and quantitative research methods for the investigation of prospective teachers' views on the operational aspects of such tools. The participants in this study were 75 prospective teachers that were participating in the graduate certification programme for secondary school subject teachers at Baskent University in Turkey. To realise the objectives of this study, prospective teachers were required to use the 17 of the existing LORs in their course. Analysis was also conducted on those LORs identified by the researchers. Afterwards, teachers were asked to answer an open-ended question in paper and pencil form. Through qualitative analysis, the responses of teachers were coded and presented in a table. The results of this analysis revealed many interesting points regarding teachers' thoughts on the main factors in repositories and are expected to guide the designers, developers and users of LORs to focus on the main issues related to the improvement of functionality and efficiency of such systems. What is already known about this topic What this paper adds Implications for practice and/or policy
Article
This paper describes the initial development of an HRM system that aims to decrease the gap between higher vocational education and the labour market for a specific job in the ICT sector. This paper focuses specifically on the delineation of a process model and the selection of a suitable job role (information system analyst) that is valid across organisational and cultural boundaries. The process model implies various applied uses of this ontology-based system, including mapping qualifications in vocational education to current and valid job roles, testing and evaluating the student applicant on the basis of labour market driven competencies, and providing ad-hoc support to educational institutions by elucidating the weaknesses of particular VET curricula.
Thesis
Full-text available
Building Information Modelling (BIM) is a set of technologies, processes and policies enabling multiple stakeholders to collaboratively design, construct and operate a facility. There are numerous challenges attributed to BIM adoption by industry and academia. These represent a number of knowledge gaps each warranting a focused investigation by domain researchers. This study does not isolate a single gap to address but espouses a holistic view of the knowledge problem at hand. It contributes to the discussion a set of conceptual constructs that clarify the knowledge structures underlying the BIM domain. It also introduces a number of practicable knowledge tools to facilitate BIM learning, assessment and performance improvement. This study is delivered through complementary papers and appendices to answer two primary research questions. The first explores the knowledge structures underlying the BIM domain whilst the second probes how these knowledge structures can be used to facilitate the measurement and improvement of BIM performance across the construction industry. To address the first question, the study identifies conceptual clusters underlying the BIM domain, develops descriptive taxonomies of these clusters, exposes some of their conceptual relationships, and then delivers a representative BIM framework. The BIM framework is composed of three-axes which represent the main knowledge structures underlying the BIM domain and support the development of functional conceptual models. To address the second question, BIM framework structures are extended through additional concepts and tools to facilitate BIM performance assessment and development of individuals, organizations and teams. These additional concepts include competency sets, assessment workflows and measurement tools which can be used to assess and improve the BIM performance of industry stakeholders. In addressing these research questions, a pragmatic approach to research design based on available literature and applicable theories has been adopted. By combining several research strategies, paradigms and methods, this study (1) generates several new conceptual structures (e.g. frameworks, models and taxonomies) which collectively clarify the knowledge structures underlying the BIM domain; and (2) develops a set of workflows and tools that facilitate BIM assessment, learning and performance improvement. This study delivers an extendable knowledge structure upon which to build a host of BIM performance improvement initiatives and tools. As a set of complementary papers and appendices, the study presents a rich, unified yet multi-layered environment of conceptual constructs and practicable tools; supported by a common framework, a domain ontology and simplified visual representations. Individually, each paper introduces a new framework part or solidifies a previous one. Collectively, the papers form a cohesive knowledge engine that generates assessment systems, learning modules and performance improvement tools.
Conference Paper
Full-text available
Skill management systems serve as technical platforms for mostly, though not exclusively, corporate-internal market places for skills and know-how. The systems are typically built on top of a database that contains profiles of employees and applicants. Thus, the skills may be retrieved through database queries. However, these approaches incur two major problems, viz. the finding of approximate matches and the maintenance of skill data. In this paper we describe two systems that leverage corporate skill knowledge by offering advanced means for both. We present ProPer that uses means from decision theory to allow for compensate skill matching. Then, we describe OntoProPer that combines these methods with intelligent means for inferencing of skill data. For the latter an ontology provides background knowledge, i.e. conceptual structures and rules, which supplement the skill database with ground and inferred facts from secondary information, such as project documents. These suppl...
Article
Full-text available
RDF and RDF Schema provide the first W3C standard to enrich the Web with machine-processable semantic data. However, to be able to use this semantic data, a scalable, persistent RDF store and a powerful query engine using an expressive query language are needed. Sesame is an extensible architecture implementing both of these. Sesame can be based on arbitrary repositories, ranging from traditional Data Base Management Systems, to dedicated RDF triple stores. Sesame also implements a query engine for RQL, the most powerful RDF/RDF Schema query language to date. 1
Article
Everyday, people in organizations must solve their problems to get their work accomplished. To do so, they often must find others with knowledge and information. Systems that assist users with finding such expertise are increasingly interesting to organizations and scientific communities. But, as we begin to design and construct such systems, it is important to determine what we are attempting to augment. Accordingly, we conducted a five-month field study of a medium-sized software firm. We found the participants use complex, iterative behaviors to minimize the number of possible expertise sources, while at the same time, provide a high possibility of garnering the necessary expertise. We briefly consider the design implications of the identification, selection, and escalation behaviors found during our field study. Keywords Expertise networks, knowledge networks, computermediated communications, expert locators, expertise location, expertise finding, information seeking, CSCW, compu...
Article
This deliverable is the final version of the OTK methodology. Core contributions of this document are: (i) An overview of the On-To-Knowledge building blocks and their relationships, (ii) a methodology for introducing and maintaining ontology based knowledge management solutions into enterprises with a focus on Knowledge Processes and Knowledge Meta Processes and, last but not least, (iii) the illustration of process steps by examples and lessons learned derived from applying the OTK tool suite in the OTK case studies according to the methodology.
Article
Skill management systems serve as technical platforms for mostly, though not exclusively, corporate-internal market places for skills and know-how. The systems are typically built on top of a database that contains profiles of employees and applicants. Thus, the skills may be retrieved through database queries. However, these approaches incur two major problems, viz. the finding of approximate matches and the maintenance of skill data. In this paper we describe two systems that leverage corporate skill knowledge by offering advanced means for both. We present ProPer that uses means from decision theory to allow for compensate skill matching. Then, we describe OntoProPer that combines these methods with intelligent means for inferencing of skill data. For the latter an ontology provides background knowledge, i.e.
On-to-knowledge ontoedit
  • R Studer
[Sure and Studer 2001] Sure, Y. and Studer, R. (2001). On-to-knowledge ontoedit. Technical Report Deliverable 3, On–To–Knowledge, EU Project IST–1999–10132.
The search facility rdfferret
  • U Krohn
  • J Davies
[Krohn and Davies 2001] Krohn, U. and Davies, J. (2001). The search facility rdfferret. Technical Report Deliverable 11, On–To–Knowledge, EU Project IST–1999–10132.