Jozo J. Dujmović

San Francisco State University | SFSU · Department of Computer Science

Computing the COVID-19 vaccination priority is an urgent and ubiquitous decision problem. In this paper we propose a solution of this problem using the Logic Scoring of Preference (LSP) evaluation method. Our goal is to develop a justifiable and explainable quantitative criterion for computing a vaccination priority degree for each individual in a...

In this paper we introduce andness-directed iterative OWA aggregators. Iterative OWA aggregators belong to the family of OWA aggregators, where the aggregated value of additive aggregators is a scalar product of the sorted vector of arguments and the vector of logic weights that determine conjunctive or disjunctive properties of OWA aggregators. Th...

The goal of this paper is to investigate similarities between andness-directed graded logic aggregators. Our analysis is based on idempotent soft disjunctive aggregators because the differences between hard aggregators are provably smaller. We propose three difference indicators and use them to compare three popular andness-directed aggregators: we...

In a big data context, data often originate from various unreliable sources and cannot be considered perfect. Data veracity denotes the overall confidence we have in the data and clearly has an impact on the results of querying and decision making processes. In this paper, we study the impact of data veracity on criterion handling and propose a nov...

Urban Densification Suitability Analysis (UDSA) approach has been proposed using the GIS-based Logic Scoring of Preference (LSP) decision method. Our goal is to provide the methodology for the evaluation of suitability of locations for high density urban development to facilitate the spatial decision-making process and help justifiable urban planni...

Applications, as, for example, decision support systems, need to combine information. The functions that permit to combine a set of numerical values into their single representative are called aggregation operators. They go from simple and well-known functions, as the arithmetic mean, to more sophisticated and complex, as fuzzy integrals. In the co...

This research study extends the Logic Scoring of Preference (LSP) as a general multicriteria evaluation (MCE) method by presenting and evaluating a new GIS.LSP method and software tool implemented within the geographic information systems (GIS) environment. For the evaluation and validation of the method and software tool, we describe a case study...

Computing the COVID-19 vaccination priority is an urgent and ubiquitous decision problem. In this paper we propose a solution of this problem using the LSP evaluation method. Our goal is to develop a justifiable and explainable quantitative criterion for computing a vaccination priority degree for each individual in a population. Performing vaccina...

Logic aggregators are all aggregators characterized by andness/orness. In this paper we present necessary properties of logic aggregators and use them to compare major implementations of andness‐characterized aggregators: means, t‐norms/conorms, ordered weighted average family, fuzzy integrals, and graded conjunction/disjunction. Our goal is to pro...

The goal of this paper is to present a methodology for professional evaluation, comparison and selection of alternatives in conservation planning and related areas. Our decision methodology is based on soft computing and consistent with observable properties of human reasoning. Main topics that we cover include the presentation of the LSP (Logic Sc...

We present the soft computing graded logic (GL) as a mathematical infrastructure for a soft computing propositional calculus, and GL aggregation. The GL aggregation of degrees of truth (or fuzzy membership) is a crucial component of complex criterion functions used in decision support systems. In the context of GL we propose aggregation functions t...

Intuitive evaluation is performed in the background of rational decisions in everyday life. The decision maker (DM) selects the most appropriate alternative according to an adequate evaluation and selection criterion. The consistency with the intuitive evaluation process is a necessary condition that each quantitative evaluation method must satisfy...

This chapter lists some applications of the Logic Scoring of Preference (LSP) method. It presents quantitative models for evaluation of disease severity and patient disability using the LSP method. The basic idea is that the LSP method can be used to evaluate medical conditions using general medical criteria, and to customize them according to need...

This chapter introduces graded logic (GL) as a system of realistic models of observable properties of human aggregation reasoning. It presents a survey of classical bivalent Boolean logic and introduces evaluation logic as a weighted compensative generalization of the classical Boolean logic. The chapter identifies and analyzes the characteristic p...

The evaluation process can be denoted as professional if the evaluated systems have substantial complexity and require professional domain expertise to specify the structure and parameters of Logic Scoring of Preference (LSP) evaluation criteria. Elementary attribute criteria generate attribute suitability scores for all attributes of an evaluated...

Multicriteria Evaluation (MCE) is a commonly used approach for creating suitability maps in a raster-based Geographic Information System (GIS) computing environment. MCE aggregation can be performed by a linear additive model known as the Weighted Linear Combination (WLC) or Simple Additive Scoring. The WLC uses normalized weights that allow decisi...

Frequency-based probabilistic models are suitable for the quantitative characterization and analysis of repetitive events. Quantitative models based on the concept of fuzzy set can be applied both in the case of repetitive events and in cases where frequency-based probabilistic models are not appropriate. In the case of repetitive events there is a...

A need exists for expanding agricultural lands due to increased demand for food production and security. Some regions can convert available land to agricultural land use. To evaluate available land for future agricultural production, geographic information systems (GIS) and GIS-based multicriteria evaluation (MCE) methods can be used to identify la...

The growth of urban areas and industrial intensification has contributed to a reduction in valuable agricultural lands and to various environmental impacts including climate change. This reduction in agricultural land severely impacts food production and food security. In order to effectively address this issue, spatial analytical and optimization...

Naturally dealing with information processing tasks such as database querying, information retrieval, and decision support requires the adequate handling of bipolarity that might be present in the specification of user preferences in selection criteria. Indeed, past and recent research revealed that users often express their preferences for criteri...

We propose weighted aggregation algorithms for creating general idempotent weighted aggregators of n variables derived from related symmetric idempotent aggregators of two variables. This computational method, together with interpolative aggregation, can be used for the development of general idempotent logic aggregators that satisfy a variety of c...

Evaluation, comparison, and selection of software products are frequent decision problems. Soft computing offers efficient methodology for solving such problems. Our evaluation models are based on the Logic Scoring of Preference (LSP) method for system evaluation. We present an overview of the LSP method, and techniques for building evaluation crit...

Averaging aggregation functions are valuable in building decision making and fuzzy logic systems and in handling uncertainty. Some interesting classes of averages are bivariate and not easily extended to the multivariate case. We propose a generic method for extending bivariate symmetric means to n-variate weighted means by recursively applying the...

The threshold andness is a border between soft and hard partial conjunction (similarly, the threshold orness is a border between soft and hard partial disjunction). This paper presents a weighted compensative logic based on aggregators that use adjustable threshold andness and orness. The adjustability of threshold andness/orness is a new degree of...

The Logic Scoring of Preference (LSP) is a general multicriteria decision-making method with origins in soft computing and fuzzy reasoning. It allows the nonlinear aggregation of a large number of input criteria without the loss of significance typical for additive GIS-based MCE methods. The objective of this study is to integrate the LSP method wi...

This paper investigates the structure and properties of interpolative generalized conjunction/disjunction (GCD) aggregators. The main advantage of interpolative aggregators is the possibility to include suitable properties and to exclude inconvenient properties of aggregators. Using this method we can create new forms of logic aggregators by interp...

In this paper we present a decision support system that uses soft computing models for evaluation, selection and pricing of homes. The system (called LSPhome) is based on the Logic Scoring of Preference (LSP) evaluation method and implemented in the context of online real estate. The goal of this system is to use weighted compensative logic models...

Full exploration of databases requires advanced querying facilities. This is especially the case if user preferences related to expected results are complex. Traditional query languages like SQL and OQL only have limited facilities for expressing query criteria that are composed of simple criteria. So, while searching for information, users often h...

In this paper, we investigate properties of aggregation operators that are necessary to create mathematical models that are consistent with observable properties of human reasoning. Such models are required in many applications where mathematical modeling is used to suggest a justifiable decision and a subsequent course of action. No decision can b...

Traditional query languages like SQL and OQL use a so-called WHERE clause to extract only those database records that fulfil a specified condition. Conditions can be simple or be composed of conditions that are connected through logical operators. Flexible querying approaches, among others, generalized this concept by allowing more flexible user pr...

Multi-criteria decision making has a lot of things in common with database querying. In this paper we study and compare the logic scoring of preference (LSP) soft computing technique for multi-criteria decision support and of the handling of selection criteria in ‘fuzzy’ querying of regular relational databases. Furthermore, we investigate the need...

Aggregation of continuous logic variables or degrees of fuzzy membership using soft computing aggregation models assumes the availability of all input data. Unfortunately, in many applications some inputs are missing. In this paper we propose an aggregation process that tolerates missing data. The aggregation process is implemented in the context o...

Formal concept analysis is a lattice-theoretic framework devised for the extraction of knowledge from Boolean data tables. A possibility-theoretic view of formal concept analysis has been recently introduced, and in particular set-valued counterparts ...

This paper investigates basic semantic aspects of evaluation logic. We propose a verbalized approach to the design and use of the Generalized Conjunction/disjunction (GCD) aggregators. The main goals of verbalized approach are to help in specifying semantic components of GCD, and to facilitate the use of soft computing evaluation logic and correspo...

Software evaluation is the problem of determining the extent to which a software product satisfies a set of requirements. We create quantitative models for software evaluation using a general system evaluation method called LSP (Logic Scoring of Preference). In this paper we define and classify software evaluation problems, overview the LSP method,...

In this paper, we present a systematic evaluation of the most popular SPEC benchmark suites. Our goal is to show that SPEC component-level benchmarks need to be evaluated from the standpoint of redundancy and completeness, and that such procedures can be efficiently used for tuning of existing benchmark suites and reducing the cost of benchmarking.

In this paper, we identify and describe fundamental logic properties of multicriteria methods for land-use suitability analysis and the design of suitability maps. The existing multicriteria methods can be evaluated from the standpoint of their ability to support the necessary logic properties that affect the expressive power of evaluation methods....

LSP suitability maps support geographic decision making by providing an efficient framework for evaluating mul-tiple attributes, aggregating the evaluation results, and creating a map that graphically represents the overall suitability of locations for a given purpose. In this paper, we consider elementary LSP suitability map criteria for evaluatin...

State-of-the-art strategic mitigation efforts involve careful measurement of the likely benefits derived from a project and careful selection of the funded projects to ensure a cost-efficient outcome that delivers high quality results. This paper discusses how the Logic Scoring of Preference (LSP) and optimization can be integrated in a way that...

In this paper, we propose a benchmarking technique and performance indicators that can be used to evaluate and compare programming languages and language processors in the area of efficiency of array processing. The proposed subscript permutation technique is used to develop a matrix multiplication benchmark (MMB). MMB is used to evaluate language...

In this paper we investigate the effects of using LSP logic aggregators in spatially-explicit suitability maps and compare logic aggregation with aggregation based on aggregators that use fixed andness. In particular, we analyze differences between the LSP aggregators and the additive aggregators that are currently predominant in GIS suitability ma...

Spatial Decision Support Systems (SDSS) are interactive, computer-based systems, designed to support decision makers in achieving a higher effectiveness of decision making while solving a semi-structured spatial decision problem. Current spatial decision support techniques are predominantly based on boolean logic, which makes their expressive power...

In this paper, we propose the concept of logically aggregated geographic suitability maps (LSP-maps). The goal of LSP-maps is to provide specialized maps of the suitability degree of a selected geographic region for a specific purpose. There is a wide spectrum of purposes which include suitability for industrial development, agriculture, housing, e...

In this tutorial, we describe techniques for automatic generation of benchmark and test workloads. Generated programs have adjustable parameters that are used to select the program size and structure, as well as the relative frequencies of basic operations (or program modules) that characterize the workload.

In decision making, it is sometimes more appropriate to express what has to be rejected rather than what is permitted. Moreover, permitted and rejected cases do not necessarily have to mirror each other, which is called heterogeneous bipolarity. To efficiently deal with heterogeneous bipolarity in decision making, a new bipolar criteria satisfactio...

In this paper we investigate properties of multicriteria methods that are used for building land-use suitability assessment criteria. We identify and describe fundamental properties that are of interest in the land-use suitability analysis and the design of suitability maps. The existing multicriteria methods can be evaluated from the standpoint of...

In this paper we propose the concept of logically aggregated geographic suitability maps (S-maps). The goal of S-maps is to provide specialized maps of the suitability degree of a selected geographic region for a specific purpose. There is a wide spectrum of purposes which include suitability for industrial development, agriculture, housing, educat...

In this paper we investigate seven special cases and nine characteristic forms of generalized conjunction/disjunction. They include the concepts of hard and soft partial conjunction and hard and soft partial disjunction, and their combinations. We analyze the threshold values of andness and orness that define the border between the hard and soft pa...

For many people faced with a tough purchasing decision, the research tool of choice is a web browser. Search engines solve the general problem of finding relevant data, however it is up to the user to sort, filter, and evaluate it. Decision support methods such as LSP can turn raw data into formal evaluations, but they are generally disconnected fr...

In this paper, we investigate mathematical models that are suitable for modeling decisions in the area of system evaluation, comparison, and selection. Our interest is focused on soft computing models that can be directly related to observable properties of human reasoning, and have a record of use in system evaluation practice. We analyze various...

The generalized conjunction/disjunction function (GCD) is a continuous logic function of two or more variables that integrates conjunctive and disjunctive properties in a single function. It is used as a mathematical model of simultaneity and replaceability of inputs. Special cases of this function include the full (pure) conjunction, the partial c...

The goal of this paper is to investigate fundamental properties of local andness/orness. We analyze the distribution of local andness/orness in the unit hypercube from the standpoint of usability of these indicators in decision models.

Choosing among options and selecting the best alternative is a fundamental component of human decision-making. The best alternative is the result of a mental process called system evaluation. The evaluated system can be any collection of interrelated components. The system as a whole and its components are expected to have some desired features and...

In this paper we propose a quantitative model for evaluation and selection of integrated development environments (IDEs) for Java enterprise applications. Our goal is to determine the extent to which major IDEs satisfy typical software developer requirements. Our evaluation model is based on the Logic Scoring of Preference (LSP) method for system e...

We present a comprehensive model for quantitative evaluation and comparison of search engines. The model is based on the LSP method for system evaluation. The basic contribution of our approach is the aggregation of all relevant attributes that reflect functionality, usability, and performance of search engines. In this respect our model is fully c...

The goal of this paper is to present all major forms of andness/orness. We analyze fundamental properties of nine indicators of andness/orness and compare them from the standpoint of their computational properties and usability in decision models.

We investigate the accuracy of parameters in the Logic Scoring of Preference (LSP) criterion functions for system evaluation. Main parameters are weights and conjunction/disjunction degrees (andness/orness). Weights reflect the level of relative importance of various decision variables. Andness/orness describes a desired level of simultaneity/repla...

We analyze the reliability of results obtained using the Logic Scoring of Preference (LSP) method for evaluation and comparison of complex systems. For each pair of competitive systems our goal is to compute the level of confidence in system ranking. The confidence is defined as the probability that the system ranking remains unchanged regardless o...

In this paper we investigate the use of ternary diagrams for visualization of Java workloads, and show how to use this technique for an analysis of JVM98 SPEC benchmarks. Ternary diagrams present workloads as points in plane with respect to three characterization parameters. They can be combined with other visualization techniques based on dendrogr...

The partial conjunction/disjunction function (PCD) integrates conjunctive and disjunctive features in a single function. Special cases of this function include the pure conjunction, the pure disjunction, and the arithmetic mean. PCD enables a continuous transition from the pure conjunction to the pure disjunction, using a parameter that specifies a...

In this paper we propose a quantitative model for evaluation and selection of Integrated Development Environments (IDE's) for Java enterprise applications. Our goal is to determine the extent to which major IDE's satisfy typical software developer requirements. Our evaluation model is based on the Logic Scoring of Preference (LSP) method for system...

This paper presents NPME/NT, a tool for performance measurement of networks that work under the Windows NT operating system. The tool is organized as a network performance measurement environment (NPME) that includes a network workload generator, and a control system that automatically distributes the workload to each node of the network and genera...

In this paper we discuss Software Quality Assurance (SQA) issues in the environment of an information system project, based on rapid evolutionary prototyping. The information system project provides a specialized software support for a sophisticated human resources management system in educational departments of Argentine provinces. This paper pres...

In this paper, we present the DCSP (distributed client/server pair) benchmark, a network benchmark used as a basic component of a network performance measurement environment for Unix platforms. The network workload consists of distributed client/server pairs which perform a cyclic data transfer. This workload is scalable and can be used to evaluate...

We present theoretical concepts, design, and use of universal benchmark suites. Such suites consist of benchmark programs that represent all relevant characteristic types of workload. The execution times of individual benchmarks and appropriate weights can be used to compute global performance indicators that reflect a spectrum of specific compound...

In this paper we present black-box models of workload difference and use them to develop quantitative methods for the design of benchmark suites. The proposed design methods (the method of optimum subsets, and the method of optimum weights) combine a new concept of program space coverage functions, and the criteria of completeness, redundancy, dens...

INTRODUCTION Benchmark suites are most frequently designed for industrial evaluation of competitive computer systems and networks. Examples of such benchmark suites include SPEC, TPC, GPC, PERFECT Club Benchmarks, AIM benchmarks, and others. In addition to benchmark suites sponsored by consortia of computer industry there are various collections of...

This paper presents the Logic Scoring of Preference (LSP) - a general quantitative decision method for evaluation, comparison, and selection of complex hardware and software systems. The LSP method is a generalization and an extension of various scoring techniques. Its mathematical background is a continuous preference logic. An extensive software...

We present a method for quantitative evaluation of SPEC benchmarks. The method is used for the analysis of three generations of SPEC component-level benchmarks: SPEC89, SPEC92, and SPEC95. Our approach is suitable for studying (1) the redundancy between individual benchmark programs, (2) the size, completeness, density and granularity of benchmark...

We present a quantitative method for selecting optimum configurations of computer systems. For each configuration we specify a set of requirements reflecting user's needs. The level of satisfaction of requirements is called the global preference score. Using this indicator and the total cost of each configuration we solve the following optimiz...

We present a method for quantitative evaluation of SPEC benchmarks. The method is used for the analysis of three generations of SPEC component-level benchmarks: SPEC89, SPEC92, and SPEC95. Our approach is suitable for studying (1) the redundancy between individual benchmark programs, (2) the size, completeness, density and granularity of benchmark...

We present black-box models of workload difference and we then to develop quantitative methods for the design of benchmark suites. The proposed design methods (the method of optimum subsets, and the method of optimum weights) combine a new concept of program space coverage functions, and the criteria of completeness, redundancy, density, and granul...

We have developed a scalable network traffic generator and a general computer network benchmark for Unix platforms. This benchmark can be used to evaluate performance of user-level applications which interface directly with the transport layer of TCP/IP running on all types of computer networks. The network workload consists of distributed client/s...

This book is a short, complete summary of the most important approaches to performance measurements of database systems and transaction processing systems. It is intended to serve as a tutorial for the novice and a reference for the professional. Included are contributions by ten authors: Dina Bitton, Rick Cattell, David DeWitt, Jim Gray, Neal Nels...

In this paper we study the effects of using multiple-subscripted arrays in benchmark programs. We identify and exemplify typical problems caused by multiple-subscripted arrays and show why their usage in benchmarking should be strictly controlled and frequently restricted. Multiple-subscripted arrays can be considered harmful in the case of general...

The nature of the relationship between a set of benchmark programs and a set of evaluated systems is reversible, and the same relationship can be used to solve the inverse problem of evaluation and comparison of competitive benchmark programs using performance measurements for a given set of hardware/software systems. In this paper, various aspects...

This paper describes a general cost-benefit decision model that is applicable to the evaluation, comparison, and selection of alternative products with a multiplicity of features, such as complex computer systems. The application of this model is explained and illustrated using the selection of data management systems as an example. The model has t...

Computer evaluation, comparison, and selection is essentially a decision process. The decision making is based on a number of worth indicators, including various computer performance indicators. The performance indicators are obtained through the computer performance measurement procedure. Consequently, in this environment the measurement procedure...