Milija Suknović’s research while affiliated with University of Belgrade and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (64)


Application of the AHP and PROMETHEE II individual decision-making methods and the Condorcet group decision-making method in the Selection of a multipurpose armored wheeled combat vehicle
  • Article
  • Full-text available

January 2025

·

41 Reads

Vojnotehnicki glasnik

·

·

Milija Suknović

·

Introduction/purpose: Wheeled armored combat vehicles are combat systems that are increasingly present in modern armed conflicts, especially in operations against asymmetric threats. The global wheeled armored vehicle market is constantly growing, which reflects their application in a wide range of missions and tasks of armed forces. The existence of numerous models of these vehicles with different technical and exploitation characteristics, along with the possibility of adaptation to specific needs, further complicates the choice of the most suitable alternative. The paper presents the case of solving the problem of selecting the most suitable multi-purpose medium-class wheeled armored vehicle with a 4x4 drive formula when choosing one of the four alternatives, using individual and group multi-criteria decision-making methods. Methods: In the paper, the methods of multi-criteria decision making were applied to solve problems in the field of complex combat systems selection. Experts from the field of tactics with weapon systems have ranked the alternatives following the defined criteria using the AHP (Analytic Hierarchy Process) and the PROMETHEE II (Preference Ranking Organization Method for Enrichment Evaluations II) methods. The results obtained by individual decision making were subjected to the Condorcet method of group decision making to make a final decision. Result: Selection of the most suitable vehicle by the defined criteria. Conclusion: Solving the problem involves taking into account the views of military experts regarding the optimization of multiple criteria to provide the best performance vehicle suitable for use in various missions. The choice of a multi-purpose wheeled armored combat vehicle is a complex process influenced by numerous factors that cannot be analyzed objectively without the application of adequate mathematical models.

Download


Figure 1 Diagram illustrating the MedTEA workflow, including the RExtract module and ML analysis module.
Extraction Accuracy of RExtract Module
Leveraging Large Language Models for Improved Medical Diagnostics through Structured Data Extraction

Multi-actor VIKOR Method for Highway Selection in Montenegro

May 2023

·

79 Reads

·

1 Citation

Lecture Notes in Business Information Processing

Nowadays, decision-making systems in modern infrastructural planning greatly impact everyday life. This paper proposes a novel modification of the multi-criteria decision analysis (MCDA) method VIKOR that can be successfully applied to infrastructural decision-making systems. Our contributions are twofold: We first solve a highway section selection on the Montenegro A1 highway. Secondly, we modify the VIKOR method for the multi-actor (MA) setting. Although the original VIKOR method recognized multi-actor preferences through the selection of the value of the compromise parameter v, it did not explicitly include multiple actors in the decision-making process. Moreover, we show how the multi-actor (MA) VIKOR method can serve as a decision support system for making important infra-structural decision problems, improve the transparency of the decision-making process with the rising need to include citizens in the decision-making process, and how it successfully solves the distortion in social choice problem.KeywordsMCDAVIKORhighway selectionmulti-actor



Do we Reach Desired Disparate Impact with In-Processing Fairness Techniques?

December 2022

·

50 Reads

·

1 Citation

Procedia Computer Science

Using machine learning algorithms in social environments and systems requires stricter and more detailed control. More specifically, the cost of error in such systems is much higher. Therefore, one should ensure that important decisions, such as whether to convict a person or not based on the previous criminal record, are by the legal requirements and not biased toward a group of people. One can find many many papers in the literature aimed at mitigating or eliminating unwanted bias in machine learning models. A significant part of these efforts add fairness constraint to the mathematical model or adds a regularization term to the loss function. In this paper, we show that optimizing the loss function given the fairness constraint or regularization for unfairness can surprisingly yield unfair solutions. This is due to the linear relaxation of the fairness function. By analyzing the gap between the true value of fairness and the one obtained using linear relaxation, we found that the gap can be as high as around 21% for the COMPAS dataset, and around 35% for the Adult dataset. In addition, we show that the fairness gap is consistent regardless of the strength of the fairness constraint or regularization.


A study on ski groups size and their relationship to the risk of injury

August 2022

·

63 Reads

·

5 Citations

Proceedings of the Institution of Mechanical Engineers Part P Journal of Sports Engineering and Technology

This paper addresses a novel topic in ski injury research - how a ski group size indicates the risk of ski injury. There is evidence in research literature that people ski in groups. However, the relationship between group size and the risk of injury has remained unexplored. Based on ski lift entrance data, we use the density-based clustering algorithm OPTICS to identify groups of skiers and discuss the advantages of using this algorithm. We show that the ski group size can be used to improve the identification of skiers who experience ski injury. The results of the identification of ski groups at Mt. Kopaonik Ski Resort in Serbia show that skiing alone is most susceptible to ski injury, while skiing in couples or in bigger groups reduces the risk of injury by 46%. In addition, it is confirmed that ski injuries are an early failure event phenomena. Based on the CHAID decision tree analysis, spending a small amount of time at the ski resort and skiing alone are associated with the: 6 times greater ski injury risk than the average ski injury risk.



FairDEA - Removing Disparate Impact from Efficiency Scores

December 2021

·

35 Reads

·

7 Citations

European Journal of Operational Research

Achieving fairness in algorithmic decision-making tools is an issue constantly gaining in need and popularity. Today, unfair decisions made by such tools can even be subject to legal consequences. We propose a new constraint that integrates fairness into data envelopment analysis (DEA). This allows the calculation of relative efficiency scores of decision-making units (DMUs) with fairness included. The proposed fairness constraint restricts disparate impact to occur in efficiency scores, and enables the creation of a single data envelopment analysis for both privileged and unprivileged groups of DMUs simultaneously. We show that the proposed method - FairDEA - produces an interpretable model that was tested on a synthetic dataset and two real-world examples, namely the ranking between hybrid and conventional car designs, and the Latin American and Caribbean economies. We provide the interpretation of the FairDEA method by comparing it to the basic DEA and the balanced fairness and efficiency method (BFE DEA). Along with calculating the disparate impact of the model, we performed a Wilcoxon rank-sum test to inspect for fairness in rankings. The results show that the FairDEA method achieves similar efficiency scores as other methods, but without disparate impact. Statistical analysis indicates that the differences in ranking between the groups are not statistically different, which means that the ranking is fair. This method contributes both to the development of data envelopment analysis, and the inclusion of fairness in efficiency analysis.


Table 3
Table 6
The success rate and the disparate impact of bank-marketing campaign per sensitive group
Comparison of AUC
A fair classifier chain for multi-label bank marketing strategy classification

September 2021

·

492 Reads

·

7 Citations

International Transactions in Operational Research

Recently, the usage of machine learning algorithms is subject to discussion from a legal and ethical point of view. Unwanted discrimination regarding gender or race of a prediction model can lead to legal consequences. Therefore, during predictive model learning, one needs to be aware of possible bias and adjust the model to be fair. However, in bank marketing applications, one customer can receive multiple offers instead of just one. Because of their correlation between, a multi-label classification approach is the most suitable one. This paper proposes a fair classifier chain machine learning model for multi-label classification. Our algorithm solves the multi-label classification problem in an efficient manner, and it is suitable for real-life application employment. The proposed approach allows for controlling fairness constraints during the process of machine learning. It is based on the logistic regression model, thus enabling high efficiency and understandability. We apply our model to a real-life model from bank marketing campaign response prediction. The obtained results are promising. More specifically, our model achieves high fairness measures having an increase from 7% to 17%. However, fairness has a price of a decrease in predictive performance, up to 9% of AUC. To the best of our knowledge, this is the first algorithm that introduce fairness constraints in multi-label classification problems.


Citations (39)


... A measurement with a value of 0.8 indicates the creation of fair conditions, while a measurement with a value of 1 indicates demographic parity (creation of group fairness). The closer to 1, the fairer the result [37]. ...

Reference:

Measuring and Mitigating Bias in Bank Customers Data with XGBoost, LightGBM, and Random Forest Algorithm
Do we Reach Desired Disparate Impact with In-Processing Fairness Techniques?

Procedia Computer Science

... Some studies have shown that skiing in a larger group of friends or family can reduce risk of injury by around 50%, especially compared with skiing alone. 7 This shows possible risk mitigation for pediatric injury needs to fall onto parents and counselors chaperoning these trips to reduce rates of injury. Finally, ski resort chairlift models can have an impact on injury rates. ...

A study on ski groups size and their relationship to the risk of injury
  • Citing Article
  • August 2022

Proceedings of the Institution of Mechanical Engineers Part P Journal of Sports Engineering and Technology

... To fill the gap of setting targets based on the realistic potential of DMUs and identifying the vital input-outputs to do so, a data-driven decision support framework is proposed in this study using XAI methods. The motivation for using XAI in this framework can be summarized as (i) a faster decision-making process, (ii) considering much more decision-making criteria (Radovanović et al., 2022), and providing transparency and realism for Decision-Makers (DMs) in the target setting. ...

FairDEA - Removing Disparate Impact from Efficiency Scores
  • Citing Article
  • December 2021

European Journal of Operational Research

... This model allows the use of past behaviors to make future customer predictions so that a business can place its promotional activities at the right target. Radovanović et al. (2021) confirm that in many of the campaigns, the predictive models produced results which were 22 times higher than the random ones thus underscoring demand for AI in conversion rate optimization. Chandra (2020) describes how it is possible to use AI technology to simplify the processes of creating and improving landing pages by automatically selecting the optimal sequence and location of content and call-to-action buttons based on the use of the relevant data. ...

A fair classifier chain for multi-label bank marketing strategy classification

International Transactions in Operational Research

... After the stakeholders are identified, it is possible to define different criteria for them based on their priorities. MAMCA allows for a flexible choices of decisionmaking methods, i.e., for different decision-making context, it is possible to apply different combination of weight elicitation methods and MCDM methods [32,16]. The stakeholders will have their evaluation independently. ...

Proceedings of the 6th International Conference on Decision Support System Technology – ICDSST 2020 on "Cognitive Decision Support Systems & Technologies"

... Interestingly, those who chose not to participate after inclusion were mainly recent physiotherapy graduates. It is noteworthy that young individuals with higher levels of education tend to exhibit higher dropout rates in online courses (Radovanovic et al., 2020). Additionally, excessively high or low difficulty levels have been linked to increased dropout rates (Huang et al., 2023), which could explain why some young individuals did not start the course. ...

Predicting dropout in online learning environments

Computer Science and Information Systems

... To frame our approach, it is helpful to refer to the following DSS classification [8], which splits DSS into six main classes as shown in Table 1 Although a few examples of DSS developed for public procurement are available, none of them is intended to aid public agencies throughout the entire tendering process by making holistic use of the bulk of information already in existence. Some concentrate on a particular industry [12][13][14] or on particular stages of the procurement pipeline, such as bidder selection [15][16][17], and contractor pre-qualification [18,19]. These are built around a single DSS type, typically model-driven. ...

Bidder Selection in Public Procurement using a Fuzzy Decision Support System
  • Citing Article
  • January 2015

... One study at a particular ski resort found that chairlift injuries increased by 2-fold using only a 50% capacity increase to chairlift systems across the resort. 2 As winter sports become more popular and resorts increase lift capacities, such factors as traffic patterns, lift functioning, and overall snow accommodations will take further importance to prevent increases to injury rates. ...

A ski injury risk assessment model for ski resorts

... At the moment, machine learning has been used in several areas of research to identify talents in tennis, as well as to prevent sports injuries in football, skiing, baseball, basketball, and volleyball [21,22,23,24,25,26,27]. In addition, machine learning has also been used to predict match results [28,29]. ...

Ski Injury Predictions with Explanations

Communications in Computer and Information Science