Parkinson's disease (PD) patients experience a range of symptoms, necessitating personalized treatment programs. Anti-PD medications are commonplace, yet a scenario can develop in which the Parkinson's medication being taken is no longer as effective as it once was. It may result in the re-emergence of symptoms prior to the next medicine intake. This is referred to as "wearing off". Over time, the duration of "wearing-off" shortens, requiring effective symptom management in collaboration between patients and doctors. This study aims to develop a prediction model to determine the occurrence of "wearing-off" in anti-PD medicine. To create the predictive model, real-world data, including fitness tracker records and self-reported symptoms from a smartphone application , were used. However, conducting such a study in real-world settings presents challenges, including high-class imbalance and intra-class variability when collecting self-reported symptoms from patients. Traditional imbalance learning approaches have drawbacks, such as information loss with under-sampling and overfitting or over-optimism with oversampling methods. To address these challenges, we propose a cost-sensitive hybrid optimum ensemble classifier framework. This technique adjusts class weights to give higher importance to minority classes, effectively addressing the class imbalance issue. The approach combines outputs from diverse weighted base classifiers using a stacked generalization method, harnessing the strengths of multiple high-performing base learners while mitigating their individual limitations.