Conference Paper

Approaching Remote Sensing Image Classification with Ensembles of Support Vector Machines on the D-Wave Quantum Annealer

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

... Quantum computer vision is an emerging field. Recently, several classical problems were reformulated to enable quantum optimization, including recognition [47,15] and matching tasks [55,10]. Promising results were shown so far, thus encouraging further research. ...
... Also the second term is constant, since m i is known for each image i by assumption. Thus, the objective function (6) is equivalent to (15). Observe that we should add extra constraints to take into account our additional assumptions, which force the amount of points per motion to be equal to some predefined values in every image, namely 1 T p i X i = m T i (see also Remark 1). ...
... Quantum Computer Vision. Several quantum techniques are available for computer vision tasks, such as recognition and classification [47,15], object tracking [35], transformation estimation [25], point set and shape alignment [44,56], graph matching [55] and permutation synchronization [10]. Most of these methods are designed for an AQC. ...
Preprint
Motion segmentation is a challenging problem that seeks to identify independent motions in two or several input images. This paper introduces the first algorithm for motion segmentation that relies on adiabatic quantum optimization of the objective function. The proposed method achieves on-par performance with the state of the art on problem instances which can be mapped to modern quantum annealers.
... Leveraging quantum annealing for problem resolution necessitates the formulation of quadratic unconstrained binary optimization (QUBO) representations that transform problems into quests for minimum values. This nondeterministic polynomial time (NP) mathematical framework has prompted a surge in research directed at resolving various NP-hard problems using QUBO formulations [12][13][14][15] in linear regression, support vector machines, and clustering, rendering this framework suitable for QML training on adiabatic quantum computers [16][17][18][19][20][21]. ...
... To calculate an × linear system at the 64 bit level, more than 64 logical qubits are required. We introduce a two-dimensional example using (15), (16), and (17) to explain the algorithm that has an accuracy of 64 bits or higher with 3 qubits. In Fig. 1, circles and ellipses represent contour levels for ∥ ⃗ − ⃗⃗ ∥ 2 2 . ...
Preprint
Full-text available
In the era of quantum computing, the emergence of quantum computers and subsequent advancements have led to the development of various quantum algorithms capable of solving linear equations and eigenvalues, surpassing the pace of classical computers. Notably, the hybrid solver provided by the D-wave system can leverage up to two million variables. By exploiting this technology, quantum optimization models based on quadratic unconstrained binary optimization (QUBO) have been proposed for applications, such as linear systems, eigenvalue problems, RSA cryptosystems, and CT image reconstruction. The formulation of QUBO typically involves straightforward arithmetic operations, presenting significant potential for future advancements as quantum computers continue to evolve. A prevalent approach in these developments is the binarization of variables and their mapping to multiple qubits. These methods increase the required number of qubits as the range and precision of each variable increase. Determining the optimal value of a QUBO model becomes more challenging as the number of qubits increases. Furthermore, the accuracies of the existing Qiskit simulator, D-Wave system simulator, and hybrid solver are limited to two decimal places. Problems arise because the qubits yielding the optimal value for the QUBO model may not necessarily correspond to the solution of a given problem. To address these issues, we propose a new iterative algorithm. The novel algorithm sequentially progresses from the highest to the lowest exponent in binarizing each number, whereby each number is calculated using two variables, and the accuracy can be computed up to a maximum of 16 decimal places.
... Research and applications in the use of remote sensing images with different resolutions (spatial, spectral, temporal, and radiometric) have evolved greatly in recent years, contributing to the mapping and monitoring of land use and land cover at local, regional, national, and global scales. Some of the initiatives in which quantum computing is applied in remote sensing include the use of the D-Wave 2000Q quantum annealer for training digital classifiers in multispectral images via support vector machine, a method based on machine learning (Cavallaro et al., 2020). This type of method can exponentially amplify the volume of data to be analyzed, with a shorter digital image processing time and a higher accuracy. ...
... These aspects favor the agro-environmental monitoring of large territorial extensions by better separating land use and land cover classes. Another recent application involves the processing and digital classification of agricultural crops using hyperspectral images obtained with D-Wave QA (Cavallaro et al., 2020). Otgonbaatar & Datcu (2021) developed a method based on a quantum boost classifier to classify a dataset from the airborne visible infrared imaging spectrometer sensor, which made it possible to eliminate noise and enhance the understanding of the spectral profile behavior of dozens of spectral bands, increasing the accuracy of the classification of different agricultural targets such as soybean, corn, wheat, alfalfa, and pastures. ...
Article
Full-text available
Quantum computers use the properties of quantum physics to perform information storage and processing operations. The operation of these computers involves concepts such as entanglement and superposition, which endow them with a great processing power that even surpasses that of the most powerful current supercomputers, while consuming significantly lower amounts of energy. The different studies analyzed in this review article suggest that quantum computing will have a deep impact in areas such as finance, logistics, transportation, space and automotive technology, materials science, energy, pharmaceutical and healthcare industry, cybersecurity, and agriculture. In digital agriculture, several applications that could be executed more efficiently in quantum computers for data processing and understanding of biological processes were identified and exemplified. These applications are grouped here into the following four areas: bioinformatics, remote sensing, climate modeling, and smart farming. This article also explores the strategic importance of mastering quantum computing, highlights some advantages in relation to classical computing, and presents a mapping of the services already available, enabling institutions to undertake strategic planning for the incorporation of quantum computing into their development processes. Finally, the challenges for the implementation of quantum computing are highlighted, along with some ongoing initiatives aimed at furthering research at the forefront of knowledge in this area applied to digital agriculture.
... Several quantum techniques are available for computer vision tasks, such as recognition and classification (O'Malley et al. 2018;Cavallaro et al. 2020), object tracking (Li and Ghosh 2020), transformation estimation , shape alignment and matching (Noormandipour and Wang 2022;Benkner et al. 2021Benkner et al. , 2020, permutation synchronization (Birdal et al. 2021), visual clustering , and motion segmentation (Arrigoni et al. 2022). Via Adiabatic Quantum Computing (AQC), O'Malley et al. (2018) applied binary matrix factorization to extract features of facial images. ...
... Dendukuri and Luu (2018) presented the image representation using quantum information to reduce the computational resources of classical computers. Cavallaro et al. (2020) presented multi-spectral image classification using quantum SVM. Golyanik and Theobalt (2020) introduced correspondence problems for point sets using AQC to align the rotations between pairs of point sets. ...
Article
Full-text available
Although quantum machine learning has been introduced for a while, its applications in computer vision are still limited. This paper, therefore, revisits the quantum visual encoding strategies, the initial step in quantum machine learning. Investigating the root cause, we uncover that the existing quantum encoding design fails to ensure information preservation of the visual features after the encoding process, thus complicating the learning process of the quantum machine learning models. In particular, the problem, termed the “Quantum Information Gap” (QIG), leads to an information gap between classical and corresponding quantum features. We provide theoretical proof and practical examples with visualization for that found and underscore the significance of QIG, as it directly impacts the performance of quantum machine learning algorithms. To tackle this challenge, we introduce a simple but efficient new loss function named Quantum Information Preserving (QIP) to minimize this gap, resulting in enhanced performance of quantum machine learning algorithms. Extensive experiments validate the effectiveness of our approach, showcasing superior performance compared to current methodologies and consistently achieving state-of-the-art results in quantum modeling.
... These different solutions can be combined, analogous to ensembling. This has empirically been shown to improve generalization performance in classical learning algorithms (Dietterich 2000), and a similar effect can be observed in quantum learning algorithms Cavallaro et al. 2020). ...
... , α s }. Essentially, this resembles a set of weak classifiers, that combined yield a strong classifier Cavallaro et al. 2020). In this study, the number of solutions combined is set to s = 4. ...
Article
Full-text available
Hyperparameter optimization (HPO) of neural networks is a computationally expensive procedure, which requires a large number of different model configurations to be trained. To reduce such costs, this work presents a distributed, hybrid workflow, that runs the training of the neural networks on multiple graphics processing units (GPUs) on a classical supercomputer, while predicting the configurations’ performance with quantum-trained support vector regression (QT-SVR) on a quantum annealer (QA). The workflow is shown to run on up to 50 GPUs and a QA at the same time, completely automating the communication between the classical and the quantum systems. The approach is evaluated extensively on several benchmarking datasets from the computer vision (CV), high-energy physics (HEP), and natural language processing (NLP) domains. Empirical results show that resource costs for performing HPO can be reduced by up to 9% when using the hybrid workflow with performance prediction, compared to using a plain HPO algorithm without performance prediction. Additionally, the workflow obtains similar and in some cases even better accuracy of the final hyperparameter configuration, when combining multiple heuristically obtained predictions from the QA, compared to using just a single classically obtained prediction. The results highlight the potential of hybrid quantum-classical machine learning algorithms. The workflow code is made available open-source to foster adoption in the community.
... Several quantum techniques are available for computer vision tasks, such as recognition and classification [19,20], object tracking [21], transformation estimation [22], shape alignment and matching [23][24][25], permutation synchronization [26], visual clustering [27], and motion segmentation [28]. Via Adiabatic Quantum Computing (AQC), O'Malley et al. [19] applied binary matrix factorization to extract features of facial images. ...
... Dendukuri et al. [29] presented the image representation using quantum information to reduce the computational resources of classical computers. Cavallaro et al. [20] presented multi-spectral image classification using quantum SVM. Golyanik et al. [22] introduced correspondence problems for point sets using AQC to align the rotations between pairs of point sets. ...
Preprint
Full-text available
Although quantum machine learning has been introduced for a while, its applications in computer vision are still limited. This paper, therefore, revisits the quantum visual encoding strategies, the initial step in quantum machine learning. Investigating the root cause, we uncover that the existing quantum encoding design fails to ensure information preservation of the visual features after the encoding process, thus complicating the learning process of the quantum machine learning models. In particular, the problem, termed "Quantum Information Gap" (QIG), leads to a gap of information between classical and corresponding quantum features. We provide theoretical proof and practical demonstrations of that found and underscore the significance of QIG, as it directly impacts the performance of quantum machine learning algorithms. To tackle this challenge, we introduce a simple but efficient new loss function named Quantum Information Preserving (QIP) to minimize this gap, resulting in enhanced performance of quantum machine learning algorithms. Extensive experiments validate the effectiveness of our approach, showcasing superior performance compared to current methodologies and consistently achieving state-of-the-art results in quantum modeling.
... Hybrid computer vision methods that can be executed partially on a quantum computer (QC) are an emerging research area [4,7,10,60]. Compared to classical methods, such approaches promise to solve computationally demanding (e.g., combinatorial) sub-problems faster, with improved scaling, and without relaxations that often lead to approximate solutions. ...
... In contrast to circuit-based machines, quantum annealers can already solve various real-world problems formulated as QUBOs [42,46,52,[63][64][65]. Hence, the last few years in quantum computer vision (QCV) are characterised by a rapid transition from theoretical considerations [11,47,48,69] to practical algorithms leveraging quantum-mechanical effects of quantum computers, ranging from image retrieval and processing [69,74], classification [7,10,20,49,72] and object tracking [37,75], to problems on graphs [41,59,76], consensus maximisation [22], shape alignment [50,60] and ensuring cycle-consistency [4]. ...
Preprint
Modern quantum annealers can find high-quality solutions to combinatorial optimisation objectives given as quadratic unconstrained binary optimisation (QUBO) problems. Unfortunately, obtaining suitable QUBO forms in computer vision remains challenging and currently requires problem-specific analytical derivations. Moreover, such explicit formulations impose tangible constraints on solution encodings. In stark contrast to prior work, this paper proposes to learn QUBO forms from data through gradient backpropagation instead of deriving them. As a result, the solution encodings can be chosen flexibly and compactly. Furthermore, our methodology is general and virtually independent of the specifics of the target problem type. We demonstrate the advantages of learnt QUBOs on the diverse problem types of graph matching, 2D point cloud alignment and 3D rotation estimation. Our results are competitive with the previous quantum state of the art while requiring much fewer logical and physical qubits, enabling our method to scale to larger problems. The code and the new dataset will be open-sourced.
... Binary classification on remote sensing (RS) of multispectral images can be achieved on D_WAVE 2000Q Quantum Annealer machine using Quantum SVM [17]. This method formulates the classification as a Quadratic Unconstrained Binary Optimization (QUBO) and implements the RBF kernel method on two ID datasets: Im16, and Im40. ...
... The method achieved AUROC score of 0.886 and AUPRC score of 0.930 for Im16 dataset, respectively. AURCOC of 0.882 and AURPC of 0.870 were achieved for the other dataset Im40, respectively [17]. Similar RS testing for image classification on 50 samples from SemCity Toulouse dataset on an upgraded quantum machine-D-WAVE Advantageproduced an overall accuracy of 0.874 with 0.734 F1 score which were comparable to classical SVM models and outshone the IBM quantum machines that lagged with 0.609 and 0.569 scores respectively [21]. ...
Conference Paper
Full-text available
Quantum Computing (QC) has gained immense popularity as a potential solution to deal with the ever-increasing size of data and associated challenges leveraging the concept of quantum random access memory (QRAM). QC promises-quadratic or exponential increases in computational time with quantum parallelism and thus offer a huge leap forward in the computation of Machine Learning algorithms. This paper analyzes speed up performance of QC when applied to machine learning algorithms, known as Quantum Machine Learning (QML). We applied QML methods such as Quantum Support Vector Machine (QSVM), and Quantum Neural Network (QNN) to detect Software Supply Chain (SSC) attacks. Due to the access limitations of real quantum computers, the QML methods were implemented on open-source quantum simulators such as IBM Qiskit and TensorFlow Quantum. We evaluated the performance of QML in terms of processing speed and accuracy and finally, compared with its classical counterparts. Interestingly, the experimental results differ to the speed up promises of QC by demonstrating higher computational time and lower accuracy in comparison to the classical approaches for SSC attacks.
... Binary classification on remote sensing (RS) of multispectral images can be achieved on D_WAVE 2000Q Quantum Annealer machine using Quantum SVM [17]. This method formulates the classification as a Quadratic Unconstrained Binary Optimization (QUBO) and implements the RBF kernel method on two ID datasets: Im16, and Im40. ...
... The method achieved AUROC score of 0.886 and AUPRC score of 0.930 for Im16 dataset, respectively. AURCOC of 0.882 and AURPC of 0.870 were achieved for the other dataset Im40, respectively [17]. Similar RS testing for image classification on 50 samples from SemCity Toulouse dataset on an upgraded quantum machine-D-WAVE Advantage-produced an overall accuracy of 0.874 with 0.734 F1 score which were comparable to classical SVM models and outshone the IBM quantum machines that lagged with 0.609 and 0.569 scores respectively [21]. ...
Preprint
Full-text available
Quantum Computing (QC) has gained immense popularity as a potential solution to deal with the ever-increasing size of data and associated challenges leveraging the concept of quantum random access memory (QRAM). QC promises quadratic or exponential increases in computational time with quantum parallelism and thus offer a huge leap forward in the computation of Machine Learning algorithms. This paper analyzes speed up performance of QC when applied to machine learning algorithms, known as Quantum Machine Learning (QML). We applied QML methods such as Quantum Support Vector Machine (QSVM), and Quantum Neural Network (QNN) to detect Software Supply Chain (SSC) attacks. Due to the access limitations of real quantum computers, the QML methods were implemented on open-source quantum simulators such as IBM Qiskit and TensorFlow Quantum. We evaluated the performance of QML in terms of processing speed and accuracy and finally, compared with its classical counterparts. Interestingly, the experimental results differ to the speed up promises of QC by demonstrating higher computational time and lower accuracy in comparison to the classical approaches for SSC attacks.
... These layers contain several quanvolutional filters that transform the input data into different output feature maps by using a number of random quantum circuits, in an analogous way to standard convolutional networks. Quantum circuitbased neural network classifiers for multi-spectral land cover classification have been introduced in preliminary proof-ofconcept applications as presented in [24], and an ensemble of support vector machines running on the D-Wave quantum annealer has been proposed for remote sensing image classification in [25]. In our preliminary work [26] hybrid quantumclassical neural networks for remote sensing applications are discussed, and a proof-of-concept for binary classification, using multispectral optical data, is reported. ...
... • QC is applied to land-cover classification on the reference benchmark EuroSAT dataset [28] for optical multispectral images, thus by going further than initial proofs-ofconcept on a few images [24], [25]. • QCNN multiclass classification is tackled, with respect to the simple binary classification already discussed in [26], and better results are obtained through the quantum-based networks with respect to their fully-classical counterpart. ...
Article
Full-text available
This article aims to investigate how circuit-based hybrid Quantum Convolutional Neural Networks (QCNNs) can be successfully employed as image classifiers in the context of remote sensing. The hybrid QCNNs enrich the classical architecture of CNNs by introducing a quantum layer within a standard neural network. The novel QCNN proposed in this work is applied to the Land Use and Land Cover (LULC) classification, chosen as an Earth Observation (EO) use case, and tested on the EuroSAT dataset used as reference benchmark. The results of the multiclass classification prove the effectiveness of the presented approach, by demonstrating that the QCNN performances are higher than the classical counterparts. Moreover, investigation of various quantum circuits shows that the ones exploiting quantum entanglement achieve the best classification scores. This study underlines the potentialities of applying quantum computing to an EO case study and provides the theoretical and experimental background for futures investigations.
... Quantum image representations such as qubit lattices and normal arbitrary quantum superposition states store color image information using amplitudes, phases, or basis quantum states [102,107]. For the processing of quantum represented images, there are already quite a few, mostly quantum annealing-based methods available for tasks such as image recognition and classification [27,89,172], image synthesis [49], object tracking and detection [103], graph matching [159], as well as for motion and image segmentation [13,174,179]. ...
Article
Full-text available
Quantum Artificial Intelligence (QAI) is the intersection of quantum computing and AI, a technological synergy with expected significant benefits for both. In this paper, we provide a brief overview of what has been achieved in QAI so far and point to some open questions for future research. In particular, we summarize some major key findings on the feasability and the potential of using quantum computing for solving computationally hard problems in various subfields of AI, and vice versa, the leveraging of AI methods for building and operating quantum computing devices.
... The methods reported in Table 1 have been assessed on datasets taken from the remote sensing domain, a domain in which both FaLK-SVM and the quantum-trained SVMs have already shown good performance [7], [9], [10], [23]. Specifically, the datasets employed here have been generated from the SemCity Toulouse [29] and ISPRS Potsdam [30] datasets, which consist of multispectral images with multi-ple classes (and have been employed also in the QMSVM article [7]). ...
Article
Full-text available
Support vector machines (SVMs) are widely used machine learning models, with formulations for both classification and regression tasks. In the last years, with the advent of working quantum annealers, hybrid SVM models characterised by quantum training and classical execution have been introduced. These models have demonstrated comparable performance to their classical counterparts. However, they are limited in the training set size due to the restricted connectivity of the current quantum annealers. Hence, to take advantage of large datasets, a strategy is required. In the classical domain, local SVMs, namely, SVMs trained on the data samples selected by a k -nearest neighbors model, have already proven successful. Here, the local application of quantum-trained SVM models is proposed and empirically assessed. In particular, this approach allows overcoming the constraints on the training set size of the quantum-trained models while enhancing their performance. In practice, the Fast Local Kernel Support Vector Machine (FaLK-SVM) method, designed for efficient local SVMs, has been combined with quantum-trained SVM models for binary and multiclass classification. In addition, for comparison, FaLK-SVM has been interfaced for the first time with a classical single-step multiclass SVM model (CS SVM). Concerning the empirical evaluation, D-Wave's quantum annealers and real-world datasets taken from the remote sensing domain have been employed. The results have shown the effectiveness and scalability of the proposed approach, but also its practical applicability in a real-world large-scale scenario.
... Their survey highlights key applications in robust fitting [21], transformation estimation [26,37], multiple object tracking (MOT) [63], defect detection in semiconductors [60], and permutation synchronization [12]. Additional contributions to this field include advancements in motion segmentation [4], recognition [38,44], image classification [13,17,39,40], object detection [33], multi-model fitting [23], matching problems [5,6,10,12,62], and mesh alignment [6]. All works mentioned above focus on employing AQC by translating problems into an AQC-admissible form, predominantly QUBO. ...
Preprint
Full-text available
Gate quantum computers generate significant interest due to their potential to solve certain difficult problems such as prime factorization in polynomial time. Computer vision researchers have long been attracted to the power of quantum computers. Robust fitting, which is fundamentally important to many computer vision pipelines, has recently been shown to be amenable to gate quantum computing. The previous proposed solution was to compute Boolean influence as a measure of outlyingness using the Bernstein-Vazirani quantum circuit. However, the method assumed a quantum implementation of an \ell_\infty feasibility test, which has not been demonstrated. In this paper, we take a big stride towards quantum robust fitting: we propose a quantum circuit to solve the \ell_\infty feasibility test in the 1D case, which allows to demonstrate for the first time quantum robust fitting on a real gate quantum computer, the IonQ Aria. We also show how 1D Boolean influences can be accumulated to compute Boolean influences for higher-dimensional non-linear models, which we experimentally validate on real benchmark datasets.
... Quantum image representations such as qubit lattices and normal arbitrary quantum superposition states store color image information using amplitudes, phases, or basis quantum states [114,110]. For the processing of quantum represented images, there are already quite a few, mostly quantum annealingbased methods available for tasks such as image recognition and classification [29,182,96], image synthesis [53], object tracking and detection [111], graph matching [170], as well as for motion and image segmentation [14,187,188]. For example, the problem of unsupervised graph-based image segmentation is (a) to construct a weighted undirected graph from a given image with set of vertices (pixels), set of edges (synergies between pixels), and set of weights (similarity between pixels), and then (2) to find the best partition into disjoint subsets such that the sum of weights between different subsets is minimized. ...
Preprint
Full-text available
Quantum Artificial Intelligence (QAI) is the intersection of quantum computing and AI, a technological synergy with expected significant benefits for both. In this paper, we provide a brief overview of what has been achieved in QAI so far and point to some open questions for future research. In particular, we summarize some major key findings on the feasability and the potential of using quantum computing for solving computationally hard problems in various subfields of AI, and vice versa, the leveraging of AI methods for building and operating quantum computing devices.
... AQML methods have been applied to many areas, for example, AQML is used to select candidates in materials development (Guan et al., 2021;Hatakeyama-Sato et al., 2022;von Lilienfeld, 2018;Haibo Wang & Alidaee, 2019), to detect the fraud in finance (Grossi et al., 2022;H. Wang et al., 2022), to improve the traffic scheduling (Daugherty et al., 2019), to classify remote sensing data (Cavallaro et al., 2020;Delilbasic et al., 2021), to detect anomaly (Liu & Rebentrost, 2018), to process sensor data and enable quantum walk-in robotic systems (Petschnigg et al., 2019), and to enhance the prediction in renewable energy development (Ajagekar & You, 2022) . ...
Preprint
Full-text available
The recent developments of adiabatic quantum machine learning (AQML) methods and applications based on the quadratic unconstrained binary optimization (QUBO) model have received attention from academics and practitioners. Traditional machine learning methods such as support vector machines, balanced k-means clustering, linear regression, Decision Tree Splitting, Restricted Boltzmann Machines, and Deep Belief Networks can be transformed into a QUBO model. The training of adiabatic quantum machine learning models is the bottleneck for computation. Heuristics-based quantum annealing solvers such as Simulated Annealing and Multiple Start Tabu Search (MSTS) are implemented to speed up the training of AQML based on the QUBO model. The main purpose of this paper is to present a hybrid heuristic embedding an r-flip strategy to solve large-scale QUBO with an improved solution and shorter computing time compared to the state-of-the-art MSTS method. The results of the substantial computational experiments are reported to compare an r-flip strategy embedded hybrid heuristic and a multiple start tabu search algorithm on a set of benchmark instances and three large-scale QUBO instances. The r-flip strategy embedded algorithm provides very high-quality solutions within the CPU time limits of 60 and 600 seconds.
... The field integrating machine learning and quantum computing is quantum machine learning (QML). Regarding applying QML for land cover classification, some studies use quantum annealers [14], [15]. Besides that, exploiting quantum circuits also attracts great attention. ...
Article
Full-text available
Exploiting machine learning techniques to automatically classify multi-spectral remote sensing imagery plays a significant role in deriving changes on the earth's surface. However, the computation power required to manage large earth observation data and apply sophisticated machine learning models for this analysis purpose has become an intractable bottleneck. Leveraging quantum computing provides a possibility to tackle this challenge in the future. This paper focuses on land cover classification by analyzing Sentinel-2 images with quantum computing. Two hybrid quantum-classical deep learning frameworks are proposed. Both models exploit quantum computing to extract features efficiently from multi-spectral images and classical computing for final classification. As proof of concept, numerical simulation results on the LCZ42 dataset through the TensorFlow Quantum platform verify our models' validity. The experiments indicate that our models can extract features more effectively compared with their classical counterparts, specifically, the convolutional neural network (CNN) model. Our models demonstrated improvements, with an average test accuracy increase of 4.5% and 3.3%, respectively, in comparison to the CNN model. Additionally, our proposed models exhibit better transferability and robustness than CNN models. Our models and code are available at https://github.com/zhu-xlab/LULC_MSI_QCNN .
... There are several studies on the computer vision tasks, such as recognition and classification [29], [30], object tracking [31], transformation estimation [32], shape alignment and matching [33]- [35], permutation synchronization [36], and motion segmentation [37]. In light of this research, several studies [38]- [41] have employed Quantum machines in unsupervised learning. ...
Preprint
Unsupervised vision clustering, a cornerstone in computer vision, has been studied for decades, yielding significant outcomes across numerous vision tasks. However, these algorithms involve substantial computational demands when confronted with vast amounts of unlabeled data. Conversely, Quantum computing holds promise in expediting unsupervised algorithms when handling large-scale databases. In this study, we introduce QClusformer, a pioneering Transformer-based framework leveraging Quantum machines to tackle unsupervised vision clustering challenges. Specifically, we design the Transformer architecture, including the self-attention module and transformer blocks, from a Quantum perspective to enable execution on Quantum hardware. In addition, we present QClusformer, a variant based on the Transformer architecture, tailored for unsupervised vision clustering tasks. By integrating these elements into an end-to-end framework, QClusformer consistently outperforms previous methods running on classical computers. Empirical evaluations across diverse benchmarks, including MS-Celeb-1M and DeepFashion, underscore the superior performance of QClusformer compared to state-of-the-art methods.
... (c) QSVMs are especially suitable for the NISQ era because of their shallow circuits. It should be noted that the SVM optimization can be formulated as a quadratic unconstrained binary optimization (QUBO) problem Cavallaro et al., 2020) and can hence be solved on a quantum annealer (Kadowaki and Nishimori, 1998;Das and Chakrabarti, 2005;Hauke et al., 2020). While this is its own research branch, we focus on kernel-based quantum regression in the scope of this paper. ...
... In Synthetic Aperture Radar (SAR) imaging, problems related to system design [26] and phase ambiguity [27] have been addressed. In the context of QML, a feature selection method for hyperspectral images has been proposed [28], and a QA-based Quantum Support Vector Machine (QSVM) method has been successfully used for binary classification of multispectral images [29] [30]. ...
Article
Full-text available
In recent years, the development of quantum annealers has enabled experimental demonstrations and has increased research interest in applications of quantum annealing, such as in quantum machine learning and in particular for the popular quantum Support Vector Machine (SVM). Several versions of the quantum SVM have been proposed, and quantum annealing has been shown to be effective in them. Extensions to multiclass problems have also been made, which consist of an ensemble of multiple binary classifiers. This work proposes a novel quantum SVM formulation for direct multiclass classification based on quantum annealing, called Quantum Multiclass SVM (QMSVM). The multiclass classification problem is formulated as a single quadratic unconstrained binary optimization problem solved with quantum annealing. The main objective of this work is to evaluate the feasibility, accuracy, and time performance of this approach. Experiments have been performed on the D-Wave Advantage quantum annealer for a classification problem on remote sensing data. Results indicate that, despite the memory demands of the quantum annealer, QMSVM can achieve an accuracy that is comparable to standard SVM methods, such as the one-versus-one (OVO), depending on the dataset (compared to OVO: 0.8663 vs 0.8598 on Toulouse, 0.8123 vs 0.8521 on Potsdam). More importantly, it scales much more efficiently with the number of training examples, resulting in nearly constant time (compared to OVO: 85.72s vs 248.02s on Toulouse, 58.89s vs 580.17s on Potsdam). This work shows an approach for bringing together classical and quantum computation, solving practical problems in remote sensing with current hardware.
... As for applying QML/QNNs to classify remote sensing images, some researchers focused on using quantum annealers for classification [50], [51], [52]. Besides that, studies based on quantum circuits also have been conducted to analyze remote sensing data. ...
Article
Full-text available
Image classification plays an important role in remote sensing. Earth observation (EO) has inevitably arrived in the big data era, but the high requirement on computation power has already become a bottleneck for analyzing large amounts of remote sensing data with sophisticated machine learning models. Exploiting quantum computing might contribute to a solution to tackle this challenge by leveraging quantum properties. This article introduces a hybrid quantum-classical convolutional neural network (QC-CNN) that applies quantum computing to effectively extract high-level critical features from EO data for classification purposes. Besides that, the adoption of the amplitude encoding technique reduces the required quantum bit resources. The complexity analysis indicates that the proposed model can accelerate the convolutional operation in comparison with its classical counterpart. The model’s performance is evaluated with different EO benchmarks, including Overhead-MNIST, So2Sat LCZ42, PatternNet, RSI-CB256, and NaSC-TG2, through the TensorFlow Quantum platform, and it can achieve better performance than its classical counterpart and have higher generalizability, which verifies the validity of the QC-CNN model on EO data classification tasks.
... The field integrating machine learning and quantum computing is quantum machine learning (QML). Regarding applying QML for land cover classification, some studies use quantum annealers [14], [15]. Besides that, exploiting quantum circuits also attracts great attention. ...
... One significant challenge in the medical application of QC is the limited number of available qubits. Adiabatic QC produced by D-Wave has increased the number of qubits to be utilized, which has enhanced the field of QC [29][30][31][32][33][34]. Binary-or integer-based reconstruction has been proposed in recent years, but integer-based reconstruction still has difficulty reproducing quantitative images due to the shortage of qubits to represent pixel values [8]. ...
Preprint
Full-text available
Objective: Despite recent advancements in quantum computing, the limited number of available qubits has hindered progress in CT reconstruction. This study investigates the feasibility of utilizing quantum annealing-based computed tomography (QACT) with current quantum bit levels. Approach: The QACT algorithm aims to precisely solve quadratic unconstrained binary optimization (QUBO) problems. Furthermore, a novel approach is proposed to reconstruct images by approximating real numbers using the variational method. This approach allows for accurate CT image reconstruction using a small number of qubits. The study examines the impact of projection data quantity and noise on various image sizes ranging from 4x4 to 24x24 pixels. The reconstructed results are compared against conventional reconstruction algorithms, namely maximum likelihood expectation maximization (MLEM) and filtered back projection (FBP). Main result: By employing the variational approach and utilizing two qubits for each pixel of the image, accurate reconstruction was achieved with an adequate number of projections. Under conditions of abundant projections and lower noise levels, the image quality in QACT outperformed that of MLEM and FBP. However, in situations with limited projection data and in the presence of noise, the image quality in QACT was inferior to that in MLEM. Significance: This study developed the QACT reconstruction algorithm using the variational approach for real-number reconstruction. Remarkably, only 2 qubits were required for each pixel representation, demonstrating their sufficiency for accurate reconstruction.
... In Synthetic Aperture Radar (SAR) imaging, problems related to system design [22] and phase ambiguity [23] have been addressed. In the context of QML, a feature selection method for hyperspectral images has been proposed [24], and a QAbased Quantum SVM (QSVM) method has been successfully used for binary classification of multispectral images [25] [26]. ...
Preprint
In recent years, the development of quantum annealers has enabled experimental demonstrations and has increased research interest in applications of quantum annealing, such as in quantum machine learning and in particular for the popular quantum SVM. Several versions of the quantum SVM have been proposed, and quantum annealing has been shown to be effective in them. Extensions to multiclass problems have also been made, which consist of an ensemble of multiple binary classifiers. This work proposes a novel quantum SVM formulation for direct multiclass classification based on quantum annealing, called Quantum Multiclass SVM (QMSVM). The multiclass classification problem is formulated as a single Quadratic Unconstrained Binary Optimization (QUBO) problem solved with quantum annealing. The main objective of this work is to evaluate the feasibility, accuracy, and time performance of this approach. Experiments have been performed on the D-Wave Advantage quantum annealer for a classification problem on remote sensing data. The results indicate that, despite the memory demands of the quantum annealer, QMSVM can achieve accuracy that is comparable to standard SVM methods and, more importantly, it scales much more efficiently with the number of training examples, resulting in nearly constant time. This work shows an approach for bringing together classical and quantum computation, solving practical problems in remote sensing with current hardware.
... The performance of QML implemented for big data applications is compared with the performance of classical computation [6][7][8]. Two major providers of cloud QC environments are IBM (gate-based systems) [5,9] and D-Wave (based on quantum annealing) [10,11]. The main goal of many researchers in this field is to search for potential applications that demonstrate quantum speed-ups [6]. ...
Article
Full-text available
A quantum machine is a human-made device whose collective motion follows the laws of quantum mechanics. Quantum machine learning (QML) is machine learning for quantum computers. The availability of quantum processors has led to practical applications of QML algorithms in the remote sensing field. Quantum machines can learn from fewer data than non-quantum machines, but because of their low processing speed, quantum machines cannot be applied to an image that has hundreds of thousands of pixels. Researchers around the world are exploring applications for QML and in this work, it is applied for pseudo-labelling of samples. Here, a PRISMA (PRecursore IperSpettrale della Missione Applicativa) hyperspectral dataset is prepared by quantum-based pseudo-labelling and 11 different machine learning algorithms viz., support vector machine (SVM), K-nearest neighbour (KNN), random forest (RF), light gradient boosting machine (LGBM), XGBoost, support vector classifier (SVC) + decision tree (DT), RF + SVC, RF + DT, XGBoost + SVC, XGBoost + DT, and XGBoost + RF with this dataset are evaluated. An accuracy of 86% was obtained for the classification of pine trees using the hybrid XGBoost + decision tree technique.
... In Remote Sensing (RS) one can find the usage of QSVM is limited for binary classification using both quantum annealer and gate based. Cavallaro, 11 was the first to propose remote sensing data classification using ensemble of QSVM on D-wave quantum annealer. The experiments were carried out on two multispectral datasets and he concluded that the QA version of the SVM is a valuable alternative for classical to classify RS data. ...
... More precisely, it is responsible for training the model parameters from a set of labeled training data to make correct guesses on the test data. These SVMs are known to have higher stability than decision trees or deep neural networks that perform the same role [64], [65]. Therefore, there is an advantage that small fluctuations made by some data in the training data do not have a large effect on the classification result. ...
Article
Full-text available
A combinatorial optimization problem (COP) is the problem of finding the optimal solution in a finite set. When the size of the feasible solution set is large, the complexity of the problem increases, and it is not easy to solve in a reasonable time with the current classical computer technology. Quantum annealing (QA) is a method that replaces classical simulated annealing (SA) methods that do not solve these cases. Therefore, several attempts have been made to solve this problem using a special-purpose quantum annealer to which the QA method is applied. In this survey, we analyze recent studies that solve real-scale COPs using quantum annealers. Through this, we discuss how to reduce the size of the COP to be input to overcome the hardware limitations of the existing quantum annealer. Additionally, we demonstrated the applicability of quantum annealer to COP on a practical scale by comparing and analyzing the results of the classical simulated annealing (SA) and QA method from each study.
... Building a support vector ML model requires the use to specify the kernel type [38] . Some popular kernels in remote sensing are polynomial kernels and the radial basis function (RBF) kernel [39] . Classification of satellite based imagery, detection of features like roads, wetlands, grasslands, can be solved using SVM models. ...
Article
Machine learning (ML) is a subdivision of artificial intelligence in which the machine learns from machine-readable data and information. It uses data, learns the pattern and predicts the new outcomes. Its popularity is growing because it helps to understand the trend and provides a solution that can be either a model or a product. Applications of ML algorithms have increased drastically in G.I.S. and remote sensing in recent years. It has a broad range of applications, from developing energy-based models to assessing soil liquefaction to creating a relation between air quality and mortality. Here, in this paper, we discuss the most popular supervised ML models (classification and regression) in G.I.S. and remote sensing. The motivation for writing this paper is that ML models produce higher accuracy than traditional parametric classifiers, especially for complex data with many predictor variables. This paper provides a general overview of some popular supervised non-parametric ML models that can be used in most of the G.I.S. and remote sensing based projects. We discuss classification (Naïve Bayes (NB), Support Vector Machine (SVM), Random Forest (RF), Decision Trees (DT)) and regression models (Random Forest (RF), Support Vector Machine (SVM), Linear and Non-Linear) here. Therefore, the article can be a guide to those interested in using ML models in their G.I.S. and remote sensing based projects.
... It's an ML model that can be applied to classification and regression problems(Mountrakis, Im, Ogole, & Sensing, 2011).It fits the data based on a distinct line known as a hyperplane (Sheykhmousa et al., 2020). As the model is easy to build and robust to outliers, it is widely used in the G.I.S. and remote sensing domains (Cavallaro, Willsch, Willsch, Michielsen, & Riedel, 2020). Building a support vector ML model requires the use to specify the kernel type (Waske, Benediktsson, & Sveinsson, 2009). ...
Preprint
Full-text available
Machine learning (ML) is a subdivision of artificial intelligence in which the machine learns from machine-readable data and information. It uses data, learns the pattern and predicts the new outcomes. Its popularity is growing because it helps to understand the trend and provides a solution that can be either a model or a product. Applications of ML algorithms have increased drastically in G.I.S. and remote sensing in recent years. It has a broad range of applications, from developing energy-based models to assessing soil liquefaction to creating a relation between air quality and mortality. Here, in this paper, we discuss the most popular supervised ML models (clas-sification and regression) in G.I.S. and remote sensing. The motivation for writing this paper is that ML models produce higher accuracy than traditional parametric classifiers, especially for complex data with many predictor variables. This paper provides a general overview of some popular supervised non-parametric ML models that can be used in most of the G.I.S. and remote sensing-based projects. We discuss classification (Naïve Bayes (NB), Support Vector Machine (SVM), Random Forest (RF), Decision Trees (DT)) and regression models (Random Forest (RF), Support Vector Machine (SVM), Linear and Non-Linear) here. Therefore, the article can be a guide to those interested in using ML models in their G.I.S. and remote sensing-based projects.
... It's an ML model that can be applied to classification and regression problems (Mountrakis, Im, Ogole, & Sensing, 2011).It fits the data based on a distinct line known as a hyperplane (Sheykhmousa et al., 2020). As the model is easy to build and robust to outliers, it is widely used in the G.I.S. and remote sensing domains (Cavallaro, Willsch, Willsch, Michielsen, & Riedel, 2020). Building a support vector ML model requires the use to specify the kernel type (Waske, Benediktsson, & Sveinsson, 2009). ...
Conference Paper
Full-text available
Machine learning (ML) is a subdivision of artificial intelligence in which the machine learns from machine-readable data and information. It uses data, learns the pattern and predicts the new outcomes. Its popularity is growing because it helps to understand the trend and provides a solution that can be either a model or a product. Applications of ML algorithms have increased drastically in G.I.S. and remote sensing in recent years. It has a broad range of applications, from developing energy-based models to assessing soil liquefaction to creating a relation between air quality and mortality. Here, in this paper, we discuss the most popular supervised ML models (classification and regression) in G.I.S. and remote sensing. The motivation for writing this paper is that ML models produce higher accuracy than traditional parametric classifiers, especially for complex data with many predictor variables. This paper provides a general overview of some popular supervised non-parametric ML models that can be used in most of the G.I.S. and remote sensing-based projects. We discuss classification (Naïve Bayes (NB), Support Vector Machine (SVM), Random Forest (RF), Decision Trees (DT)) and regression models (Random Forest (RF), Support Vector Machine (SVM), Linear and Non-Linear) here. Therefore, the article can be a guide to those interested in using ML models in their G.I.S. and remote sensing-based projects.
... Regarding using QML for EO data classification, several studies have used quantum annealers [1,2]. Additionally, applying quantum circuits to analyze EO images also attracts great attention. ...
Conference Paper
Due to the rapid growth of earth observation (EO) data and the complexity of machine learning models, the high requirement on the computation power for EO data analysis becomes a bottleneck. Exploiting quantum computing might tackle this challenge in the future. In this paper, we present a hybrid quantum-classical convolutional neural network (QC-CNN) to classify EO data which can accelerate feature extraction compared with its classical counterpart and handle multi-category classification tasks with reduced quantum resources. The model’s validity is verified with the Overhead-MNIST dataset through the TensorFlow Quantum platform.
... Despite the fact that quantum machine learning is a recently surging field, it already encompasses a rich set of quantum techniques and approaches, for example linear regression [19], [20], [21], clustering analysis [22], dimensionality reduction [23], [24], data classification [25], [26], [27], [28], and neural networks [29], [30], [31]. Besides, quantum machine learning algorithms have been applied to channel discrimination [7], vehicle classification [32], and image classification [33]. Support vector machine (SVM) is a supervised machine learning technique for solving classification. ...
Preprint
Full-text available
Quantum algorithms can enhance machine learning in different aspects. In 2014, Rebentrost et al.et~al. constructed a least squares quantum support vector machine (LS-QSVM), in which the Swap Test plays a crucial role in realizing the classification. However, as the output states of a previous test cannot be reused for a new test in the Swap Test, the quantum algorithm LS-QSVM has to be repeated in preparing qubits, manipulating operations, and carrying out the measurement. This paper proposes a QSVM based on the generalized quantum amplitude estimation (AE-QSVM) which gets rid of the constraint of repetitive processes and saves the quantum resources. At first, AE-QSVM is trained by using the quantum singular value decomposition. Then, a query sample is classified by using the generalized quantum amplitude estimation in which high accuracy can be achieved by adding auxiliary qubits instead of repeating the algorithm. The complexity of AE-QSVM is reduced to O(κ3ε3(log(mn)+1))O(\kappa^{3}\varepsilon^{-3}(log(mn)+1)) with an accuracy ε\varepsilon, where m is the number of training vectors, n is the dimension of the feature space, and κ\kappa is the condition number. Experiments demonstrate that AE-QSVM is advantageous in terms of training matrix, the number of iterations, space complexity, and time complexity.
... For analysing practical RS datasets, there are several approaches of training ML models and solving RS optimization problems on a D-Wave QA [11], [12], [13], and even on a gate-based quantum computer [14], [15]. The D-Wave QA has around 5, 000 input qubits and a specific Pegasus topology for the connectivity of its qubits [16], and it is designed for solving a Quadratic Unconstrained Binary Optimization (QUBO) problem [9]. ...
Preprint
Full-text available
Machine Learning (ML) techniques are employed to analyze and process big Remote Sensing (RS) data, and one well-known ML technique is a Support Vector Machine (SVM). An SVM is a quadratic programming (QP) problem, and a D-Wave quantum annealer (D-Wave QA) promises to solve this QP problem more efficiently than a conventional computer. However, the D-Wave QA cannot solve directly the SVM due to its very few input qubits. Hence, we use a coreset ("core of a dataset") of given EO data for training an SVM on this small D-Wave QA. The coreset is a small, representative weighted subset of an original dataset, and any training models generate competitive classes by using the coreset in contrast to by using its original dataset. We measured the closeness between an original dataset and its coreset by employing a Kullback-Leibler (KL) divergence measure. Moreover, we trained the SVM on the coreset data by using both a D-Wave QA and a conventional method. We conclude that the coreset characterizes the original dataset with very small KL divergence measure. In addition, we present our KL divergence results for demonstrating the closeness between our original data and its coreset. As practical RS data, we use Hyperspectral Image (HSI) of Indian Pine, USA.
... (1) Comparison with detailed real-time simulations of quantum annealing systems based on solving the time-dependent Schrödinger equation [24,25] or the timedependent master equation [5,6,[26][27][28][29][30]. (2) Direct QPU benchmarks (including comparison with other quantum annealing systems and optimization problem solvers) for problems of intermediate size that may or may not need embeddings and solve either real-world or artificial problems [11,[31][32][33][34][35][36][37][38][39][40][41]. (3) Benchmarks of hybrid solvers that use a combination of QPUs and CPUs or GPUs to solve large-scale application problems [12,18,42,43]. ...
Article
Full-text available
We benchmark the quantum processing units of the largest quantum annealers to date, the 5000+ 5000 + qubit quantum annealer Advantage and its 2000+ qubit predecessor D-Wave 2000Q, using tail assignment and exact cover problems from aircraft scheduling scenarios. The benchmark set contains small, intermediate, and large problems with both sparsely connected and almost fully connected instances. We find that Advantage outperforms D-Wave 2000Q for almost all problems, with a notable increase in success rate and problem size. In particular, Advantage is also able to solve the largest problems with 120 logical qubits that D-Wave 2000Q cannot solve anymore. Furthermore, problems that can still be solved by D-Wave 2000Q are solved faster by Advantage. We find, however, that D-Wave 2000Q can achieve better success rates for sparsely connected problems that do not require the many new couplers present on Advantage, so improving the connectivity of a quantum annealer does not per se improve its performance.
... This young field seeks to identify how challenging problems can be formulated for and benefit from quantum hardware. While it remained predominantly theoretical at early stages [63,21], QCV methods from various domains were evaluated on real quantum hardware during the recent few years, including image classification [62,64,19], object detection [55], graph matching [72], mesh alignment [6], robust fitting [29] and permutation synchronisation [9]. ...
Preprint
We present a hybrid classical-quantum framework based on the Frank-Wolfe algorithm, Q-FW, for solving quadratic, linearly-constrained, binary optimization problems on quantum annealers (QA). The computational premise of quantum computers has cultivated the re-design of various existing vision problems into quantum-friendly forms. Experimental QA realizations can solve a particular non-convex problem known as the quadratic unconstrained binary optimization (QUBO). Yet a naive-QUBO cannot take into account the restrictions on the parameters. To introduce additional structure in the parameter space, researchers have crafted ad-hoc solutions incorporating (linear) constraints in the form of regularizers. However, this comes at the expense of a hyper-parameter, balancing the impact of regularization. To date, a true constrained solver of quadratic binary optimization (QBO) problems has lacked. Q-FW first reformulates constrained-QBO as a copositive program (CP), then employs Frank-Wolfe iterations to solve CP while satisfying linear (in)equality constraints. This procedure unrolls the original constrained-QBO into a set of unconstrained QUBOs all of which are solved, in a sequel, on a QA. We use D-Wave Advantage QA to conduct synthetic and real experiments on two important computer vision problems, graph matching and permutation synchronization, which demonstrate that our approach is effective in alleviating the need for an explicit regularization coefficient.
... In particular, various attempts to tackle land-use / land-cover classification recently emerged. Gwaron and Levinsky proposed Quantum Neural Networks (QNN) for multiclass classification of multispectral (Sentinel-2) images [5], while Cavallaro et al. used quantum versions of an ensemble of Support-Vector Machines (SVMs) to perform land-cover binary classification of Landsat images [6]. ...
Article
Full-text available
Objective: Despite recent advancements in quantum computing, the limited number of available qubits has hindered progress in CT reconstruction. This study investigates the feasibility of utilizing quantum annealing-based computed tomography (QACT) with current quantum bit levels. Approach: The QACT algorithm aims to precisely solve quadratic unconstrained binary optimization (QUBO) problems. Furthermore, a novel approach is proposed to reconstruct images by approximating real numbers using the variational method. This approach allows for accurate CT image reconstruction using a small number of qubits. The study examines the impact of projection data quantity and noise on various image sizes ranging from 4×4 to 24×24 pixels. The reconstructed results are compared against conventional reconstruction algorithms, namely maximum likelihood expectation maximization (MLEM) and filtered back projection (FBP). Main result: By employing the variational approach and utilizing two qubits for each pixel of the image, accurate reconstruction was achieved with an adequate number of projections. Under conditions of abundant projections and lower noise levels, the image quality in QACT outperformed that of MLEM and FBP. However, in situations with limited projection data and in the presence of noise, the image quality in QACT was inferior to that in MLEM. Significance: This study developed the QACT reconstruction algorithm using the variational approach for real-number reconstruction. Remarkably, only 2 qubits were required for each pixel representation, demonstrating their sufficiency for accurate reconstruction.
Chapter
This chapter discusses the role of remote sensing (RS) in observing and monitoring our planet, with a specific focus on satellite RS and RS through the use of networked sensors (fixed or mobile). Some history of the development of these systems over the years is first presented. Next, several applications are analyzed, and the advantages and disadvantages of processing of data collected from satellite platforms or sensor networks are highlighted. A combination of heterogeneous data from different sources is also discussed. Finally, present and future trends, employing algorithms of artificial intelligence (AI) and in particular of machine learning (ML) in RS data processing, are discussed.
Article
Full-text available
Quantum Machine Learning (QML) is an emerging technology that only recently has begun to take root in the research fields of Earth Observation (EO) and Remote Sensing (RS), and whose state of the art is roughly divided into one group oriented to fully quantum solutions, and in another oriented to hybrid solutions. Very few works applied QML to EO tasks, and none of them explored a methodology able to give guidelines on the hyperparameter tuning of the quantum part for Land Cover Classification (LCC). As a first step in the direction of quantum advantage for RS data classification, this letter opens new research lines, allowing us to demonstrate that there are more convenient solutions to simply increasing the number of qubits in the quantum part. To pave the first steps for researchers interested in the above, the structure of a new hybrid quantum neural network for EO data and LCC is proposed with a strategy to choose the number of qubits to find the most efficient combination in terms of both system complexity and results accuracy. We sampled and tried a number of configurations, and using the suggested method we came up with the most efficient solution (in terms of the selected metrics). Better performance is achieved with less model complexity when tested and compared with state-of-the-art (SOTA) and standard techniques for identifying volcanic eruptions chosen as a case study. Additionally, the method makes the model more resilient to dataset imbalance, a significant problem when training classical models. Lastly, the code is freely available so that interested researchers can reproduce and extend the results.
Chapter
We present a hybrid classical-quantum framework based on the Frank-Wolfe algorithm, Q-FW, for solving quadratic, linearly-constrained, binary optimization problems on quantum annealers (QA). The computational premise of quantum computers has cultivated the re-design of various existing vision problems into quantum-friendly forms. Experimental QA realisations can solve a particular non-convex problem known as the quadratic unconstrained binary optimization (QUBO). Yet a naive-QUBO cannot take into account the restrictions on the parameters. To introduce additional structure in the parameter space, researchers have crafted ad-hoc solutions incorporating (linear) constraints in the form of regularizers. However, this comes at the expense of a hyper-parameter, balancing the impact of regularization. To date, a true constrained solver of quadratic binary optimization (QBO) problems has lacked. Q-FW first reformulates constrained-QBO as a copositive program (CP), then employs Frank-Wolfe iterations to solve CP while satisfying linear (in)equality constraints. This procedure unrolls the original constrained-QBO into a set of unconstrained QUBOs all of which are solved, in a sequel, on a QA. We use D-Wave Advantage QA to conduct synthetic and real experiments on two important computer vision problems, graph matching and permutation synchronization, which demonstrate that our approach is effective in alleviating the need for an explicit regularization coefficient.
Chapter
Motion segmentation is a challenging problem that seeks to identify independent motions in two or several input images. This paper introduces the first algorithm for motion segmentation that relies on adiabatic quantum optimization of the objective function. The proposed method achieves on-par performance with the state of the art on problem instances which can be mapped to modern quantum annealers.KeywordsMotion segmentationQuantum approachSynchronization
Article
Quantum machine learning (QML) focuses on machine learning models developed explicitly for quantum computers. Availability of the first quantum processor led to further research, particularly exploring possible practical applications of QML algorithms in the remote sensing field. The demand for extensive field data for remote sensing applications has started creating bottlenecks for classical machine learning algorithms. QML is becoming a potential solution to tackle big data problems as it can learn from fewer data. This paper presents a QML model based on a quantum support vector machine (QSVM) to classify Holm Oak trees using PRISMA hyperspectral Imagery. Implementation of quantum models was carried on a quantum simulator and a real-time superconducting quantum processor of IBM. The performance of the QML model is validated in terms of dataset size, overall accuracy, number of qubits, training and predicting speed. Results were indicative that (i) QSVM offered 5% higher accuracy than classical SVM (CSVM) with 50 samples and ≥12 qubits/feature dimensions whereas with 20 samples at 16 Qubits/feature dimension, (ii) training time for QSVM at maximum accuracy was 284 s with 50 samples and with 20 samples was 53.68 s and (iii) predicting time for 400 pixels using the QSVM model trained with 50 samples dataset was 5243 s whereas with 20 samples dataset was 2845 s. Results were indicative that QML offers better accuracy but lack training and predicting speed for hyperspectral data. Another observation is that predicting speed of QSVM depends on the number of samples used to train the model.
Conference Paper
Full-text available
The classification of land-cover classes in remote sensing images can suit a variety of interdisciplinary applications such as the interpretation of natural and man-made processes on the Earth surface. The Convolutional Support Vector Machine (CSVM) network was recently proposed as binary classifier for the detection of objects in Unmanned Aerial Vehicle (UAV) images. The training phase of the CSVM is based on convolutional layers that learn the kernel weights via a set of linear Support Vector Machines (SVMs). This paper proposes the Multi-scale Convolutional Support Vector Machine (MCSVM) network, that is an ensemble of CSVM classifiers which process patches of different spatial sizes and can deal with multi-class classification problems. The experiments are carried out on the EuroSAT Sentinel-2 dataset and the results are compared to the one obtained with recent transfer learning approaches based on pre-trained Convolutional Neural Networks (CNNs).
Article
Full-text available
The promise of quantum computers is that certain computational tasks might be executed exponentially faster on a quantum processor than on a classical processor¹. A fundamental challenge is to build a high-fidelity processor capable of running quantum algorithms in an exponentially large computational space. Here we report the use of a processor with programmable superconducting qubits2–7 to create quantum states on 53 qubits, corresponding to a computational state-space of dimension 2⁵³ (about 10¹⁶). Measurements from repeated experiments sample the resulting probability distribution, which we verify using classical simulations. Our Sycamore processor takes about 200 seconds to sample one instance of a quantum circuit a million times—our benchmarks currently indicate that the equivalent task for a state-of-the-art classical supercomputer would take approximately 10,000 years. This dramatic increase in speed compared to all known classical algorithms is an experimental realization of quantum supremacy8–14 for this specific computational task, heralding a much-anticipated computing paradigm.
Article
Full-text available
Deep learning (DL) algorithms have seen a massive rise in popularity for remote-sensing image analysis over the past few years. In this study, the major DL concepts pertinent to remote-sensing are introduced, and more than 200 publications in this field, most of which were published during the last two years, are reviewed and analyzed. Initially, a meta-analysis was conducted to analyze the status of remote sensing DL studies in terms of the study targets, DL model(s) used, image spatial resolution(s), type of study area, and level of classification accuracy achieved. Subsequently, a detailed review is conducted to describe/discuss how DL has been applied for remote sensing image analysis tasks including image fusion, image registration, scene classification, object detection , land use and land cover (LULC) classification, segmentation, and object-based image analysis (OBIA). This review covers nearly every application and technology in the field of remote sensing, ranging from pre-processing to mapping. Finally, a conclusion regarding the current state-of-the art methods, a critical conclusion on open challenges, and directions for future research are presented.
Article
Full-text available
Recent progress implies that a crossover between machine learning and quantum information processing benefits both fields. Traditional machine learning has dramatically improved the benchmarking and control of experimental quantum computing systems, including adaptive quantum phase estimation and designing quantum computing gates. On the other hand, quantum mechanics offers tantalizing prospects to enhance machine learning, ranging from reduced computational complexity to improved generalization performance. The most notable examples include quantum enhanced algorithms for principal component analysis, quantum support vector machines, and quantum Boltzmann machines. Progress has been rapid, fostered by demonstrations of midsized quantum optimizers which are predicted to soon outperform their classical counterparts. Further, we are witnessing the emergence of a physical theory pinpointing the fundamental and natural limitations of learning. Here we survey the cutting edge of this merger and list several open problems.
Article
Full-text available
Evidence is mounting that Convolutional Networks (ConvNets) are the most effective representation learning method for visual recognition tasks. In the common scenario, a ConvNet is trained on a large labeled dataset (source) and the feed-forward units activation of the trained network, at a certain layer of the network, is used as a generic representation of an input image for a task with relatively smaller training set (target). Recent studies have shown this form of representation transfer to be suitable for a wide range of target visual recognition tasks. This paper introduces and investigates several factors affecting the transferability of such representations. It includes parameters for training of the source ConvNet such as its architecture, distribution of the training data, etc. and also the parameters of feature extraction such as layer of the trained ConvNet, dimensionality reduction, etc. Then, by optimizing these factors, we show that significant improvements can be achieved on various (17) visual recognition tasks. We further show that these visual recognition tasks can be categorically ordered based on their distance from the source task such that a correlation between the performance of tasks and their distance from the source task w.r.t. the proposed factors is observed.
Article
Full-text available
We present a heuristic algorithm for finding a graph H as a minor of a graph G that is practical for sparse G and H with hundreds of vertices. We also explain the practical importance of finding graph minors in mapping quadratic pseudo-boolean optimization problems onto an adiabatic quantum annealer.
Book
A comprehensive introduction to Support Vector Machines and related kernel methods. In the 1990s, a new type of learning algorithm was developed, based on results from statistical learning theory: the Support Vector Machine (SVM). This gave rise to a new class of theoretically elegant learning machines that use a central concept of SVMs—-kernels—for a number of learning tasks. Kernel machines provide a modular framework that can be adapted to different tasks and domains by the choice of the kernel function and the base algorithm. They are replacing neural networks in a variety of fields, including engineering, information retrieval, and bioinformatics. Learning with Kernels provides an introduction to SVMs and related kernel methods. Although the book begins with the basics, it also includes the latest research. It provides all of the concepts necessary to enable a reader equipped with some basic mathematical knowledge to enter the world of machine learning using theoretically well-founded yet easy-to-use kernel algorithms and to understand and apply the powerful algorithms that have been developed over the last few years.
Article
HyperLabelMe is a web platform that allows the automatic benchmarking of remote-sensing image classifiers. To demonstrate this platform's attributes, we collected and harmonized a large data set of labeled multispectral and hyperspectral images with different numbers of classes, dimensionality, noise sources, and levels. The registered user can download training data pairs (spectra and land cover/use labels) and submit the predictions for unseen testing spectra. The system then evaluates the accuracy and robustness of the classifier, and it reports different scores as well as a ranked list of the best methods and users. The system is modular, scalable, and ever-growing in data sets and classifier results.
Article
Land-cover mapping in remote sensing (RS) applications renders rich information for decision support and environmental monitoring systems. The derivation of such information increasingly relies on robust classification methods for identifying the complex land-cover area of different categories. Numerous classification techniques have been designed for the analysis of RS imagery. In this context, support vector machines (SVMs) have recently received increasing interest. However, the need for a small-size training set remains a bottleneck to design efficient supervised classifiers, while an adequate number of unlabeled data is readily available in RS images and can be exploited as a supplementary source of information. To fully leverage these precious unlabeled data, a number of promising advanced SVM-based methods, such as active SVMs, semisupervised SVMs (S3VMs), and SVMs combined with other algorithms, have been developed to analyze satellite imagery. In this literature review, we have surveyed these learning techniques to explore RS images. Moreover, we have provided the empirical evidences of SVMs and three representative techniques. It is our hope that this review will provide guidelines to future researchers to enhance further algorithmic developments in RS applications.
Article
A wide range of methods for analysis of airborne- and satellite-derived imagery continues to be proposed and assessed. In this paper, we review remote sensing implementations of support vector machines (SVMs), a promising machine learning methodology. This review is timely due to the exponentially increasing number of works published in recent years. SVMs are particularly appealing in the remote sensing field due to their ability to generalize well even with limited training samples, a common limitation for remote sensing applications. However, they also suffer from parameter assignment issues that can significantly affect obtained results. A summary of empirical results is provided for various applications of over one hundred published works (as of April, 2010). It is our hope that this survey will provide guidelines for future applications of SVMs and possible areas of algorithm enhancement.