About
144
Publications
30,988
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
3,957
Citations
Introduction
I am a full Professor with the Dep. of Wind and Energy Systems, Technical University of Denmark (DTU), and currently heading the section "Energy Markets & Analytics".
I am interested in data-driven and market-oriented approaches to power system operation and planning, also in coordination with other energy systems. My focus area is the intersection of multiple fields, including optimization, game theory, and machine learning for energy applications.
Homepage: www.jalalkazempour.com
Current institution
Additional affiliations
October 2013 - November 2014
February 2015 - October 2016
October 2009 - June 2013
Publications
Publications (144)
The smart grid technology enables an increasing level of responsiveness on the demand side, facilitating demand serving entities - large consumers and retailers - to procure their electricity needs under the best conditions. Such entities generally exhibit a proactive role in the pool, seeking to procure their energy needs at minimum cost. Within t...
This paper proposes an Optimal Power Flow (OPF) model with Flexible AC Transmission System (FACTS) devices to minimize wind power spillage. The uncertain wind power production is modeled through a set of scenarios. Once the balancing market is cleared, and the final values of active power productions and consumptions are assigned, the proposed mode...
This paper proposes an approach for analyzing the impacts of large-scale wind power integration on electricity market equilibria. A pool-based oligopolistic electricity market is considered including a day-ahead market and a number of real-time markets. Wind power is considered within the generation portfolio of the strategic producers, and the unc...
The first of this two-paper series proposes a methodology to characterize generation investment equilibria in a pool-based network-constrained electricity market, where the producers behave strategically. To this end, the investment problem of each strategic producer is represented using a bilevel model, whose upper-level problem determines the opt...
This paper analyzes numerically the approach reported in the companion paper for identifying generation investment equilibria in an electricity market where the producers behave strategically. To this end, a two-node illustrative example and a large-scale case study based on the IEEE reliability test system (RTS) are examined and the results obtain...
In response to increasing grid congestion in the Netherlands, non-firm connection and transport agreements (CTAs) and capacity restriction contracts (CRCs) have been introduced, allowing consumer curtailment in exchange for grid tariff discounts or per-MW compensations. This study examines the interaction between an electrolyzer project, facing siz...
Various factors make electricity markets increasingly complex, making their analysis challenging. This complexity demands advanced analytical tools to manage and understand market dynamics. This paper explores the application of deep reinforcement learning (DRL) and bi-level optimization models to analyze and simulate electricity markets. We introd...
Dynamic pricing through bilevel programming is widely used for demand response but often assumes perfect knowledge of prosumer behavior, which is unrealistic in practical applications. This paper presents a novel framework that integrates bilevel programming with online learning, specifically Thompson sampling, to overcome this limitation. The appr...
Hydrogen produced through electrolysis with renewable power is considered key to decarbonize several hard-to-electrify sectors. This work proposes a novel approach to model the active electricity market participation of co-located renewable energy and electrolyzer plants, based on opportunity-cost bidding. While a renewable energy plant typically h...
We develop a bidding strategy for a hybrid power plant combining co-located wind turbines and an electrolyzer, constructing a price-quantity bidding curve for the day-ahead electricity market while optimally scheduling hydrogen production. Without risk management, single imbalance pricing leads to an all-or-nothing trading strategy, which we term '...
To encourage the participation of stochastic distributed energy resources in Nordic ancillary service markets, the Danish transmission system operator, Energinet, has introduced grid codes requiring a minimum 90% reliability for the full availability of reserve capacity bids. This paper addresses the bidding strategy of flexibility aggregators unde...
One of the main responsibilities of a Transmission System Operator (TSO) operating an electric grid is to maintain a designated frequency (e.g., 50 Hz in Europe). To achieve this, TSOs have created several products called frequency-supporting ancillary services. The Frequency Containment Reserve (FCR) is one of these ancillary service products. Thi...
Energy market designs with non-merchant storage have been proposed in recent years, with the aim of achieving optimal market integration of storage. In order to handle the time-linking constraints that are introduced in such markets, existing works commonly make simplifying assumptions about the end-of-horizon storage level, e.g., by imposing an ex...
The system operators usually need to solve large-scale unit commitment problems within limited time frame for computation. This paper provides a pragmatic solution, showing how by learning and predicting the on/off commitment decisions of conventional units, there is a potential for system operators to warm start their solver and speed up their com...
Due to their slow gas flow dynamics, natural gas pipelines function as short-term storage, the so-called
linepack
. By efficiently utilizing linepack, the natural gas system can provide flexibility to the power system through the flexible operation of gas-fired power plants. This requires accurately representing the gas flow physics governed by p...
This paper proposes a mathematical framework for dynamic pricing in an energy community to enable the provision of capacity limitation services to the distribution grid. In this framework, the energy community complies with a time-variant limit on its maximum power import from the distribution grid in exchange for grid tariff discounts. A bi-level...
This paper investigates how a thermostatically controlled load can deliver flexibility either in form of manual frequency restoration reserves (mFRR) or load shifting, and which one is financially more appealing to such a load. A supermarket freezer is considered as a representative flexible load, and a grey-box model describing its temperature dyn...
We propose and develop a new algorithm for trading wind energy in electricity markets, within an online learning and optimization framework. In particular, we combine a component-wise adaptive variant of the gradient descent algorithm with recent advances in the feature-driven newsvendor model. This results in an online offering approach capable of...
The cost competitiveness of green hydrogen production via electrolysis presents a significant challenge for its large-scale adoption. One potential solution to make electrolyzers profitable is to diversify their products and participate in various markets, generating additional revenue streams. Electrolyzers can be utilized as flexible loads and pa...
The hydrogen production curve of the electrolyzer describes the non-linear and non-convex relationship between its power consumption and hydrogen production. An accurate representation of this curve is essential for the optimal scheduling of the electrolyzer. The current state-of-the-art approach is based on piece-wise linear approximation, which r...
Hybrid power plants comprising renewable power sources and electrolyzers are envisioned to play a key role in accelerating the transition towards decarbonization. It is common in the current literature to use simplified operational models for electrolyzers. It is still an open question whether this is a good practice, and if not, when a more detail...
Electric power systems and the companies and customers that interact with them are experiencing increasing levels of uncertainty due to factors such as renewable energy generation, market liberalization, and climate change. This raises the important question of how to make optimal decisions under uncertainty. This paper aims to provide an overview...
We develop a Nash equilibrium problem representing a perfectly competitive market wherein all players are subject to the same source of uncertainty with an unknown probability distribution. Each player-depending on her individual access to and confidence over empirical data-builds an ambiguity set containing a family of potential probability distri...
The increasing share of renewables in the electricity generation mix comes along with an increasing uncertainty in power supply. In the recent years, distributionally robust optimization has gained significant interest due to its ability to make informed decisions under uncertainty, which are robust to misrepresentations of the distributional infor...
The disturbances from variable and uncertain renewable generation propagate from power systems to natural gas networks, causing gas network operators to adjust gas supply nominations to ensure operational security. To alleviate expensive supply adjustments, we develop control policies to leverage instead the flexibility of linepack – the gas stored...
This paper proposes a regression market for wind agents to monetize data traded among themselves for wind power forecasting. Existing literature on data markets often treats data disclosure as a binary choice or modulates the data quality based on the mismatch between the offer and bid prices. As a result, the market disadvantages either the data s...
As a common practice, the direction of natural gas flow in every pipeline is determined ex-ante for simplification purposes, and treated as a given parameter within the scheduling problem. However, in integrated gas and electric power networks with a large share of intermittent renewable power supply, it is no longer straightforward to optimally pr...
Excess heat will be an important heat source in future carbon-neutral district heating systems. A barrier to excess heat integration is the lack of appropriate scheduling and pricing systems for these producers, which generally have small capacity and limited flexibility. In this work, we formulate and analyze two methods for scheduling and pricing...
Denmark has recently set a legislation called Market Model 3.0 to make the ecosystem for demand-side flexibility more attractive to stakeholders involved. The main change is to relax the previous mandate that required each aggregator to be associated with a retailer and a balance responsible party. We explain the rationale behind such a change and...
Energy market designs with non-merchant storage have been proposed in recent years, with the aim of achieving optimal integration of storage. In order to handle the time-linking constraints that are introduced in such markets, existing works commonly make simplifying assumptions about the end-of-horizon storage level. This work analyzes market prop...
Convex optimization finds many real-life applications, where--optimized on real data--optimization results may expose private data attributes (e.g., individual health records, commercial information), thus leading to privacy breaches. To avoid these breaches and formally guarantee privacy to optimization data owners, we develop a new privacy-preser...
Denmark has recently set a new legislation called Market Model 3.0 that explicitly re-defines the position of flexibility aggregators, aiming to further promote demand-side flexibility. The main change is to relax the previous mandate that required each aggregator to be associated with a retailer and a balance responsible party. We explain the rati...
This paper proposes and develops a new algorithm for trading wind energy in electricity markets, within an online learning and optimization framework. In particular, we combine a component-wise adaptive variant of the gradient descent algorithm with recent advances in the feature-driven newsvendor model. This results in an online offering approach...
Energy forecasting has attracted enormous attention over the last few decades, with novel proposals related to the use of heterogeneous data sources, probabilistic forecasting, online learning, etc. A key aspect that emerged is that learning and forecasting may highly benefit from distributed data, though not only in the geographical sense. That is...
The ever-increasing interest in the collection of data by advancing technical and social sectors makes it distributed in terms of ownership. Also, the diverse expertise of these owners results in the extraction of varying quality of predictive information. Thus, the platforms for pooling forecasts based on distributed data and heterogeneous predict...
The growing penetration of stochastic renewable energy sources increases the need for operational flexibility to cope with imbalances. Existing proposals for flexibility procurement are envisioning markets where the transmission system operator (TSO) can access flexible resources located at the distribution system operator (DSO)-level and vice vers...
Excess heat will be an important heat source in future carbon-neutral district heating systems. A barrier to excess heat integration is the lack of appropriate scheduling and pricing systems for these producers, which generally have small capacity and limited flexibility. In this work, we formulate and analyze two methods for scheduling and pricing...
As a common practice, the direction of natural gas flow in every pipeline is determined ex-ante for simplification purposes, and treated as a given parameter within the scheduling problem. However, in integrated gas and electric power networks with a large share of intermittent renewable power supply, it is no longer straightforward to optimally pr...
We propose stochastic control policies to cope with uncertain and variable gas extractions in natural gas networks. Given historical gas extraction data, these policies are optimized to produce the real-time control inputs for nodal gas injections and for pressure regulation rates by compressors and valves. We describe the random network state as a...
In the context of transition towards sustainable, cost-efficient and reliable energy systems, the improvement of current energy and reserve dispatch models is crucial to properly cope with the uncertainty of weather-dependent renewable power generation. In contrast to traditional approaches, distributionally robust optimization offers a risk-aware...
Current bid formats in pool-based electricity markets are ill-equipped to accommodate the broad range of non-conventional sources of flexibility, such as demand response and interconnected heating , natural gas and water infrastructure networks. To address this issue, this paper introduces the novel price-region bid format to be used in both forwar...
This paper proposes a regression market for wind agents to monetize data traded among themselves for wind power forecasting. Existing literature on data markets often treats data disclosure as a binary choice or modulates the data quality based on the mismatch between the offer and bid prices. As a result, the market disadvantages either the data s...
Energy forecasting has attracted enormous attention over the last few decades, with novel proposals related to the use of heterogeneous data sources, probabilistic forecasting, online learn-ing, etc. A key aspect that emerged is that learning and forecasting may highly benefit from distributed data, though not only in the geographical sense. That i...
The disturbances from variable and uncertain renewable generation propagate from power systems to natural gas networks, causing gas network operators to adjust gas supply nominations to ensure operational security. To alleviate expensive supply adjustments, we develop control policies to leverage instead the flexibility of linepack -- the gas store...
Current electricity and natural gas markets operate with deter-ministic description of uncertain supply, and in a temporally and sectorally decoupled way. This practice in energy systems is being challenged by the increasing integration of stochastic renewable energy sources. There is a growing need for exchanging operational flexibility among ener...
As more renewables are integrated into the power system, capacity expansion planners need more advanced long-term decision-making tools to properly model short-term stochastic production uncertainty and to explore its effects on expansion decisions. We develop a distributionally robust generation expansion planning model, accounting for a family of...
Local flexibility markets have a substantial potential to unlock the flexibility of distributed energy resources in the distribution level. Capacity limitation services have been perceived as one of the most appealing products to be traded in these markets. This work argues why classical market-clearing and pricing mechanisms such as pay-as-bid, un...
To the best of our knowledge, this paper proposes for the first time a design of a continuous local flexibility market that explicitly considers network constraints. Continuous markets are expected to be the most appropriate design option during the early stages of local flexibility markets, where insufficient liquidity can hinder market developmen...
When energy customers schedule loads ahead of time, this information, if acquired by their energy retailer, can improve the retailer's load forecasts. Better forecasts lead to wholesale purchase decisions that are likely to result in lower energy imbalance costs, and thus higher profits for the retailer. Therefore, this paper monetizes the value of...
This paper goes beyond the current state of the art related to Wasserstein distributionally robust optimal power flow problems, by adding dependence structure (correlation) and support information. In view of the space-time dependencies pertaining to the stochastic renewable power generation uncertainty , we apply a moment-metric-based distribution...
Although distribution grid customers are obliged to share their consumption data with distribution system operators (DSOs), a possible leakage of this data is often disregarded in operational routines of DSOs. This paper introduces a privacy-preserving optimal power flow (OPF) mechanism for distribution grids that secures customer privacy from unau...
We address the market design issue for a local energy community, comprising prosumers, consumers, photovoltaic and energy storage systems, all connected as a community to a distribution grid. Our work explores different market design options based on cooperative and non-cooperative game-theoretic models that enable an economic access to the benefit...
The increasing share of renewables in the electrical energy generation mix comes along with an increasing uncertainty in power supply. In the recent years, distributionally robust optimization has gained significant interest due to its ability to make informed decisions under uncertainty, which are robust to misrepresentations of the distributional...
We propose a new forward electricity market framework that admits heterogeneous market participants with second-order cone strategy sets, who accurately express the nonlinearities in their costs and constraints through conic bids, and a network operator facing conic operational constraints. In contrast to the prevalent linear-programming-based elec...
Local energy communities are proposed as a regulatory framework to enable the market participation of end-consumers. However, volatile local market-clearing prices, and consequently, volatile cost give rise to local market participants with generally heterogeneous risk attitudes. To prevent the increased operational cost of communities due to conse...
In an increasingly decentralized energy system with tight interdependencies with heat and electricity markets, prosumers, who act both as consumers and producers at the interface between the markets, are becoming important operational flexibility providers. Policy-makers and market operators need a better understanding of the motivations and behavi...
The Danish government has set very ambitious binding targets regarding decarbonization. By 2030, carbon dioxide emissions must be reduced by 70% compared to the 1990 level. This can be achieved primarily through a predominantly renewables-based electricity system and the electrification of energy demand...
The interdependence between electricity and natural gas systems has lately increased due to the wide deployment of gas-fired power plants (GFPPs). Moreover, weather-driven renewables introduce uncertainty in the operation of the integrated energy system, increasing the need for operational flexibility. Recently proposed stochastic dispatch models o...
Using flexibility from the coordination of power and natural gas systems helps with the integration of variable renewable energy in power systems. To include this flexibility into the operational decision-making problem, we propose a distributionally robust chance-constrained co-optimization of power and natural gas systems considering flexibility...
Existing energy networks can foster the integration of uncertain and variable renewable energy sources by providing additional operational flexibility. In this direction, we propose a combined power, heat, and natural gas dispatch model to reveal the maximum potential “network flexibility”, corresponding to the ability of natural gas and district h...
We propose stochastic control policies to cope with uncertain and variable gas extractions in natural gas networks. Given historical gas extraction data, these policies are optimized to produce the real-time control inputs for nodal gas injections and for pressure regulation rates by compressors and valves. We describe the random network state as a...
We develop a stochastic equilibrium model for an electricity market with asymmetric renewable energy forecasts. In our setting, market participants optimize their profits using public information about a conditional expectation of energy production but use private information about the forecast error distribution. This information is given in the f...
This paper addresses a centralized generation expansion planning problem, accounting for both long- and short-term uncertainties. The long-term uncertainty (demand growth) is modeled via a set of scenarios, while the short-term uncertainty (wind power generation) is described by a family of probability distributions with the same first- and second-...
This paper proposes a two-stage auction-based local market mechanism to allocate physical storage rights (PSRs). As a market product, PSRs are provided by a storage owner and enable the local market participants (including renewable producers, consumers and prosumers) to access the storage. That is, they can book storage in the form of PSRs and dis...
This paper develops a novel differentially private framework to solve convex optimization problems with sensitive optimization data and complex physical or operational constraints. Unlike standard noise-additive algorithms, that act primarily on the problem data, objective or solution, and disregard the problem constraints, this framework requires...
The large penetration of stochastic and non-dispatchable renewable energy sources increases the need for operational flexibility in power systems. Flexibility can be unlocked by aligning the existing interactions and synergies between heat and power systems. However, in the current sequential order of heat and electricity market clearings, the heat...
Using flexibility from the coordination of power and natural gas systems helps with the integration of variable renewable energy in power systems. To include this flexibility into the operational decision-making problem, we propose a distributionally robust chance-constrained co-optimization of power and natural gas systems considering flexibility...
Existing energy networks can foster the integration of uncertain and variable renewable energy sources by providing additional operational flexibility. In this direction, we propose a combined power, heat, and natural gas dispatch model to reveal the maximum potential "network flexibility", corresponding to the ability of natural gas and district h...
We develop a stochastic equilibrium model for an electricity market with asymmetric renewable energy forecasts. In our setting, market participants optimize their profits using public information about a conditional expectation of energy production but use private information about the forecast error distribution. This information is given in the f...
Coordinating the operation of combined heat and power plants (CHPs) and heat pumps (HPs) at the interface between heat and power systems is essential to achieve a cost-effective and efficient operation of the overall energy system. Indeed, in the current sequential market practice, the heat market has no insight into the impacts of heat dispatch on...
Due to increasing penetration of stochastic renewable energy sources in electric power systems, the need for flexible resources especially from fast-start conventional generation units (e.g., combined cycle gas turbine plants) is growing. The fast-start conventional units are being operated more frequently in order to respond to the variability and...
Although distribution grid customers are obliged to share their consumption data with distribution system operators (DSOs), a possible leakage of this data is often disregarded in operational routines of DSOs. This paper introduces a privacy-preserving optimal power flow (OPF) mechanism for distribution grids that secures customer privacy from unau...
A large number of mechanisms are proposed to manage potential problems in distribution networks caused by the participation of distributed energy resources (DERs) in the wholesale markets. In this paper, we first introduce a practical and straightforward mechanism, based on capacity limits, which avoids conflicts between the transmission system ope...
Bi-level optimization constitutes the most popular mathematical methodology for modeling the deregulated electricity market. However, state-of-the-art models neglect the physical non-convex operating characteristics of market participants, due to their inherent inability to capture binary decision variables in their representation of the market cle...
This paper proposes a market mechanism for co-optimization of energy and reserve procurement in day-ahead electricity markets with high shares of renewable energy. The single-stage chance-constrained day-ahead market clearing problem takes uncertain wind in-feed into account, resulting in optimal day-ahead dispatch schedule and an affine participat...
In current practice, the day-ahead market-clearing outcomes are not necessarily feasible for distribution networks, i.e, the network constraints might not be satisfied. Hence, the distribution system operator may consider an ex-post re-dispatch mechanism, exploiting potential flexibility of local distributed energy resources (DERs) including demand...
We study a competitive electricity market equilibrium with two trading stages, day-ahead and real-time. The welfare of each market agent is exposed to uncertainty (here from renewable energy production), while agent information on the probability distribution of this uncertainty is not identical at the day-ahead stage. We show a high sensitivity of...
Distributed algorithms enable private Optimal Power Flow (OPF) computations by avoiding the need in shar- ing sensitive information localized in algorithms sub-problems. However, adversaries can still infer this information from the coordination signals exchanged across iterations. This paper seeks formal privacy guarantees for distributed OPF comp...
Coordinating the operation of units at the interface between heat and electricity systems, such as combined heat and power plants and heat pumps, is essential to reduce inefficiencies in each system and help achieve a cost-effective and efficient operation of the overall energy system. These energy systems are currently operated by sequential marke...
A major restructuring of electricity markets takes place worldwide, pursuing maximum economic efficiency. In most modern electricity markets, including the widely adapted Locational Marginal Price (LMP) market, efficiency is only guaranteed under the assumption of perfect competition. Moreover , market design is heavily focused on deterministic con...
This paper proposes a fixed-term (e.g., monthly) Demand Response (DR) contract market. Based on the outcomes of this market, the Distribution System Operator (DSO) pays DR aggregators to modify power consumption within a fixed window each day. Two contract types are introduced: Scheduled contracts require the DR daily, while conditional contracts r...
Utilizing operational flexibility from natural gas networks can foster the integration of uncertain and variable renewable power production. We model a combined power and natural gas dispatch to reveal the maximum potential of linepack, i.e., energy storage in the pipelines, as a source of flexibility for the power system. The natural gas flow dyna...
This paper addresses a multi-stage generation investment problem for a strategic (price-maker) power producer in electricity markets. This problem is exposed to different sources of uncertainty, including short-term operational (e.g., rivals' offering strategies) and long-term macro (e.g., demand growth) uncertainties. This problem is formulated as...