du.sePublications
Change search
Refine search result
1 - 5 of 5
CiteExportLink to result list
Permanent link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Rows per page
  • 5
  • 10
  • 20
  • 50
  • 100
  • 250
Sort
  • Standard (Relevance)
  • Author A-Ö
  • Author Ö-A
  • Title A-Ö
  • Title Ö-A
  • Publication type A-Ö
  • Publication type Ö-A
  • Issued (Oldest first)
  • Issued (Newest first)
  • Created (Oldest first)
  • Created (Newest first)
  • Last updated (Oldest first)
  • Last updated (Newest first)
  • Disputation date (earliest first)
  • Disputation date (latest first)
  • Standard (Relevance)
  • Author A-Ö
  • Author Ö-A
  • Title A-Ö
  • Title Ö-A
  • Publication type A-Ö
  • Publication type Ö-A
  • Issued (Oldest first)
  • Issued (Newest first)
  • Created (Oldest first)
  • Created (Newest first)
  • Last updated (Oldest first)
  • Last updated (Newest first)
  • Disputation date (earliest first)
  • Disputation date (latest first)
Select
The maximal number of hits you can export is 250. When you want to export more records please use the Create feeds function.
  • 1.
    Han, Mengjie
    et al.
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    May, Ross
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    Zhang, Xingxing
    Dalarna University, School of Technology and Business Studies, Energy Technology.
    Wang, Xinru
    Pan, Song
    Yan, Da
    Jin, Yuan
    A novel reinforcement learning method for improving occupant comfort via window opening and closingManuscript (preprint) (Other academic)
  • 2.
    Han, Mengjie
    et al.
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    May, Ross
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    Zhang, Xingxing
    Dalarna University, School of Technology and Business Studies, Energy Technology.
    Wang, Xinru
    Pan, Song
    Yan, Da
    Jin, Yuan
    Xu, Liguo
    A review of reinforcement learning methodologies for controlling occupant comfort in buildings2019In: Sustainable cities and society, ISSN 2210-6707, Vol. 51, article id 101748Article in journal (Refereed)
  • 3.
    Han, Mengjie
    et al.
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    Zhang, Xingxing
    Dalarna University, School of Technology and Business Studies, Energy Technology.
    Xu, Liguo
    May, Ross
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    Pan, Song
    Wu, Jinshun
    A review of reinforcement learning methodologies on control systems for building energy2018Report (Other academic)
    Abstract [en]

    The usage of energy directly leads to a great amount of consumption of the non-renewable fossil resources. Exploiting fossil resources energy can influence both climate and health via ineluctable emissions. Raising awareness, choosing alternative energy and developing energy efficient equipment contributes to reducing the demand for fossil resources energy, but the implementation of them usually takes a long time. Since building energy amounts to around one-third of global energy consumption, and systems in buildings, e.g. HVAC, can be intervened by individual building management, advanced and reliable control techniques for buildings are expected to have a substantial contribution to reducing global energy consumptions. Among those control techniques, the model-free, data-driven reinforcement learning method seems distinctive and applicable. The success of the reinforcement learning method in many artificial intelligence applications has brought us an explicit indication of implementing the method on building energy control. Fruitful algorithms complement each other and guarantee the quality of the optimisation. As a central brain of smart building automation systems, the control technique directly affects the performance of buildings. However, the examination of previous works based on reinforcement learning methodologies are not available and, moreover, how the algorithms can be developed is still vague. Therefore, this paper briefly analyses the empirical applications from the methodology point of view and proposes the future research direction.

  • 4.
    May, Ross
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    The reinforcement learning method: A feasible and sustainable control strategy for efficient occupant-centred building operation in smart cities2019Licentiate thesis, comprehensive summary (Other academic)
    Abstract [en]

    Over half of the world’s population lives in urban areas, a trend which is expected to only grow as we move further into the future. With this increasing trend in urbanisation, challenges are presented in the form of the management of urban infrastructure systems. As an essential infrastructure of any city, the energy system presents itself as one of the biggest challenges. As cities expand in population and economically, global energy consumption increases and as a result so do greenhouse gas (GHG) emissions. To achieve the 2030 Agenda’s sustainable development goal on energy (SDG 7), renewable energy and energy efficiency have been shown as key strategies for attaining SDG 7. As the largest contributor to climate change, the building sector is responsible for more than half of the global final energy consumption and GHG emissions. As people spend most of their time indoors, the demand for energy is made worse as a result of maintaining the comfort level of the indoor environment. However, the emergence of the smart city and the internet of things (IoT) offers the opportunity for the smart management of buildings. Focusing on the latter strategy towards attaining SDG 7, intelligent building control offers significant potential for saving energy while respecting occupant comfort (OC). Most intelligent control strategies, however, rely on complex mathematical models which require a great deal of expertise to construct thereby costing in time and money. Furthermore, if these are inaccurate then energy is wasted and the comfort of occupants is decreased. Moreover, any change in the physical environment such as retrofits result in obsolete models which must be re-identified to match the new state of the environment. This model-based approach seems unsustainable and so a new model-free alternative is proposed. One such alternative is the reinforcement learning (RL) method. This method provides a beautiful solution to accomplishing the tradeoff between energy efficiency and OC within the smart city and more importantly to achieving SDG 7. To address the feasibility of RL as a sustainable control strategy for efficient occupant-centred building operation, a comprehensive review of RL for controlling OC in buildings as well as a case study implementing RL for improving OC via a window system are presented. The outcomes of each seem to suggest RL as a feasible solution, however, more work is required in the form of addressing current open issues such as cooperative multi-agent RL (MARL) needed for multi-occupant/multi-zonal buildings.

  • 5.
    May, Ross
    et al.
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    Zhang, Xingxing
    Dalarna University, School of Technology and Business Studies, Energy Technology.
    Wu, J.
    Han, Mengjie
    Dalarna University, School of Technology and Business Studies, Microdata Analysis.
    Reinforcement learning control for indoor comfort: A survey2019In: IOP Conference Series: Materials Science and Engineering, 2019, Vol. 609, no 6, article id 062011Conference paper (Refereed)
    Abstract [en]

    Building control systems are prone to fail in complex and dynamic environments. The reinforcement learning (RL) method is becoming more and more attractive in automatic control. The success of the reinforcement learning method in many artificial intelligence applications has resulted in an open question on how to implement the method in building control systems. This paper therefore conducts a comprehensive review of the RL methods applied in control systems for indoor comfort and environment. The empirical applications of RL-based control systems are then presented, depending on optimisation objectives and the measurement of energy use. This paper illustrates the class of algorithms and implementation details regarding how the value functions have been represented and how the policies are improved. This paper is expected to clarify the feasible theory and functions of RL for building control systems, which would promote their wider-spread application and thus contribute to the social economic benefits in the energy and built environments.

1 - 5 of 5
CiteExportLink to result list
Permanent link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • chicago-author-date
  • chicago-note-bibliography
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf