HVAC system modeling and control methods: a review and case study

Document Type : Original Article

Authors

1 Dept. of Elec. Eng., Bu-Ali Sina University, Mahdieh Street, 65178-38695, Hamedan, Iran

2 Dept. of Chem. Eng. and Oil Refining, Basrah University for Oil and Gas, Basrah, 61004, Iraq

3 Dept. of Oil and Gas Eng., Basrah University for Oil and Gas, Basrah, 61004, Iraq

10.22109/jemt.2022.298902.1324

Abstract

Improvement of air quality and provision of the residents’ comfort in different buildings are the main tasks of HVAC (heating, ventilating, and air conditioning) systems. A large number of control methods have been applied to HVAC systems to adjust the indoor temperature in buildings and, at the same time minimizing energy consumption to be reflected in minimizing energy cost, furthermore, it reduces the peak load of the power grid, and provide ancillary services such as frequency regulation. This paper reviews different techniques proposed for modeling HVAC systems. Moreover, it provides a comprehensive review of HVAC system control methods, categorizes them, and then extracts their advantages, disadvantages, and main features. Furthermore, an HVAC system model is proposed and compared to the RLF (residential load factor) model with and without the Takagi-Sugeno Fuzzy (TSF) controller, which is applied to control the proposed and RLF HVACs. The results of the proposed HVAC model and the complete RLF model are compared from different aspects. The results demonstrate the efficiency and robustness of the proposed model. The energy consumption of the proposed HVAC system and RLF models, by applying TSF controller along a day are evaluated. The results show that the proposed HVAC system model is saving energy around 10.06% when compared with the RLF model.

Keywords

Main Subjects


1. G. Pierre, H. Steinfeld, B. Henderson, A. Mottet, C. Opio, J. Dijkman, A. Falcucci, and G. Tempio, "Tackling climate change through livestock: a global assessment of emissions and mitigation opportunities,". Food and Agriculture Organization of the United Nations (FAO), vol. 14, no. 2, 2013.
2. R. Z. Homod, K. S. Gaeid, S. M. Dawood, A. Hatami, and K. S. Sahari, "Evaluation of energy-saving potential for optimal time response of HVAC control system in smart buildings," Appl. Energy, vol. 271, no. August, p. 115255, 2020.
3. P. Octavian, L. F. Tutunaru, F. Bode, A. C. Abrudan, and M. C. Balan. "Energy efficiency of PCM integrated in fresh air cooling systems in different climatic conditions," Applied energy, vol.212, pp.976-996, 2018.
4. R. Z. Homod, "Analysis and optimization of HVAC control systems based on energy and performance considerations for smart buildings, " Renew. Energy, vol. 126, pp. 49–64, 2018.
5. R. Z. Homod, and S. SM Khairul. "Intelligent HVAC control for high energy efficiency in buildings: achieving energy savings with developed nonlinear control strategies of central air-condition for intelligent buildings, " LAP LAMBERT Academic Publishing, 2014.
6. A. I. Dounis and C. Caraiscos, "Advanced control systems engineering for energy and comfort management in a building environment — A review ", Renewable and Sustainable Energy Reviews. vol. 13, pp. 1246–1261, 2009.
7. R. Z. Homod, "Review on the HVAC System Modeling Types and the Shortcomings of Their Application," Journal of Energy, 2013.
8. R. Z. Homod, "Modeling and Fault-Tolerant Control Developed for HVAC Systems". LAP LAMBERT Academic Publishing, 2014.
9. W. Sheng-wei, J. Wang, and J. Burnett., "Mechanistic model of centrifugal chillers for HVAC system dynamics simulation," Build Serv Eng Res Technol, pp.73–83., 2000.
10. C. Xiao, Q. Wang, and J. Srebric, "A data-driven state-space model of indoor thermal sensation using occupant feedback for low-energy buildings, " Energy Build J., 91, pp. 187–198, 2015.
11. Z. Dongliang, X. Xia, and N. Cai, "A dynamic simplified model of radiant ceiling cooling integrated with underfloor ventilation system, "Appl. Therm. Eng.Journal, 106, pp.415-422, 2016.
12. M. Giorgio, J. Chen, and G. Lowry. "Development of room temperature and relative humidity linear parametric models for an open office using BMS data." Energy and Buildings, vol.42, no.3, pp.348-356, 2010.
13. K. Andrew, M. Li, and F. Tang, "Modeling and optimization of HVAC energy consumption," Applied Energy, vol.87, no.10, pp.3092-3102, 2010.
14. M. Yudong, J. Matuško, and F. Borrelli. "Stochastic model predictive control for building HVAC systems: Complexity and conservatism," IEEE Transactions on Control Systems Technology, vol. 23, no.1, pp.101-116. 2014.
15. G. Ali, C. Tang, and B. Becerik-Gerber. "An online learning approach for quantifying personalized thermal comfort via adaptive stochastic modeling," Building and Environment, vol. 92, pp. 86–96, 2015.
16. A. Afram and F. Janabi-Sharifi, "Review of modeling methods for HVAC systems" , Applied Thermal Engineering, vol. 67, 2014.
17. G. H. Afroz, GM Shafiullah, T. Urmeea, "Modeling techniques used in building HVAC control systems: A review," Renew. Sustain. Energy Rev., pp. 1–21, 2017.
18. J. Rehrl, D. Schwingshackl, and M. Horn, "A modeling approach for HVAC systems based on the LoLiMoT algorithm," IFAC Proceedings ,vol.47, no. 3, 10862-10868. 2014.
19. M. Barbosa and N. Mendes, "Combined simulation of central HVAC systems with a whole-building hygrothermal model," Energy and Buildings, vol.40, no. 3, pp.276-288, 2008.
20. I. Ursu, I. Nastase, S. Caluianu, A. Iftene, and A. Toader, "Intelligent control of HVAC systems. Part I: Modeling and synthesis, " INCAS Bull., vol. 5, no. 1, pp. 103–118, 2013.
21. K. Arendt, M. Jradi, H. R. Shaker, C. T. Veje, and S. Denmark, "Comparative Analysis Of White- , Gray- And Black-Box Models For Thermal Simulation Of Indoor Environment: Teaching Building Case Study General description, " In Proceedings of the 2018 Building Performance Modeling Conference and SimBuild co-organized by ASHRAE and
IBPSA-USA, Chicago, IL, USA, pp. 26-28. 2018.
22. J. C. Yiu and S. Wang, "Multiple ARMAX modeling scheme for forecasting air conditioning system performance," Energy Conversion and Management, vol. 48, pp. 2276–2285, 2007.
23. A. Afram and F. Janabi-Sharifi, "Gray-box modeling and validation of residential HVAC system for control system design, " Appl. Energy, vol. 137, pp. 134–150, 2015.
24. Z. Yi, and V. I. Hanby, "Model-based control of renewable energy systems in buildings," HVAC&R Research vol.12, no. S1, pp.739-760, 2006.
25. J. E. Braun, "A general control algorithm for cooling towers in cooling plants with electric and/or gas-driven chillers, " HVAC&R Res., pp. 581–598, 2007.
26. S. Andreas, G. Zucker, and R. Hofmann. "Automatically creating HVAC control strategies based on Building Information Modeling (BIM): Heat provisioning and distribution." Energies, vol. 13, no. 17, pp.4403, 2020.
27. A. Niccolo, M. Manfren, and G. Marenzi, "Building Automation and Control Systems and performance optimization: A framework for analysis," Renewable and Sustainable Energy Reviews, vol.75, pp. 313–330., 2017.
28. D. Picard and L. Helsen, "Cloud-based implementation of white-box model predictive control for a GEOTABS office building: A field test demonstration," J. Process Control, vol. 88, pp. 63–77, 2020.
29. M. Jia, “Building Performance Evaluation Using Coupled Simulation of EnergyPlus TM and an Occupant Behavior Model,” , Sustainability, vol.12, no.10, pp.4086.2020.
30. D. Azuatalam, W. Lee, F. De Nijs, and A. Liebman, "Reinforcement Learning for Whole-building HVAC Control and Demand Response, " Energy AI, p. 100020, 2020.
31. K. Eydner, M. Toufek, B. Henzler, and T. Stergiaropoulos, "Investigation of multizone building with HVAC system using a coupled thermal and airflow model, " CLIMA, vol. 111, pp. 1–8, 2019.
32. J. Woods and E. Bonnema, "Regression-based approach to modeling emerging HVAC technologies in EnergyPlus: A case study using a Vuilleumier-cycle heat pump, " Energy Build., vol. 186, pp. 195–207, 2019.
33. Jani, D. B., K. Bhabhor, M. Dadi, S. Doshi, P. V. Jotaniya, H. Ravat, and K. Bhatt, "A review on use of TRNSYS as simulation tool in performance prediction of desiccant cooling cycle," Journal of Thermal Analysis and
Calorimetry, vol.140, no. 5, pp.2011-2031, 2020.
34. R. Mohamad, and N. Kelly, "Toward better estimation of HVAC Loads: integrating a detailed human thermal model into building simulation," Energy Procedia vol. 122, pp. 1147–1152, 2017.
35. R. Zhang, T. Hong, and L. Berkeley, "Modeling And Simulation Of Operational Faults Of Hvac Systems Using Energyplus, " ASHRAE and IBPSA-USA SimBuild, Building Performance Modeling Conference Salt
Lake City, UT, August 8-12, 2016.
36. P. Taylor, J. Zhao, K. P. Lam, B. E. Ydstie, and O. T. Karaguzel, "EnergyPlus model-based predictive control within design–build–operate energy information modelling infrastructure, " J. Build. Perform. Simul.,
pp. 37–41, 2015.
37. S. Ahamed, R. Zmeureanu, N. Cortrufo, and J. Candanedo, "Gray-box virtual sensor of the supply air temperature of air handling units, " Sci. Technol. Built Environ., pp. 1–12, 2020.
38. W. Xiong and J. Wang, "A semi-physical static model for optimizing power consumption of HVAC systems," Control Eng. Pract., vol. 96, p. 104312, 2020.
39. K. Saurav, "Gray-Box Approach for Thermal Modelling of Buildings for Applications in District Heating and Cooling Networks," In Proceedings of the Eighth International Conference on Future Energy Systems, pp.
347-352. 2017.
40. R. D. Coninck, F. Magnusson, J. Åkesson, and L. Helsen, "Toolbox for development and validation of grey-box building models for forecasting and control," J. Build. Perform. Simul., vol. 9, no. 3, pp. 288–303, 2016.
41. Y. Ji and P. Xu, "Model Based Indirect Submetering Method of HVAC End-use in Existing Office Building," Procedia Eng., vol. 121, no. 114, pp. 1705–1712, 2015.
42. B. Delcroix, J. L. Ny, M. Bernier, M. Azam, B. Qu, and J. S. Venne, "Autoregressive neural networks with exogenous variables for indoor temperature prediction in buildings, " Build. Simul., 2020.
43. C. Cui, X. Zhang, and W. Cai, "An energy-saving oriented air balancing method for demand controlled ventilation systems with branch and black-box model," Appl. Energy, vol. 264, p. 114734, 2020.
44. A. Afram, A. S. Fung, F. Janabi-Sharifi, and K. Raahemifar, "Development and performance comparison of low-order black-box models for a residential HVAC system, " Journal of Building Engineering, vol. 15, pp. 137–155, 2018.
45. H. B. Gunay, W. Shen, and C. Yang, "Blackbox modeling of central heating and cooling plant equipment performance Blackbox modeling of central heating and cooling plant equipment performance, " Science and Technology for the Built Environment, vol.24, no. 4, p.396-409, 2017.
46. C. K. Sara, and C. Kallus, "Data-driven methodology for energy and peak load reduction of residential HVAC systems," vol. 145, pp. 852–859, 2016.
47. R. H. Chintala, and B. P. Rasmussen, "Automated Multi-Zone Linear Parametric Black Box Modeling approach For Building HVAC Systems," In Dynamic Systems and Control Conference, American Society of Mechanical Engineers, vol. 57250, pp. 1–10, 2015.
48. S. Royer, S. Thil, and T. Talbert, "Black-box modeling of buildings thermal behavior using system identification," IFAC Proceedings, vol. 47, no.3, pp.10850-10855, 2014.
49. K. Macek, G. Kontes, and V. Dimitrios, "Black-Box Optimization for Buildings and Its Enhancement by Advanced Communication Infrastructure Optimization in Buildings," Advances in Distributed Computing and Artificial Intelligence Journal, vol.2, no.2, pp.53, 53–64, 2013.
50. H. Fock, E. Mara, T. A. Lauret, and A. J. Boyer, "Black-Box Modelling Of HVAC System: Improving The Performances Of Neural Networks Eric Fock," arXiv Prepr. arXiv1212.5594., 2012.
51. A. Almabrok, M. Psarakis, and A. Dounis, "Fast tuning of the PID controller in an HVAC system using the Big Bang-Big Crunch algorithm and FPGA technology," Algorithms, vol. 11, no.10, 2018.
52. M. Imal, "Design and implementation of energy efficiency in HVAC systems based on robust PID control for industrial applications," J. Sensors, 2015.
53. C. Blasco, J. Monreal, and I. Ben, "Modelling and PID Control of HVAC System According to Energy Efficiency and Comfort Criteria," In Sustainability in Energy and Buildings, pp. 365–374, 2012.
54. G. Ulpiani, "Comparing the performance of on / off, PID and fuzzy controllers applied to the heating system of an energy-efficient building," Energy and Buildings, vol.116, pp.1-17, 2016.
55. K. Cetin, M. H. Fathollahzadeh, and N. Kunwar, "Development and validation of an HVAC on/off controller in EnergyPlus for energy simulation of residential and small commercial buildings," Energy Build., 2018.
56. S. J. Salsbury, T. Mhaskar, P., &  Qin, "Predictive control methods to improve energy efficiency and reduce demand in buildings," Comput. Chem. Eng., vol. 51, pp. 77-85, 2013.
57. A. Almusaed, A. Almssad, R.Z. Homod, and I. Yitmen, "Environmental Profile on Building Material Passports for Hot Climates", Sustainability, vol. 12, no. 9, p. 3720, 2020.
58. A. Maytham, A. Mohamed, R. Z. Homod, H. Shareef, and K. Khalid, "Awareness on energy management in residential buildings: A case study in Kajang and Putrajaya," Journal of Engineering Science and Technology, vol. 12, no. 5, pp. 1280–1294, 2017.
59. A. Parisio, D. Varagnolo, D. Risberg, G. Pattarello, M. Molinari, and K. H. Johansson, "Randomized Model Predictive Control for HVAC Systems," In Proceedings of the 5th ACM Workshop on Embedded Systems For Energy-Efficient Buildings, pp. 1-8. 2013.
60. R. Carli, G. Cavone, S. Ben Othman, and M. Dotoli, "IoT based architecture for model predictive control of HVAC systems in smart buildings,
" Sensors (Switzerland), vol. 20, no. 3, pp. 1–18, 2020.
61. M. Amin, and B. Dong. "Occupancy behavior based model predictive control for building indoor climate—A critical review," Energy and Buildings, vol. 129, pp. 499–513., 2016.
62. A Afram and F Ja nabi-Sharifi , "Theory and applications of HVAC control systems-A review of model predictive control (MPC)," Building and Environment, vol.72, pp. 343-355, 2014.
63. D. P. I. Hazyuk, C. Ghiaus, "Model predictive control of thermal comfort as a benchmark for controller performance," J. Autom. Constr., pp. 98–109, 2014.
64. M. Soudari, V. Kaparin, and S. Srinivasan, "Predictive smart thermostat controller for heating, ventilation, and air-conditioning systems,", Proceedings of the Estonian Academy of Sciences, vol.67, no. 3, pp. 291–299, 2018.
65. G. R. Gonc, A. S. Bazanella, and C. Lorenzini, "Data-Driven LQR Control Design," IEEE control systems letters, vol.3, no.1, pp.180-185, 2018.
66. B. Thomas, M Soleimani-Mohseni, P Fahlén, "Feed-forward in temperature control of buildings," Energy Build. Sci. Direct, vol.37, no. 7, pp.755-761, 2005.
67. J.J. Wang, C.F. Zhang, Y.Y. Jing, "Research of Cascade Control with an Application to Central Air-Conditioning System, ", In 2007 International Conference on Machine Learning and Cybernetics, IEEE, vol. 1, pp. 498-503., 2007.
68. N. Jain, R. J. Otten, and A. G. Alleyne, "Decoupled Feedforward Control for an Air-Conditioning and Refrigeration System," In Proceedings of the 2010 American control conference, IEEE, pp. 5904–5909, 2010.
69. C. H. Mayr, N. Euler-Rolle, M. Kozek, C. Hametner, and S. Jakubek, "Control Engineering Practice Engine control unit PID controller calibration by means of local model networks," Control Eng. Pract., vol. 33, pp. 125–135, 2014.
70. D. Ivanova, N. Valov, and M. Deyanov, "Application of the genetic algorithm for cascade control of a HVAC system," MATEC Web Conf., vol. 292, pp. 01064, 2019.
71. K. Kianfar and M. Saif, "Cascaded Control of Superheat Temperature of an HVAC System Via Super Twisting Sliding Mode Control", IFAC, vol. 47, no. 3., 2014.
72. C. Lin and F. Hsiao, "Applied Sciences Proportional-Integral Sliding Mode Control with an Application in The Balance Control of A Two Wheel Vehicle System," Applied Sciences, vol.10, no. 15, pp.5087., 2020.
73. A. Shah, D. Huang, Y. Chen, X. Kang, and N. Qin, "Robust sliding mode control of air handling unit for energy efficiency enhancement, " Energies, vol. 10, no. 11, 2017.
74. O. H. Hameed, J. J. Faraj, and M. S. Alwan, "A Review of Intelligent Control Approaches in Heating Ventilation and Air Conditioning Systems," J. Mech. Eng. Res. Dev., vol. 43, no. 6, pp. 135–166, 2020.
75. E. Semsar-Kazerooni, M. J. Yazdanpanah, and C. Lucas, "Nonlinear control and disturbance decoupling of HVAC systems using feedback linearization and backstepping with load estimation," IEEE Trans. Control Syst. Technol., vol. 16, no. 5, pp. 918–929, 2008.
76. Z. Wang and G. Hu, "Economic MPC of nonlinear systems with nonmonotonic Lyapunov functions and its application to HVAC control," Int. J. Robust Nonlinear Control, vol. 28, no. 6, pp. 2513–2527, 2018.
77. L. Zheng and L. Cai, "A distributed demand response control strategy using Lyapunov optimization," IEEE Trans. Smart Grid, vol. 5, no. 4, pp. 2075–2083, 2014.
78. C.G. Rieger and D.S. Naidu, "Demonstration of a Hybrid Intelligent Control Strategy for Critical Building HVAC Systems," J. Control Intell. Syst., pp. 1-22., 2010.
79. C. Guo, Q. Song, and W. Cai, "A neural network assisted cascade control system for air handling unit," IEEE Trans. Ind. Electron., vol. 54, no. 1, pp. 620–628, 2007.
80. K. M. and A. H. Soyguder S, "Design and simulation of self-tuning PID-type fuzzy adaptive control for an expert HVAC system," Expert Syst Appl., pp. 4566–73., 2009.
81. A. Afram, F. Janabi-Sharifi, A. S. Fung, and K. Raahemifar, "Artificial neural network ( ANN ) based model predictive control ( MPC ) and optimization of HVAC systems: A state of the art review and case study of a residential HVAC system," Energy Build., vol. 141, pp. 96–113, 2017.
82. A. Aswani, M. Neal, T. Jay, K. Andrew, C. David, and T. Claire, "Energyefficient building HVAC control using hybrid system LBMPC." IFAC Proceedings, vol.45, no.17, pp.496-501, 2012.
83. M. Fiorentini, P. Cooper, Z. Ma, and D. A. Robinson, "Hybrid model predictive control of a residential HVAC system with PVT energy generation and PCM thermal storage," Energy Procedia, vol. 83, pp. 21–30, 2015.
84. J. Bai and X. Zhang, "A new adaptive PI controller and its application in HVAC systems," Energy Conversion and Management, vol. 48, pp. 1043–1054, 2007.
85. R. Z. Homod, T. M. I. Mahlia, and H. A. F. Mohamed, "PID-Cascade for HVAC System Control for HVAC System Control" In International Conference on Control, Instrumentation and Mechatronic Engineering (CIM09,), pp. 598-603, 2009.
86. J. Aguilar, "A survey about fuzzy cognitive maps papers," International journal of computational cognition, vol.3, no. 2 pp. 27–33., 2005.
87. R. Z. Homod, K. Salleh, M. Sahari, H. A. F. Almurib, and F. Ha, "RLF and TS fuzzy model identification of indoor thermal comfort based on PMV/PPD," Building and Environment, vol.49, pp.141-153., 2012.
88. F. Behrooz, R. Abdul Rahman, and S. Khairulmizam, "A survey on applying different control methods approach in building automation systems to obtain more energy efficiency," International Journal of Physical Sciences vol.6, no. 9, pp. 2308–2314., 2011.
89. C.D. Stylios and P.P. Groumpos, "Fuzzy cognitive maps in modeling supervisory control systems," J.Intell. FuzzySyst., vol.8, no.1, pp. 83–98., 2000.
90. C.C. Cheng and D. Lee, "Artificial intelligence-assisted heating ventilation and air conditioning control and the unmet demand for sensors: Part 1. Problem formulation and the hypothesis," Sensors, vol.19, no.5, p.1131, 2019.
91. J.K.W. Wong, H. Li, S.W. Wang , "Intelligent building research: A review, " Autom. Constr., vol.14, no.1, pp. 143–159, 2005.
92. S.A. Kalogirou, "Artificial neural networks in renewable energy systems applications: A review," Renew. Sustain. Energy Rev., pp. 373–401., 2001.
93. S.A. Kalogirou, G.A. Florides, C. Neocleous, and C.N. Schizas, "Estimation of daily heating and cooling loads using artificial Neural Networks," CLIMA, pp. 1–11, 2001.
94. F. Calvino, M. La Gennusa, G. Rizzo, and G. Scaccianoce, "The control of indoor thermal comfort conditions: introducing a fuzzy adaptive controller," Energy Build., pp. 97–102., 2004.
95. P.A. González and J.M. Zamarreno, "Prediction of hourly energy consumption in buildings based on a feedback artificial neural network," Energy Build., vol.37, no.6, pp. 595–601, 2005.
96. B. Paris, J. Eynard, S. Grieu, and M. Polit, "Hybrid PID-fuzzy control scheme for managing energy resources in buildings," Appl. Soft Comput., pp. 5068–5080., 2011.
97. Ö. A. Dombayci, "The prediction of heating energy consumption in a model house by using artificial neural networks in Denizli–Turkey," Advances in Engineering Software, vol.41, no.2, pp. 141–147., 2010.
98. A.H. Neto and F.A.S. Fiorelli , "Comparison between detailed model simulation and artificial neural network for forecasting building energy consumption," Energy and buildings, vol.40, no.12, pp.2169-2176, 2008.
99. K. Dalamagkidis, D. Kolokotsa, K. Kalaitzakis, and G. S. Stavrakakis, "Reinforcement learning for energy conservation and comfort in buildings," Building and environment, vol.42, no.7, pp.2686-2698, 2007.
100. M Terziyska, Y Todorov, and M Petrov, "Fuzzy-Neural model predictive control of a building heating system," IFAC, pp. 69–74., 2006.
101. M. Hadjiski, V. Sgurev, and V. Boishina, "Multi agent intelligent control of centralized HVAC systems," IFAC Proceedings, vol.39, no.19, pp.195-200, 2006.
102. Š. Kozák, "Advanced Control Engineering Methods in Modern Technological Applications," In Proceedings of the 13th International Carpathian Control Conference (ICCC). IEEE, pp. 392–397, 2012.
103. L.S.H. Mirinejad and K.C. Welch, "A Review of Intelligent Control Techniques in HVAC Systems," In 2012 IEEE Energytech, IEEE, pp. 1-5., 2012.
104. M.W. Ahmad, M. Mourshed, B. Yuce, and Y. Rezgui, "Computational intelligence techniques for HVAC systems: A review," In Building Simulation, vol.9, no.4, pp. 359–398, 2016.
105. X. Yuan, Y. Pan, J. Yang, W. Wang, and Z. Huang, "Study on the application of reinforcement learning in the operation optimization of HVAC system," In Building Simulation, vol.14, no.1, pp. 75-87, 2021.
106. Z. M. and V. A. Ye D., "A Survey of Self-Organization Mechanisms in Multiagent Systems," IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol.47, no.3, IEEE, pp. 441–461, 2017.
107. D. Biswas, "Reinforcement Learning based HVAC Optimization in Factories," In Proceedings of the Eleventh ACM International Conference on Future Energy Systems, pp. 428-433, 2020.
108. P Stone and M Veloso, "Multiagent systems: a survey from machine learning perspective," Autonomous Robots, vol.8, no. 3, pp. 345-383, 2000.
109. L. Yu, S. Qin, M. Zhang, C. Shen, T. Jiang, and X. Guan, "Deep Reinforcement Learning for Smart Building Energy Management: A Survey," arXiv preprint arXiv:2008.05074, 2020.
110. Z. Zhang, A. Chong, Y. Pan, C. Zhang, S. Lu and K.P. Lam, "A deep reinforcement learning approach to using whole building energy model for hvac optimal control," In 2018 Building Performance Analysis Conference and SimBuild., vol. 3, pp. 22-23, 2018.
111. T. Wei, S. Member, S. Ren, and Q. Zhu, "Deep Reinforcement Learning for Joint Datacenter and HVAC Load Control in Distributed MixedUse Buildings," IEEE Trans. Sustain. Comput., 2019.
112. P. Davidsson, L. Henesey, L. Ramstedt, J. Törnquist, and F. Wernstedt, "An analysis of agent-based approaches to transport logistics," Transportation Research part C: emerging technologies, vol.13, no. 4, pp.255-271, 2005.
113. K. U. Ahn and C. S. Park, "Application of deep Q-networks for modelfree optimal control balancing between different HVAC systems Application of deep Q-networks for model-free optimal control balancing between different HVAC systems, " Sci. Technol. Built Environ., vol. 26, no. 1, pp. 61–74, 2020.
114. R. Jia, M. Jin, K. Sun, T. Hong, and C. Spanos, "Advanced Building Control via Deep Reinforcement Learning Assessing the feasibility of using the heat demand-outdoor temperature function for a longterm district heat demand forecast, " Energy Procedia, vol. 158, pp. 6158–6163, 2019.
115. L. Yu, Y. Sun, Z. Xu, C. Shen, and S. Member, "Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings," IEEE Transactions on Smart Grid, vol.12, no.1, pp.407-419, 2020.
116. Y. Zhang, Z. Li, and Y. Zhang, "Validation and Calibration of an AgentBased Model: A Surrogate Approach," Discrete Dynamics in Nature and Society, Hindawi, p.9, 2020.
117. X. Li, W. Mao, D. Zeng, and F.Y. Wang, "Agent-based social simulation and modeling in social computing," In International Conference on Intelligence and Security Informatics, Springer, Berlin, Heidelberg, pp. 401-412, 2008.
118. L.Klein, K. Jun-young, K. Geoffrey, J. Farrokh Jazizadeh, B.-G. Burcin, V. Pradeep, and T. Milind, "Coordinating occupant behavior for building energy and comfort management using multi-agent systems," Automation in construction, vol.22, pp. 525–536., 2012.
119. S Russell and P Norvig, "Artificial Intelligence: a modern approach," 3rd Ed. Ch. Upper Saddle River, NJ: Prentice-Hall, 2009.
120. F.L. Bellifemine, G. Caire, D. Greenwood, and F.L. Bellifemine, "Developing Multi-Agent Systems with JADE, " John Wiley & Sons,vol.7, 2007.
121. A.E.F. Seghrouchni, A.M. Florea, and A. Olaru, "Multi-Agent Systems: A Paradigm to Design Ambient Intelligent Applications," In Intelligent Distributed Computing IV, Springer, Berlin, Heidelberg, pp. 3–9., 2010.
122. A. G. Lez-Briones, F. D. L. Prieta, M. S. Mohamad, S. Omatu, and J. M. Corchado, "Multi-agent systems applications in energy optimization problems: A state-of-the-art review," Energies, vol. 11, no. 8, pp. 1–28, 2018.
123. A. Al-Daraiseh, E. El-Qawasmeh, and N. Shah, "Multi-agent system for energy consumption optimisation in higher education institutions," J. Comput. Syst. Sci., vol. 81, no. 6, pp. 958–965, 2015.
124. W. Kofler M. J., Reinisch C. and Kastner, "A semantic representation of energy-related information in future smart homes," Energy Build., pp. 169–179., 2012.
125. M Ganzha, LC Jain, D Jarvis, J Jarvis, and R Rönnquist, "Multiagent Systems and Applications," Intelligent systems reference library, Springer, 2013.
126. T Labeodan, K Aduda, G Boxem, and W Zeiler, "On the application of multi-agent systems in buildings for improved building operations, performance and smart grid interaction–A survey," Renewable and Sustainable Energy Reviews, vol. 50 , pp.1405-1414, 2015.
127. M. Han and R. May, "A review of reinforcement learning methodologies on control systems for building energy," information technology and microdata analysis, pp. 1–26, 2018.
128. R. Yang and L. Wang, "Multi-zone building energy management using intelligent control and optimization, " Sustainable cities and society, vol.6, pp. 16-21, 2013.
129. H.M. Schwartz, "Multi-agent machine learning," John Wiley Sons Inc, 2014.
130. M. Bowling and V. Manuela, "Multiagent learning using a variable learning rate," Artificial Intelligence, vol.136, no. 2, pp. 215-250, 2002.
131. R. Dominguez and S. Cannella, “Insights on multi-agent systems applications for supply chain management,” Sustain., vol. 12, no. 5, pp. 1–13, 2020.
132. A. Windham, S. Treado, "A review of multi-agent systems concepts and research related to building HVAC control," Science and Technology for the Built Environment, vol.22, no.1, pp.50-66. 2017.
133. S. Wang, and M. Zhenjun, "Supervisory and optimal control of building HVAC systems: A review." Hvac&R Research, vol.14, no. 1, pp. 3–32, 2008.
134. B. Tashtoush, M. Mohammed, and A.-R. Mohammed. "Dynamic model of an HVAC system for control analysis," Energy, vol.30, no.10, pp. 1729–1745, 2005.
135. EG Pita and S Stevenson, "Air conditioning principles and systems", Columbus, OH: Prentice Hall, 1998.
136. R. Z. Homod, K. S. M. Sahari, H. A. F. Almurib, and F. H. Nagi, "Double cooling coil model for non-linear HVAC system using RLF method, " Energy Build., vol. 43, no. 9, pp. 2043–2054, 2011.
137. L. Morales Escobar, J. Aguilar, A. Garces-Jimenez, J. A. Gutierrez De Mesa, and J. M. Gomez-Pulido, "Advanced fuzzy-logic-based contextdriven control for HVAC management systems in buildings," IEEE Access, vol. 8, pp. 16111–16126, 2020.
138. Z. A. Shah, H. F. Sindi, A. Ul-Haq, and M. A. Ali, "Fuzzy Logic-Based Direct Load Control Scheme for Air Conditioning Load to Reduce Energy Consumption," IEEE Access, vol. 8, pp. 117413–117427, 2020.
139. R. Z. Homod, K. Salleh, M. Sahari, H. A. F. Almurib, and F. Hafiz, "Gradient auto-tuned Takagi–Sugeno Fuzzy Forward control of a HVAC system using predicted mean vote index," Energy Build., vol. 49, pp. 254–267, 2012.
140. R. Z. Homod, H. Togun, H. J. Abd, and K. S. M. Sahari, "A novel hybrid modelling structure fabricated by using Takagi-Sugeno fuzzy to forecast HVAC systems energy demand in real-time for Basra city," Sustain. Cities Soc., vol. 56, no. June 2019, p. 102091, 2020.
141. "https://www.bbc.com/weather/99532.".
142. R. Z. Homod, K. Salleh, M. Sahari, and H. A. F. Almurib, "Energy saving by integrated control of natural ventilation and HVAC systems using model guide for comparison," Renew. Energy, vol. 71, pp. 639–650, 2014.