Full text
energies Article Novel Proposal for Prediction of CO2Course and Occupancy Recognition in Intelligent Buildings within IoT Jan Vanus *,†,‡ , Ojan M. Gorjani ‡and Petr Bilik Department of Cybernetics and Biomedical Engineering, Faculty of Electrical Engineering and Computer Science, VSB - Technical University of Ostrava, 70833 Ostrava-Poruba, Czech Republic; [email protected] (O.M.G.); petr[email protected] (P.B.) *Correspondence: [email protected]; Tel.: +420-597-325-856 † Current address: 17. listopadu 2172/15, 70800 Ostrava, Czech Republic. ‡ These authors contributed equally to this work. Received: 31 October 2019; Accepted: 23 November 2019; Published: 28 November 2019 Abstract: Many direct and indirect methods, processes, and sensors available on the market today are used to monitor the occupancy of selected Intelligent Building (IB) premises and the living activities of IB residents. By recognizing the occupancy of individual spaces in IB, IB can be optimally automated in conjunction with energy savings. This article proposes a novel method of indirect occupancy monitoring using CO 2 , temperature, and relative humidity measured by means of standard operating measurements using the KNX (Konnex (standard EN 50090, ISO/IEC 14543)) technology to monitor laboratory room occupancy in an intelligent building within the Internet of Things (IoT). The article further describes the design and creation of a Software (SW) tool for ensuring connectivity of the KNX technology and the IoT IBM Watson platform in real-time for storing and visualization of the values measured using a Message Queuing Telemetry Transport (MQTT) protocol and data storage into a CouchDB type database. As part of the proposed occupancy determination method, the prediction of the course of CO 2 concentration from the measured temperature and relative humidity values were performed using mathematical methods of Linear Regression, Neural Networks, and Random Tree (using IBM SPSS Modeler) with an accuracy higher than 90%. To increase the accuracy of the prediction, the application of suppression of additive noise from the CO 2 signal predicted by CO 2 using the Least mean squares (LMS) algorithm in adaptive filtering (AF) method was used within the newly designed method. In selected experiments, the prediction accuracy with LMS adaptive filtration was better than 95%. Keywords: KNX; Neural Network (NN); Multilayer Perceptron (MLP); Random Tree (RT); Linear Regression (LR); Cloud Computing (CC); Internet of Things (IoT); LMS (Least Mean Squares) Adaptive filter (AF); gateway; monitoring; occupancy; prediction; IBM SPSS; Intelligent Buildings (IB); energy savings 1. Introduction Until recently, automated smart wiring was the privilege of commercial buildings. However, more and more people want to take advantage of the smart installation options in their homes. There are already many companies on the market involved in smart installations. The prices of such systems with high level of reliability are becoming more affordable in relation to what the customer gains. One of the customer’s motivations for monitoring and controlling the operational and technical conditions of the building can be tracking the events in the building. By measuring various physical quantities, Energies 2019,12, 4541; doi:10.3390/en12234541 www.mdpi.com/journal/energies
Energies 2019,12, 4541 2 of 25 for example, a window left open, unauthorized entry or the presence of people in a building can be inferred. Another motivation for space monitoring can be care for disabled people or seniors. The IoT is increasingly being used to monitor and control the operational status of a building today, which greatly facilitates remote communication with the building from anywhere in the world. This is an area that is relatively new and constantly developing. However, multinational companies such as Google, IBM, Amazon, etc. are becoming increasingly important players in the IoT world. They come with their services, which they run on their servers and offer to customers. These services are generally referred to as Cloud Computing (CC). IB and IoT are two distinct concepts that are closely related, as IB requires real-time interaction with different technological processes. The interactions take place within the system on the basis of a programmed model or directly with the users, and IoT inherently helps. This research is focused on current trends in building automation and monitoring of operational and technical conditions in IB within IoT. The authors of [ 1 – 23 ] focused on new approaches for home automation solutions within IoT. The authors investigated the new possibilities and trends of IB and smart home (SH) automation solutions with appropriate use of IBM IoT tools [ 2 – 6 ], with ensuring appropriate security in IB and SH automatization [ 7 – 9 ], and with the possible overlap of applications within the Smart Cities (SC) [10,11] and Smart Home Care (SHC) [12] platforms. The above-stated articles contain technical terms such as SH, IB, IoT, communication technology, data transfer in connection with communication protocols, CC, “Cloud of Things”. etc. SH is an automated or intelligent home. This is an expression for a modern living space in contrast to existing conventional buildings. SH is characterized by a high degree of automation of operational and technical processes, which are operated by people in standard households. These include lighting control, air temperature and air-conditioning control, kitchen equipment, security technology, door and window control, energy management, multimedia, and consumer electronics control, among many others. SH connects a number of automated systems and appliances with interoperability among the decentralized or centralized management technologies used. One of the main objectives is to increase the required level of user comfort while saving energy costs [ 24 ]. SH should, of course, also offer the possibility of an additional configuration of functionality. IoT is a network of interconnected devices that can exchange information with each other and be mutually interactive. Each of these devices must be clearly identifiable and addressable. Standardized communication protocols are used for communication. The aim is to create autonomous systems that are able to perform the expected activities completely independently on the basis of data obtained from the equipment. In practice, this means that the more data are collected, the better they can be analyzed, which may be useful in IoT implementation in specific fields [ 25 ]. In his article on the introduction to the IoT, Vojacek described IoT architecture as a model consisting of three basic elements [ 26 ]. The first block includes the “things” themselves, which are all devices connected to the network, whether cable or wireless, providing completely independent data. The second block represents the network, which serves as a means of communication between the things themselves and the control system. The third block includes data processing, which can be on the cloud, i.e. a remote server on which the data are further processed. The development of the Internet of Things is now mainly driven by the rapid development of new IoT-enabled devices and their ever-decreasing price. By 2020, it is estimated that the number of connected IoT devices may exceed 30 billion [ 27 ]. However, this figure varies for different sources, but it is certain that the numbers go to tens of billions. This brings about the issue of Internet addressing, because addresses from the IPv4 address space were depleted in 2011, but, with the advent of IPv6, address depletion should not occur as there are 2 128 addresses in this address space, which is a huge number; for your information, it is about 66 trillion IP addresses per square centimeter of the Earth’s surface, including the oceans [ 28 , 29 ]. The Internet of Things may be used in many sectors of human activities. Smart Cities (SC) and Smart Grids (SG) can also be included in the current IoT application areas. Obviously, it is necessary to transfer the data collected effectively. When it comes to wireless data transmissions, the most important parameters include especially range, energy intensity, the security
Energies 2019,12, 4541 3 of 25 of transmission, format, intensity of data processing, and transmission speed. Competition in this segment is relatively high [ 30 – 33 ]. Several communication protocols, such as MQTT, Constrained Application Protocol (CoAP), and Extensible Messaging and Presence Protocol (XMPP), are available for IoT data transmission [ 34 ]. In this work, the MQTT protocol is used. Aazam et al. described the topic of CC in the work “Cloud of Things: Integrating the Internet of Things and CC and the issues involved” [ 35 ]. This is a growing trend in IT technologies, which is also used in IoT. The characteristic feature of CC is the provision of services, software, and hardware of servers that are accessible to the users via the Internet from anywhere in the world. The cloud technology provider will enable the user to use their computing power, data storage, and the software offered. For the users, these services are appealing because they may not have the knowledge of the intrinsic functionality of the hardware and software leased. It also offers high-level data security or a high-quality, user-friendly web interface. Depending on the use of services, CC can be divided into groups [ 36 ]: IaaS (Infrastructure as a Service), SaaS (Software as a Service), PaaS (Platform as a Service), and NaaS (Network as a Service). The basic idea behind CC is to move application logic to remote servers. The individual devices in SH with an Internet connection can be connected directly to the cloud. The data received are collected and processed here. Based on the data evaluated, there is a feedback interaction with the devices in SH. It is often necessary to connect a device that does not have an Internet connection to the system. This can be performed using a gateway that is connected to the Internet. This gateway does not have to mediate communication to only one device. Often, cloud services also offer their own applications for visualization of the data processed and their storage in the database. There is a huge amount of data that can be used for other complex calculations, such as machine learning. Leading providers of these cloud technologies include IBM, which, inter alia, offers IBM Watson IoT, and Amazon with its Amazon Web Services. Similar to this study, the obtained results in [ 12 , 18 , 37 , 38 ] showed that the accuracy of CO 2 prediction can possibly exceed 90%. Khazaei [ 39 ] employed a multilayer perceptron neural network for the purpose of indoor CO 2 concentration levels, where relative humidity and temperature were used as inputs. The most accurate model (based on the calculated mean-square-error (MSE)) was five steps ahead of the reference signal. On average, the difference between reference and prediction signals was less than 17 ppm. Wang [ 40 ] used a recurrent neural network (RNN) based dynamic backpropagation (BP) algorithm model with historical internal inputs. The models were developed to predict the temperature and humidity of a solar greenhouse. The obtained results demonstrate that the RNN-BP model provides reasonably good predictions. One of the benefits of the prediction of CO 2 concentration levels is low-cost indirect occupancy monitoring. Szczurek et al. proposed a method to provide occupancy determination in intermittently occupied space in real-time and with predefined temporal resolution [ 41 ]. Galda et al. discovered insignificant difference between a room with and without plants, while measuring values of CO 2 concentration, inner temperature, and relative humidity [ 42 ]. In our article, we used KNX technology for IB–IoT connectivity by means of the MQTT protocol within the IBM Watson IoT platform. The target of this article is to propose and verify a novel method for predicting CO 2 concentration (ppm) course from the temperature (T indoor ( ° C)) and relative humidity (rH indoor (%)) courses measured with operational accuracy to monitor occupancy in SH using conventional KNX operating sensors with the least investment cost. To achieve the goal, it is necessary to program the required KNX modules in the ETS 5 SW tool. Next, a software application is created to ensure connectivity between the KNX technology and the IoT IBM platform for real-time storage and visualization of the data measured. To predict the course of CO 2 concentration, it is necessary to verify and compare mathematical methods (linear regression (LR), random trees (RT), and multilayer perceptron’s (MLP)), and to select the method with the best results achieved. To increase the accuracy of CO 2 prediction, it is necessary to implement the LMS AF in an application for suppressing the additive noise from the CO 2 signal predicted and to assess the advantages and disadvantages of using AF in the newly proposed method. The proposed method was verified using the measured data in springtime with day-long and week-long intervals (2–10 May 2019). The proposed method can
Energies 2019,12, 4541 4 of 25 save investment costs in the design of large office buildings. Recognition of occupancy of monitored premises in the building leads to the optimization of IB automation in connection with the reduction of operating costs of IB. 2. Materials and Methods 2.1. Building Automation—KNX Technology KNX technology is a worldwide standard in the field of wiring of intelligent buildings and their automation. It is a decentralized solution. KNX technology provides the interconnection of KNX modules using the Twisted pair (TP) communication medium. The devices used in this work are an MTN6005-0001 sensor of CO 2 , temperature, and air humidity (technical parameters: current consumption from the bus, max. 10 mA; ambient temperature, − 5 to 45 ° C; measuring range for CO 2 , 300–9999 ppm; measuring range for temperature: 0–40 ° C; and measuring range for humidity, linear 20–100%). A laboratory (EB312) on the premises of the building of the new FEI at VSB Technical University of Ostrava was used as the experimental location. This location often holds educational classes or it is visited by staff and researchers. Furthermore, in this laboratory, there are bus buttons MTN6172 and MTN6171 for controlling the lighting and switching off (disconnecting) the sockets. In the switchboard in the corridor, there is the switching actuator MTN 649204 and, for lighting control, the dimming actuator KNX/DALI gate MTN680191. Each device in the KNX installation has an identifiable individual address and, together with other devices, forms a function block using a group address. As a whole, these components have been parameterized into a functional unit in the ETS5 configuration software offered by KNX associations (Figure 1). Figure 1. MTN6005-0001 sensor configuration. As mentioned above, the measurement was performed in laboratory EB312, on the premises of the building of the new FEI at VŠB TU Ostrava. Therefore, the necessary structure of the building was created using the ETS 5 SW tool (Figure 2). The topology in the KNX installation consists of the backbone, the main line, and five secondary lines (Figure 3).
Energies 2019,12, 4541 5 of 25 Figure 2. The structure of the building of New FEI VŠB-TU Ostrava created in the ETS 5 SW tool. Figure 3. Building Topology of New FEI VŠB-TU Ostrava created in the ETS 5 SW tool. The connection between the lines is provided by a bus coupler, which allows connection of up to 64 KNX modules. To ensure proper communication between the individual KNX modules by means of the KNX telegram, a group address, which uniquely determines the functionality of the individual operational and technical functions, is defined (Figure 4) [ 43 ]. The topology in the KNX installation consists of the backbone, the main line, and five secondary lines (Figure 3).
Energies 2019,12, 4541 6 of 25 Figure 4. The structure of the group addresses of the building of New FEI VŠB-TU Ostrava created in the ETS 5 SW tool. KNX Association, in response to the expanding IoT trend, introduced its own solution—KNX Web Services. This solution removes obstacles to accessing KNX as part of the Internet of Things. It enables reliable integration of a large installation in which multiple suppliers and manufacturers are installed. KNX Web Services focus on the existing web services, such as oBIX, OPC UA, and BACnet-WS. Web services are standalone modular software components that can be described, published, and activated via the web [ 44 , 45 ]. It is necessary to use a suitable interface between the KNX installation and the IP network. On the Internet side, control devices, such as mobile devices, web applications, etc., that communicate with the interface via web services can be connected. For the implementation, however, it is necessary to know the configuration of the KNX installation as it was created by the ETS program. This is conducted by means of an ETS software supplement called ETS Exporter App [ 46 ]. There are several applications on the market that are able to communicate with KNX installations. The ones that are known include KNX DashBoard, KNXWeb2 or LinKNX [ 47 ], and Home In Hand [ 48 ]. In this work, the connection of the KNX technology and the IBM cloud technology is provided using SW that we developed, which enables communication between the IBM Watson IoT service and the KNX smart installation (Figure 5). MQTT protocol is used as a communication protocol. Figure 5. A block diagram of the KNX technology SW connection created in the New FEI VŠB-TU Ostrava building with the IBM IoT Watson platform. Microsoft Visual Studio 2017 was chosen as the development environment. The .NET framework is used as the development framework and C# is used both from the KNX Association and from IBM. A personal computer (PC) with the Windows 10 operating system is used as a hardware solution for running the developed SW. The IBM Watson IoT platform web service is used to access the KNX
Energies 2019,12, 4541 7 of 25 installation within IoT. The function and the requirement of this software are to run continuously on the selected device and to maintain a connection for two-way communication, respectively. This software is implemented to serve as access for an independent application that monitors the presence of people in the room. Room EB312 located in the FEI building at VŠB TU Ostrava is monitored. Libraries for communication with the KNX bus, the IBM Watson IoT platform, the Cloudant database, and the JSON files were used as third-party libraries. The Falcon SDK library was used to establish connectivity with the KNX installations using the Manufacturer SDK version. The IBM Watson IoT-CSharp library was used to interact with the IBM Watson IoT platform. The individual KNX modules communicate with IoT IBM using a KNXnet/IP router. The data obtained from the KNX installation by the software implemented must be transferred for further processing in real-time. To do this, the IBM Watson IoT platform service controlled through the Web interface is used. This is a PaaS service. This service acts as a broker, an intermediary for real-time communication between the applications and the IoT devices using the MQTT protocol. The software implemented acts as both a publisher and a subscriber because it is a gateway to the KNX installation from the Internet and allows two-way communication. Multiple publishers and subscribers can be logged into this service. Another SW application we developed is the Console Gateway software, which is implemented as a console application (Figure 6). Its function is to maintain a continuous connection between the KNX installation and the IBM Watson IoT platform. During this connection, the application monitors the KNX bus and captures and sends the predetermined telegrams to the Watson IoT platform. The console application was created primarily for faster implementation and high reliability. The Console Gateway SW tool created was deployed on a laboratory PC that runs continuously as long as it is necessary to maintain a connection between the cloud service and the KNX installation. Upon start-up, it informs the user of the success or failure of the connection to the KNXnet/IP router and the Watson IoT cloud service. If both are OK, the user is prompted to start the data transfer. Then, the console writes data that are sent to the cloud. Figure 6. A diagram of the ConsoleGateway SW solution implemented for online data transfer from the KNX technology to IoT IBM Watson. The official .Net framework Falcon library provided by the KNX association is used for communication with the KNXnet/IP router. This library allows establishing connections, sending commands to the KNX installation, monitoring communication on the KNX bus, and requesting information about KNX devices. The connection to the router is established in the tunneling mode. To establish a connection, it is necessary to configure the connection parameters, namely the IP address and the port number. When the program is closed, it is necessary to terminate the connection.
Energies 2019,12, 4541 8 of 25 2.2. Predictive Analysis Predictive models are based on variables that are most likely to influence the outcome. These variables are also known as predictors [ 49 ]. Predictive modeling has a wide range of applications such as weather forecasting, business, Bayesian spam filters, advertising and marketing, fraud detection, etc. The formulation of the statistical model requires the collection of data for relevant predictors. Ahmad et al. compared different methods of predictive modeling for solar thermal energy systems such as random forest, extra trees, and regression trees [ 50 ]. The predictive analysis performed in this article falls under the category of machine learning with a supervised learning strategy. In simple words, machine learning is the process of computers learning and recognizing patterns based on the data, which helps the computer program to make intelligent decisions. Supervised learning is one of the methods used in machine learning. Usually, in this method, a set of solved (labeled) examples are presented to the machine for training, which helps the machine to establish the pattern between the problem and the answer. Once the pattern is established, the machine can solve similar problems on its own [ 51 ]. Kachalsky et al. explained an application of supervised learning techniques in a computer card game that resulted in a high percentage of won games by the computer [ 52 ]. Unsupervised learning is based on similar principles such as clustering in data mining, which uses clustering to discover classes within the data. This method can find a pattern in unsolved (unlabeled) examples that may not have a semantic meaning. Nijhawan et al. used unsupervised learning for classification of land cover by taking advantage of relative positions of pixels in the image of the land [ 53 ]. Another class of machine learning techniques is semi-supervised learning, which uses labeled examples to learn class models and unlabeled examples to refine the boundaries between classes. Liu et al. demonstrated an example of the application of semi-supervised learning combined with multitask learning in landmine detection [ 54 ]. The fourth machine learning approach is active learning, which requires the active role of the user in the learning process by asking the user to label an unlabeled example. This improves the quality of analysis by taking advantage of human knowledge [51]. In [ 37 ], the authors used the radial basis functions (feedforward NN) for CO 2 prediction. They examined the performance of the developed models based on the number of neurons and interval lengths. The results indicate that the day-long interval lengths are the most suitable for training the radial basis function. This article compares the performance of three different statistical methods (linear regression (LR), random trees (RT), and multilayer perceptron (MLP)) for predictions of the CO 2 concentration level in an intelligent administrative building (New FEI Building) in VSB TU Ostrava (Figure 7). As explained above, the authors developed a software tool that is capable of obtaining and recording the values of temperature, humidity, and CO 2 concentration through the KNX Platform. The obtained data were divided into various intervals that were processed using the IBM SPSS Modeler software tool. Figure 7. Predictive analysis concept. The process of CO2predictions can be broken into the following parts: 1. Data collection 2. Pre-processing of the collected data 3. Predictions using IBM SPSS
Energies 2019,12, 4541 9 of 25 4. Evaluation and comparison of the obtained results The data collection was performed by a personal computer that was running the developed KNX-IBM gateway software. As explained above, the developed software records and transmits any message that is traveling through the KNX bus (twisted pair). The developed software creates a new database entry for every KNX bus message that contains a predefined group address. Using the developed method, the data collection rate can vary from one to ten samples per minute (approximately 7000 samples per 24 h). The obtained data intervals were normalized (feature scaling or min-max normalization) using Microsoft Excel. In the third step of the implementation, the IBM SPSS Modeler software was used for the development of predictive models. Figure 8shows an example of a data stream in IBM SPSS Modeler 18. The data are imported using an Excel node. The filter and type nodes select relevant data and assign correct data types (continuous, categorical, etc.). Additionally, the type node can assign which parameters are used as predictors (input) and which as predictions (target). In IBM SPSS Modeler, K-fold, V-fold, N-fold, and partitioning methods are commonly used as validation methods. For optimization purposes, it is recommended to use a partitioning method for large datasets [ 55 ]. The partitioning method randomly divides (the ratio of this division can be defined) the input datasets into three parts of training, testing, and validation. In this experiment, 40% of the input data were used for training of the models and 30% of the data for testing partition, which were mainly used for selecting the most suitable model and prevention of overfitting. The validation partition (30% of the input data) was used to determine how well the models truly perform. Using this partition, the developed models perform predictions using only predictors. The obtained results were compared with the reference signal. The partitioned data were fed directly to statistical predictive models (linear regression, random tree, and neural networks (MLP)). The resulting predictions can be exported to Excel files or analyzed using built-in functions such as plots and analysis nodes. Figure 8. Representation of a data stream in IBM SPSS. 2.2.1. Linear Regression (LR) LR is one of the oldest and most commonly used algorithms in supervised machine learning [ 56 ]. Generally, it estimates the coefficients of the linear equation. These coefficients involve one or more independent variables that can best predict the value of the dependent variable [ 56 – 61 ]. Equation (1) represents a simple mathematical representation of LR, where it evaluates the influence of the variable X on y ( α and β are coefficients and ε is error variable). If the response y is influenced by more than one predictor variable, the regression function can be modeled with the function in Equation (2) ( β0 , β1 , β2 , and βk are regression coefficients). Equations (3)–(6) are matrix representations of y , X , β and ε, respectively [57,58] y=α+βX+ε, (1) y=β0+β1X1+β2X2+... +βKXK+ε, (2)
Energies 2019,12, 4541 16 of 25 Time (hh:mm) 00:00 06:00 12:00 18:00 00:00 CO2(ppm) 350 400 450 500 550 600 650 700 750 800 Reference CO2(ppm) Predicted CO2(ppm) LMS adaptive filtration CO2(ppm) t4 t3t2t1 t6 t5 Figure 11. CO 2 (ppm) reference waveform (blue), prediction waveform using LR (Forward setting) (red), and LMS adaptive filtration of prediction waveform using LR (black), (training day-long interval 3 May 2019). Legend (hh:mm:ss): arrival t1 = 09:48:52, departure t2 = 09:53:32, and length of stay in the room EB312 ∆t = 00:05:40; arrival t3 = 10:58:55, departure t4 = 11:37:19, and length of stay in the room EB312 ∆t = 00:39:24; and arrival t5 = 12:16:20, departure t6 = 13:34:58, and length of stay in the room EB312 ∆t= 01:18:38. 3.2. RT Prediction The RT method was implemented using 1–20 trees. The maximum number of nodes was set to 10,000 (by default). The maximum tree depth was set to 10 and minimum child nodes (Min Bucket) size to 5. The model stopped building once the accuracy could no longer improve. The analysis performed with the day-long interval of 3 May showed increasing the number of trees results in increased accuracy of the models. However, by increasing this number any further than eight trees, the result did not imply any significant improvements. Similar behaviors were observed for the other intervals. Table 3shows that the models with 13, 16, and 18 trees represent exactly the same average results, which are similar to the models with 10 and 11 trees, which implies the ideal range of 13–18 trees. The most accurate results were obtained from day-long interval of 3 May 2019 (LC: 0.991, MAE: 7.476, and MSE: 1.427 × 10 3 ) and the least accurate result was obtained from the day-long interval of 2–10 May 2019 and one tree model (LC: 0.562, MAE: 13.862, and MSE: 6.675 × 10 4 ). Table 4shows the average of each time interval. It can be easily observed that day-long intervals are significantly more accurate than the week-long interval. Figure 12 demonstrates mostly accurate predictions of CO 2 concentration levels. However, between 15:00 and 24:00, various noises and glitches can be observed. This indicates a slight overfitting. Table 3. Average of results for each implemented setting (number of trees) (RT prediction). Number of Trees LC MAE MSE 1 0.7822 37.655 4.163 ×103 3 0.8138 29.083 2.439 ×103 5 0.8464 31.453 1.465 ×103 8 0.8646 31.453 1.359 ×103 10 0.8672 28.016 1.319 ×103 11 0.8674 22.062 1.314 ×103 13 0.8676 27.944 1.085 ×103 16 0.8676 27.944 1.085 ×103 18 0.8676 27.944 1.085 ×103 20 0.8486 31.596 1.085 ×103
Energies 2019,12, 4541 17 of 25 Table 4. Average results of each interval (RT prediction). Interval LC MAE MSE 3 May 0.975 11.356 4.187 ×102 6 May 0.699 43.181 2.176 ×103 7 May 0.879 28.543 1.601 ×103 9 May 0.895 37.9874 6.474 ×102 2–10 May −17.5829 26.1345 3.355 ×103 To filter the predicted course of CO 2 concentration by RT (using 18 trees), an LMS AF was applied to suppress the additive noise from the CO 2 Reference signal measured (ppm) (Figure 12), while maintaining the convergence and stability with the parameters set (filter order M = 48, step size parameter µ= 5.9 × 10 −3 ). The implemented adaptive LMS filtration significantly improved the course of the resulting predicted course of CO 2 concentration. The calculated correlation coefficient between the courses of Reference CO 2 (ppm) and the LMS adaptive filtration of CO 2 (ppm) (Figure 12) reached 99.25%, which is higher than the calculated value of the correlation coefficient of 98.96% between Reference CO 2 (ppm) and RT (using 18 trees) Predicted CO 2 (ppm) in Figure 12 as well as in comparison with the results indicated in Tables 3and 4. Time (hh:mm) 00:00 06:00 12:00 18:00 00:00 CO2(ppm) 350 400 450 500 550 600 650 700 750 800 Reference CO2(ppm) Predicted CO2(ppm) LMS adaptive filtration CO2(ppm) t6 t5t4 t3t2t1 Figure 12. CO 2 reference waveform (blue), prediction waveform using RT (using 18 trees) (red), and LMS adaptive filtration of prediction waveform using RT (using 18 trees) (black), (training day-long interval 3 May 2019). Legend (hh:mm:ss): arrival t1 = 09:48:52, departure t2 = 09:53:32, and length of stay in the room EB312 ∆t = 00:05:40; arrival t3 = 10:58:55, departure t4 = 11:37:19, and length of stay in the room EB312 ∆t = 00:39:24; and arrival t5 = 12:16:20, departure t6 = 13:34:58, and length of stay in the room EB312 ∆t= 01:18:38. 3.3. NN (MLP) Prediction The implementation of a NN (MLP) was performed using several different settings for the number of neurons in the hidden layers. For the purpose of comparisons, these models were tested using the identical data-intervals. The model trained with data day-long interval of 6 May 2019, with settings of 500 neurons in the first hidden layer and 20 neurons in the second hidden layer provided the highest overall accuracy (LC: 0.997, MAE: 4.597, and MSE: 3.641 × 10 1 ). Meanwhile, the week-long training data interval (2–10 May 2019) combined with 100 neurons in the first hidden layer and 50 neurons in the second hidden layer provided the least accuracy (LC: 0.947, MAE: 19.764, and MSE: 8.414 × 10 2 ). By investigating the overall trend of the results, it was observed that the models which had 500 neurons in the first layer and 20 neurons in the second layer generally performed better. These results can be observed in Table 5, which demonstrates the overall trend of analysis results in terms of model settings. On the other hand, Table 6shows that the day-long intervals hold better average accuracies. Additionally, the day-long interval of 6 May appears to be the most suitable training interval. Figure 13 shows the CO 2 reference and prediction signal using a neural network. The applied model used 500
Energies 2019,12, 4541 18 of 25 neurons in the first and 20 neurons in the second hidden layer. The day-long interval of 3 May 2019 was used for training of this model. Although the signals demonstrate accurate overall prediction of CO 2 concentration levels, in the final hours (between 22:30 and 24:00) of the day, some noises can be observed due to minor overfitting. Table 5. Average of results for each implemented setting (number of neurons) (NN prediction). Number of Neurons LC MAE MSE Layer1-Layer2 Number of Neurons LC MAE MSE 10–10 0.988 9.7558 2.112 ×102 25–50 0.989 9.315 1.927 ×102 50–25 0.990 8.6476 1.636 ×102 50–100 0.989 9.0496 1.803 ×102 100–50 0.990 8.9098 1.763 ×102 500–20 0.991 8.2812 1.626 ×102 20–500 0.984 10.839 2.634 ×102 Table 6. Average of each interval (NN prediction). Interval LC MAE MSE 3 May 0.990 8.658 1.364 ×102 6 May 0.996 5.024 4.662 ×101 7 May 0.993 8.818 2.018 ×102 9 May 0.989 10.442 2.15 ×102 2–10 May 0.972 14.600 4.518 ×102 To filter the predicted course of CO 2 concentration by NN (using 500 neurons in Layer 1 and 20 neurons in Layer 2), an LMS AF was applied for additive noise canceling from the CO 2 reference signal measured (ppm) (Figure 13), while maintaining the convergence and stability with the parameters set (filter order M = 48, step size parameter µ= 5.9 × 10 −3 ). The implemented adaptive LMS filtration significantly improved the course of the resulting predicted course of CO 2 concentration. The calculated correlation coefficient between the courses of Reference CO 2 (ppm) and the LMS adaptive filtration of CO 2 (ppm) (Figure 13) reached 99.29%, which is higher than the calculated value of the correlation coefficient of 98.96% between Reference CO 2 (ppm) and NN (using 500 neurons in Layer 1 and 20 neurons in Layer 2) Predicted CO 2 (ppm) in Figure 13 as well as in comparison with the results indicated in Tables 5and 6.
Energies 2019,12, 4541 19 of 25 Time (hh:mm) 00:00 06:00 12:00 18:00 00:00 CO2(ppm) 350 400 450 500 550 600 650 700 750 800 Reference CO2(ppm) Predicted CO2(ppm) LMS adaptive filtration CO2(ppm) t6 t5t4 t3t2t1 Figure 13. CO 2 reference waveform (blue), prediction waveform using NN (using neurons 500 in Layer 1 and 20 neurons in Layer 2) (Table 5) (red), and LMS adaptive filtration of prediction waveform using NN (using neurons 500 in Layer 1 and 20 neurons in Layer 2) (black) (training day-long interval 3 May 2019). Legend (hh:mm:ss): arrival t1 = 09:48:52, departure t2 = 09:53:32, and length of stay in the room EB312 ∆t = 00:05:40; arrival t3 = 10:58:55, departure t4 = 11:37:19, and length of stay in the room EB312 ∆t = 00:39:24; and arrival t5 = 12:16:20, departure t6 = 13:34:58, and length of stay in the room EB312 ∆t = 01:18:38. 4. Discussion In the first part of the practical work, the development of a dedicated console application for KNX installation and IBM Watson IoT platform connectivity was described. When creating this program, the emphasis was placed on simplicity and reliability. Continuous running of the program was controlled by a web browser with an Internet connection, as the Watson IoT IBM platform provides a friendly web interface for visualizing the data received. After satisfactory verification of reliability, the development of a desktop version, which provides the user with a clear user interface, was commenced. Its core function, i.e., connectivity of the KNX and IoT IBM technologies, is the same as in the case of the console application. In the second part of the practical work, based on the data obtained from the KNX installation, a visualization application allowing the user both to display the values measured, namely their historical values depending on the database size and to visualize and process the data transmitted in real-time, was being developed. Emphasis was placed on information about the current occupancy of the room monitored. The user can monitor the measured values of the course of the CO 2 sensor concentration, from the development of which the occupancy of the space monitored can be derived. When designing the new method for predicting the course of CO 2 concentration based on temperature and humidity measurements, one of the motivations for CO 2 prediction was to save the initial investment resources for the acquisition of CO 2 sensors, which are significantly more expensive compared to temperature and humidity sensors. For prediction, IBM offers the SPSS modeler desktop application or the Watson Studio cloud service. Both options were used during the implementation. When working with the SPSS modeler, the prediction was conducted based on the input data in the form of a csv file. Using Watson Studio, which also offers many features that can be used to process data for CO 2 prediction, there was also a successful connection with the Cloudant database for the access to historical data and, at the same time, there was a connection of this service with the Watson IoT platform for real-time data transfer from the KNX installation. By reviewing the obtained results from LR, it becomes apparent that changing the algorithms of the models does not have any major impact on the results. Furthermore, day-long intervals showed significantly better accuracy. By summing up the tabulated and graphical results, it was concluded that the predictions obtained from this method would be accurate enough for the detection of presence. The prediction results included some inaccurate predictions. Therefore, it is not suitable for accurate CO 2 concentration level predictions. The RT method showed significantly improved generalizations of CO 2 concentration levels. Unlike the previous method, model settings affected the
Energies 2019,12, 4541 20 of 25 result noticeably. The general trend of the prediction pointed toward better accuracy with an increase in the number of trees. Specifically, the region between 10 and 18 trees appeared to be optimal for accurate predictions. Except for 6 May 2019, the prediction results from day-long intervals showed better overall characteristics. Further investigations found that 6 May 2019 showed short occupancy day-long intervals. Despite the fact the prediction waveform contained few minor inaccuracies and small noisy sections, it was still considered as a suitable method for both occupancy monitoring and accurate CO 2 waveform predictions. The NN (MLP) showed the best numerical characteristics. The visual investigation verified the good generalization of the trained models. All models and methods showed noisy predictions at late hours of the day. Nevertheless, these noise levels were reduced in NN (MLP). Similar to previous methods, the day-long training intervals were more accurate. Overall, the NN (MLP) proved to be the most accurate method for both occupancy monitoring and accurate CO2waveform predictions. The use of an LMS AF in an application for suppressing the additive noise in the CO 2 concentration course predicted significantly improved the resulting CO 2 concentration course compared to the reference course measured for all of the above-stated LR, RT, NN (MLP) prediction methods (Figures 11–13). The best results, in terms of prediction accuracy using the LMS AF, were obtained for the NN method, where the calculated correlation coefficient between the courses of CO 2 reference (ppm) and the LMS adaptive CO 2 filtration (ppm) (Figure 13) reached 99.29% for the adaptive LMS filter order set (filter order M = 48, step size parameter µ= 5.9 × 10 −3 ) (Table 6). It can be compared with the correlation coefficient values calculated, as shown in Tables 5and 6, or the with other methods in Tables 1–4. The disadvantage of the LMS AF is the initial peak (Figures 11–13) when the AF does not know the signal course processed. This is due to the vector of the weighting filtration coefficients w(n) , which was set to zero for the initial conditions and the start-up of the predicted CO 2 course processing by the LMS AF (Equation (23)). 5. Conclusions The article describes the implementation of a novel method for predicting CO 2 course from the temperature and relative humidity courses measured (within the operational accuracy) to monitor occupancy in IB using conventional KNX operating sensors. The article further describes the programming of the required KNX modules in the ETS 5 SW tool. The IoT-based automation of smart homes has been investigated in numerous studies [ 88 – 92 ]. However, this article develops a novel SW tool that ensures connectivity between the KNX technology and the IoT IBM platform for real-time storage and visualization of the data measured. Furthermore, the article describes a comparison of mathematical methods (linear regression (LR), random trees (RT), and multilayer perceptron (MLP)) in the framework of CO 2 prediction. To increase the accuracy of the CO 2 prediction, the authors then describe the implementation of the LMS AF in a novel application. It suppresses the additive noise in the predicted CO 2 waveform. There are similar works [ 39 , 41 , 93 ] focused on CO 2 modeling or indirect occupancy monitoring. The novelty of this article is within its comprehensiveness. It offers a complete solution: programming of KNX modules, development of pc based IoT gateway, predictive analysis, and filtration. The authors used the IBM SPSS Software tool for CO 2 concentration waveforms prediction using relative humidity (indoor) and temperature (indoor) values. These three important mathematical methods were investigated numerically and visually. LR showed the least accuracy with many offsets and noise output signal. NN (MLP) showed the most accurate results with minor noise and glitches. Based on the results achieved with a prediction accuracy of more than 98% for the selected experiments, it can be stated that the proposed objectives and procedures were met. In the next work, the authors will focus on the application of the proposed method in the optimization of operating costs in IB with subsequent energy savings within IB automatization.
Energies 2019,12, 4541 21 of 25 Author Contributions: J.V. and O.M.G., methodology; J.V. and O.M.G., software; J.V. and O.M.G., validation; J.V. and O.M.G., formal analysis; J.V. and O.M.G., investigation; J.V. and O.M.G., resources; J.V., data creation; J.V. and O.M.G., writing—original draft preparation; J.V. and O.M.G., writing—review and editing; J.V., visualization; J.V., supervision; P.B., project administration; and P.B., funding acquisition Funding: This work was supported by the Student Grant System of VSB Technical University of Ostrava, grant number SP2019/118. Acknowledgments: This work was supported by the Student Grant System of VSB Technical University of Ostrava, grant number SP2019/118. This work was supported by the European Regional Development Fund in the Research Centre of Advanced Mechatronic Systems project, project number CZ.02.1.01/0.0/0.0/16_019/0000867 within the Operational Programme Research, Development and Education. Conflicts of Interest: The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. Abbreviations The following abbreviations are used in this manuscript: NN Neural Network MLP Multilayer Perceptron RT Random Tree LR Linear Regression CC Cloud Computing IoT Internet of Things LMS Least Mean Squares AF Adaptive filter IB Intelligent Buildings SH Smart Home SHC Smart Home Care VLC Visible Light Communication LED Light-Emitting Diode KNX Konnex (standard EN 50090, ISO/IEC 14543) DNS Device Name System MQTT Message Queuing Telemetry Transport ETS Engineering Tool Software SW Software CO2Carbon dioxide SC Smart Cities SG Smart Grids CoAP Constrained Application Protocol XMPP Extensible Messaging and Presence Protocol IBM SPSS Statistical Package for the Social Sciences from the company IBM References 1. Asensio, J.A.; Criado, J.; Padilla, N.; Iribarne, L. Emulating home automation installations through component-based web technology. Future Gener. Comput. Syst. 2017,93, 777–791. [CrossRef] 2. Aggarwal, M.; Madhukar, M. IBM’s Watson Analytics for Health Care: A Miracle Made True. In Cloud Computing Systems and Applications in Healthcare; IGI Global: Hershey, PA, USA, 2017; pp. 117–134. 3. Petnik, J.; Vanus, J. Design of smart home implementation within IoT with natural language interface. IFAC-PapersOnLine 2018,51, 174–179. [CrossRef] 4. Leki´c, M.; Gardaševi´c, G. IoT sensor integration to Node-RED platform. In Proceedings of the 2018 IEEE 17th International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia-Herzegovina, 21–23 March 2018; pp. 1–5. 5. Martinez, A.C. Connecting Small Form-Factor Devices to the Internet of Things. In Advances in Human Factors and System Interactions; Springer: Cham, Switzerland, 2017; pp. 313–322.
Energies 2019,12, 4541 22 of 25 6. Akinsiku, A.; Jadav, D. BeaSmart: A beacon enabled smarter workplace. In Proceedings of the NOMS 2016—2016 IEEE/IFIP Network Operations and Management Symposium, Istanbul, Turkey, 25–29 April 2016; pp. 1269–1272. 7. Nandi, S. Cloud-based cognitive premise security system using ibm watson and IBM internet of things (IoT). In Advances in Electronics, Communication and Computing; Springer: Singapore, 2018; pp. 723–731. 8. Marksteiner, S.; Jiménez, V.J.E.; Valiant, H.; Zeiner, H. An overview of wireless IoT protocol security in the smart home domain. In Proceedings of the 2017 Internet of Things Business Models, Users, and Networks, Copenhagen, Denmark, 23–24 November 2017; pp. 1–8. 9. Tanwar, S.; Patel, P.; Patel, K.; Tyagi, S.; Kumar, N.; Obaidat, M.S. An advanced Internet of Thing based security alert system for smart home. In Proceedings of the 2017 International Conference on Computer, Information and Telecommunication Systems (CITS), Dalian, China, 21–23 July 2017; pp. 25–29. 10. Perera, C.; Liu, C.H.; Jayawardena, S. The emerging internet of things marketplace from an industrial perspective: A survey. IEEE Trans. Emerg. Top. Comput. 2015,3, 585–598. [CrossRef] 11. Bastos, D.; Shackleton, M.; El-Moussa, F. Internet of things: A survey of technologies and security risks in smart home and city environments. In Proceedings of the Living in the Internet of Things: Cybersecurity of the IoT, London, UK, 28–29 March 2018. 12. Vanus, J.; Belesova, J.; Martinek, R.; Nedoma, J.; Fajkus, M.; Bilik, P.; Zidek, J. Monitoring of the daily living activities in smart home care. Hum.-Centric Comput. Inf. Sci. 2017 ,7, 30. doi:10.1186/s13673-017-0113-6. [CrossRef] 13. Hol ` y, R.; Kalika, M.; Havlík, J.; Makarov, A. HVAC system—Communication platform. In Proceedings of the 2018 3rd International Conference on Intelligent Green Building and Smart Grid (IGBSG), Yi-Lan, Taiwan, 22–25 April 2018; pp. 1–4. 14. Chen, M.; Wan, J.; Li, F. Machine-to-machine communications: Architectures, standards and applications. Ksii Trans. Internet Inf. Syst. 2012,6. [CrossRef] 15. Ilieva, S.; Penchev, A.; Petrova-Antonova, D. Internet of Things Framework for Smart Home Building. In Proceedings of the International Conference on Digital Transformation and Global Society, St. Petersburg, Russia, 23–24 June 2016; Springer: Cham, Switzerland, 2016; pp. 450–462. 16. Mainetti, L.; Mighali, V.; Patrono, L. An android multi-protocol application for heterogeneous building automation systems. In Proceedings of the 2014 22nd International Conference on Software, Telecommunications and Computer Networks (SoftCOM), Split, Croatia, 17–19 September 2014; pp. 121–127. 17. Bajer, M. IoT for smart buildings-long awaited revolution or lean evolution. In Proceedings of the 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud), Barcelona, Spain, 6–8 August 2018; pp. 149–154. 18. Vanus, J.; Machac, J.; Martinek, R.; Bilik, P.; Zidek, J.; Nedoma, J.; Fajkus, M. The design of an indirect method for the human presence monitoring in the intelligent building. Hum.-Centric Comput. Inf. Sci. 2018 , 8, 28. doi:10.1186/s13673-018-0151-8. [CrossRef] 19. Jung, M.; Weidinger, J.; Kastner, W.; Olivieri, A. Building automation and smart cities: An integration approach based on a service-oriented architecture. In Proceedings of the 2013 27th International Conference on Advanced Information Networking and Applications Workshops, Barcelona, Spain, 25–28 March 2013; pp. 1361–1367. 20. Vanus, J.; Stratil, T.; Martinek, R.; Bilik, P.; Zidek, J. The possibility of using VLC data transfer in the smart home. IFAC-PapersOnLine 2016,49, 176–181. [CrossRef] 21. Díaz, M.; Martín, C.; Rubio, B. State-of-the-art, challenges, and open issues in the integration of Internet of things and cloud computing. J. Netw. Comput. Appl. 2016,67, 99–117. [CrossRef] 22. Kelly, S.D.T.; Suryadevara, N.K.; Mukhopadhyay, S.C. Towards the implementation of IoT for environmental condition monitoring in homes. IEEE Sens. J. 2013,13, 3846–3853. [CrossRef] 23. Koo, J.; Kim, Y.G. Interoperability of device identification in heterogeneous IoT platforms. In Proceedings of the 2017 13th International Computer Engineering Conference (ICENCO), Cairo, Egypt, 27–28 December 2017; pp. 26–29. 24. Tolentino, M. 1950s Smart Homes: Future in the Past. 2014. Available online: https://siliconangle.com/ 2014/02/05/1950ssmart-homes-future-in-the-past/ (accessed on 20 January 2019). 25. Pohanka, P. Internet vˇecí. In: i2ot.eu 2019. Available online: http://i2ot.eu/internet-of-things/ (accessed on 9 April 2019).
Energies 2019,12, 4541 23 of 25 26. Vojacek, A. Zakladní uvod do oblasti internetu veci (IoT). 2016. Available online: https://automatizace.hw. cz/zakladni-uvod-dooblasti-internetu-veci-iot.html (accessed on 21 January 2019). 27. Bouhaï, N.; Saleh, I. Internet of Things: Evolutions and Innovations; Wiley-ISTE: London, UK, 2017. 28. KNX asociace. knxcz.cz. Available online: https://knxcz.cz/images/clanky/KNX-IoT_en.pdf (accessed on 31 January 2019). 29. Hagen, S. IPv6 essentials; O’Reilly Media, Inc.: Sebastopol, CA, USA, 2006. 30. Nilsoon, R. Bluetooth Low Energy není jen nová verze standard Bluetooth. 2013. Available online: https://www.automa.cz/cz/casopis-clanky/bluetoothlow-energy-neni-jen-nova-verze-standardubluetooth-2013_12_0_10907/ (accessed on 31 January 2019). 31. LoRa Alliance. LoRaWAN: What Is It? 2015. Available online: https://lora-alliance.org/sites/default/files/ 2018-04/what-is-lorawan.pdf (accessed on 21 January 2019). 32. Farahani, S. ZigBee Wireless Networks and Transceivers; Newnes: Oxford, UK, 2011. 33. Paetz, C. Z-Wave Essentials; Createspace Independent Publishing Platform: Zwickau, Germany, 2017. 34. MALÝ, M. Protokol MQTT: komunikaˇcní standart pro IoT. 2016. Available online: https://www.root.cz/ clanky/protokol-mqttkomunikacni-standard-pro-iot/ (accessed on 21 January 2019). 35. Ranjan, R.; Wang, L.; Chen, J.; Benatallah, B. Cloud Computing: Methodology, Systems, and Applications; CRC Press: Boca Raton, FL, USA, 2011. 36. Intesis Software S.L.U. houseinhand.com, 2016. Available online: https://www.houseinhand.com/ (accessed on 31 January 2019). 37. Vanus, J.; Kubicek, J.; Gorjani, O.M.; Koziorek, J. Using the IBM SPSS SW Tool with Wavelet Transformation for CO 2 Prediction within IoT in Smart Home Care. Sensors 2019 ,19, 1407. doi:10.3390/s19061407. [CrossRef] 38. Vanus, J.; Martinek, R.; Bilik, P.; Zidek, J.; Dohnalek, P.; Gajdos, P.; Ieee. New Method for Accurate Prediction of CO 2 in the Smart Home. In Proceedings of the 2016 IEEE International Instrumentation and Measurement Technology Conference Proceedings, Taipei, Taiwan, 23–26 May 2016; IEEE: New York, NY, USA, 2016; pp. 1333–1337. 39. Khazaei, B.; Shiehbeigi, A.; Kani, A. Modeling indoor air carbon dioxide concentration using artificial neural network. Int. J. Environ. Sci. Technol. 2019,16, 729–736. doi:10.1007/s13762-018-1642-x. [CrossRef] 40. Wang, H.K.; Li, L.; Wu, Y.; Meng, F.J.; Wang, H.H.; Sigrimis, N.A. Recurrent Neural Network Model for Prediction of Microclimate in Solar Greenhouse. Ifac PapersOnline 2018 ,51, 790–795. doi:10.1016/j.ifacol.2018.08.099. [CrossRef] 41. Szczurek, A.; Maciejewska, M.; Pietrucha, T. Occupancy determination based on time series of CO2 concentration, temperature and relative humidity. Energy Build. 2017 ,147, 142–154. doi:10.1016/j.enbuild.2017.04.080. [CrossRef] 42. Galda, Z.; Sipkova, V.; Labudek, J.; Gergela, P.; SGEM. Experimental Measurements of CO2in the Summer Months in the Passive House. In Proceedings of the 15th International Multidisciplinary Scientific Geoconference (SGEM), Albena, Bulgaria, 18–24 June 2015; International Multidisciplinary Scientific GeoConference-SGEM; Stef92 Technology Ltd.: Sofia, Bulgaria, 2015; pp. 127–132. 43. Aazam, M.; Khan, I.; Alsaffar, A.A.; Huh, E.N. Cloud of Things: Integrating Internet of Things and cloud computing and the issues involved. In Proceedings of the 2014 11th International Bhurban Conference on Applied Sciences & Technology (IBCAST), Islamabad, Pakistan, 14–18 January 2014; pp. 414–419. 44. Asociace, K. Knx-Specifications. 2014. Available online: https://my.knx.org/en/downloads/knxspecifications (accessed on 31 January 2019). 45. Asociace, K. sti.uniurb.it. Available online: http://www.sti.uniurb.it/romanell/Domotica_e_Edifici_ Intelligenti/110504-Lez10a-KNX-Datapoint%20Types%20v1.5.00%20AS.pdf (accessed on 31 January 2019). 46. Michalec, L. Komunikace v KNX. 2014. Available online: https://vyvoj.hw.cz/automatizace/komunikacev-knx.html (accessed on 31 January 2019). 47. Intesis Software S.L.U. (Application). Available online: https://play.google.com/store/apps/details?id= com.intesis.houseinhand (accessed on 31 January 2019). 48. DELIOT. Pascal. Available online: https://www.microsoft.com/cs-cz/p/knxdashboard/9wzdncrdm06f? activetab=pivot:overviewtab# (accessed on 31 January 2019). 49. Rouse, M. Predictive modeling. Available online: https://searchenterpriseai.techtarget.com/definition/ predictive-modeling (accessed on 31 May 2019).
Energies 2019,12, 4541 24 of 25 50. Ahmad, M.W.; Reynolds, J.; Rezgui, Y. Predictive modelling for solar thermal energy systems: A comparison of support vector regression, random forest, extra trees and regression trees. J. Clean. Prod. 2018 ,203, 810–821. [CrossRef] 51. Han, J.; Pei, J.; Kamber, M. Data Mining: Concepts and Techniques; Elsevier: Waltham, MA, USA, 2011. 52. Kachalsky, I.; Zakirzyanov, I.; Ulyantsev, V. Applying reinforcement learning and supervised learning techniques to play Hearthstone. In Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), Cancun, Mexico, 18–21 December 2017; pp. 1145–1148. 53. Nijhawan, R.; Srivastava, I.; Shukla, P. Land cover classification using super-vised and unsupervised learning techniques. In Proceedings of the 2017 International Conference on Computational Intelligence in Data Science (ICCIDS), Chennai, India, 2–3 June 2017; pp. 1–6. 54. Liu, Q.; Liao, X.; Carin, L. Semi-Supervised Life-Long Learning with Application to Sensing. In Proceedings of the 2007 2nd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, St. Thomas, VI, USA, 12–14 December 2007; pp. 1–4. 55. IBM. IBM SPSS Modeler 18.0 User’s Guide; IBM. Available online: https://searchenterpriseai.techtarget.com/ definition/predictive-modeling (accessed on 31 May 2019). 56. Yan, X.; Su, X. Linear Regression Analysis: Theory and Computing; World Scientific: Singapore, 2009. 57. Rencher, A.C.; Christensen, W.F. Chapter 10, Multivariate regression–Section 10.1, Introduction. In Methods of Multivariate Analysis; Wiley Series in Probability and Statistics; John Wiley & Sons Inc.: New York, NY, USA, 2012; Volume 709, p. 19. 58. Ralston, A.; Wilf, H.S. Mathematical Methods for Digital Computers; Technical Report; John Wiley and Sons Ltd.: New York, NY, USA, 1960. 59. Hocking, R.R. A Biometrics invited paper. The analysis and selection of variables in linear regression. Biometrics 1976,32, 1–49. [CrossRef] 60. Draper, N.; Smith, H. Applied Regression Analysis, 2nd ed.; John Willey & Sons: New York, NY, USA, 1981. 61. SAS Institute Inc. SAS/STAT User’s Guide Version 6, 4th ed.; SAS Institute Inc.: Cary, NC, USA, 1989. 62. Knecht, W.R. Pilot Willingness to Take Off Into Marginal Weather. Part 2. Antecedent Overfitting with Forward Stepwise Logistic Regression; Technical Report; Federal Aviation Administration Oklahoma City Ok Civil Aeromedical Inst: Oklahoma City, OK, USA, 2005. 63. Flom, P.L.; Cassell, D.L. Stopping Stepwise: Why Stepwise and Similar Selection Methods Are Bad, and What You Should Use. In Proceedings of the NorthEast SAS Users Group (NESUG) 2007: Statistics and Data Analysis, Baltimore, MD, USA, 11–14 November 2007. 64. Myers, R.H.; Myers, R.H. Classical and Modern Regression with Applications; Duxbury press: Belmont, CA, USA, 1990; Volume 2. 65. Bendel, R.B.; Afifi, A.A. Comparison of stopping rules in forward “stepwise” regression. J. Am. Stat. Assoc. 1977,72, 46–53. 66. Kubinyi, H. Evolutionary variable selection in regression and PLS analyses. J. Chemom. 1996 ,10, 119–133. [CrossRef] 67. Quinlan, J.R. Simplifying decision trees. Int. J. Man-Mach. Stud. 1987,27, 221–234. [CrossRef] 68. Liaw, A.; Wiener, M. Classification and regression by randomForest. R News 2002,2, 18–22. 69. Breiman, L. Classification and Regression Trees; Routledge: Boca Raton, FL, USA, 2017. 70. Meir, A.; Moon, J.W. On the altitude of nodes in random trees. Can. J. Math. 1978,30, 997–1015. [CrossRef] 71. Duquesne, T.; Le Gall, J.F. Random Trees, Lévy Processes and Spatial Branching Processes; Société mathématique de France: Paris, France, 2002; Volume 281. 72. Le Gall, J.F. Random trees and applications. Probab. Surv. 2005,2, 245–311. [CrossRef] 73. Pittel, B. Note on the heights of random recursive trees and random m-ary search trees. Random Struct. Algorithms 1994,5, 337–347. [CrossRef] 74. Ripley, B.D.; Hjort, N. Pattern Recognition and Neural Networks; Cambridge University Press: Cambridge, UK, 1996. 75. Haykin, S. Neural Networks: A Comprehensive Foundation; Prentice Hall PTR: Upper Saddle River, NJ, USA, 1994. 76. Zarei, T.; Behyad, R. Predicting the water production of a solar seawater greenhouse desalination unit using multi-layer perceptron model. Sol. Energy 2019,177, 595–603. [CrossRef]
Energies 2019,12, 4541 25 of 25 77. Moosavi, S.R.; Wood, D.A.; Ahmadi, M.A.; Choubineh, A. ANN-Based Prediction of Laboratory-Scale Performance of CO 2 -Foam Flooding for Improving Oil Recovery. Nat. Resour. Res. 2019 ,28, 1619–1637. [CrossRef] 78. IBM. IBM SPSS Modeler 18 Algorithms Guide; IBM. Available online: ftp://public.dhe.ibm.com/software/ analytics/spss/documentation/modeler/18.0/en/AlgorithmsGuide.pdf (accessed on 31 January 2019). 79. Willmott, C.J.; Matsuura, K. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim. Res. 2005,30, 79–82. [CrossRef] 80. Lehmann, E.L.; Casella, G. Theory of Point Estimation; Springer Science & Business Media: New York, NY, USA, 2006. 81. Ijiri, Y. The linear aggregation coefficient as the dual of the linear correlation coefficient. Econom. J. Econom. Soc. 1968,36, 252–259. [CrossRef] 82. Jan, J. Cislicova Filtrace, Analyza a Restaurace Signalu; Vutium: Brno, Czech Republic, 2002. 83. Boroujeny, B.F. Adaptive Filters: Theory and Applications; John Wiley & Sons: New York, NY, USA, 2013. 84. Poularikas, A.D.; Ramadan, Z.M. Adaptive Filtering Primer with MATLAB; CRC Press: Boca Raton, FL, USA, 2017. 85. Haykin, S.S. Modern Filters; Macmillan Coll Division: Upper Saddle River, NJ, USA, 1989. 86. Haykin, S.S.; Widrow, B. Least-Mean-Square Adaptive Filters; Wiley Online Library: New York, NY, USA, 2003; Volume 31. 87. Haykin, S.S. Adaptive Filter Theory; Pearson Education India: Bengaluru, India, 2005. 88. Kodali, R.K.; Jain, V.; Bose, S.; Boppana, L. IoT based smart security and home automation system. In Proceedings of the 2016 International Conference on Computing, Communication and Automation (ICCCA), Noida, India, 29–30 April 2016; pp. 1286–1289. 89. Pirbhulal, S.; Zhang, H.; E Alahi, M.; Ghayvat, H.; Mukhopadhyay, S.; Zhang, Y.T.; Wu, W. A novel secure IoT-based smart home automation system using a wireless sensor network. Sensors 2017 ,17, 69. [CrossRef] 90. Pavithra, D.; Balakrishnan, R. IoT based monitoring and control system for home automation. In Proceedings of the 2015 Global Conference on Communication Technologies (GCCT), Thuckalay, India, 23–24 April 2015; pp. 169–173. 91. Wang, M.; Zhang, G.; Zhang, C.; Zhang, J.; Li, C. An IoT-based appliance control system for smart homes. In Proceedings of the 2013 Fourth International Conference on Intelligent Control and Information Processing (ICICIP), Beijing, China, 9–11 June 2013; pp. 744–747. 92. Lee, W.S.; Hong, S.H. Implementation of a KNX-ZigBee gateway for home automation. In Proceedings of the 2009 IEEE 13th International Symposium on Consumer Electronics, Kyoto, Japan, 25–28 May 2009; pp. 545–549. 93. Skön, J.; Johansson, M.; Raatikainen, M.; Leiviskä, K.; Kolehmainen, M. Modelling indoor air carbon dioxide (CO2) concentration using neural network. Methods 2012,14, 16. © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).