Assessing the Uncertainties of Simulation Approaches for Solar Thermal Systems Coupled to Industrial Processes

  Citation: Cardemil, J.M.; Calderón-Vásquez, I.; Pino, A.; Starke, A.; Wolde, I.; Felbol, C.; Lemos, L.F.L.; Bonini, V.; Arias, I.; Iñigo-Labairu, J.; et al. Assessing the Uncertainties of Simulation Approaches for Solar Thermal Systems Coupled to Industrial Processes. Energies 2022,15, 3333. https://doi.org/10.3390/en15093333 Academic Editor: Ruiz Ramirez Javier Received: 22 March 2022 Accepted: 25 April 2022 Published: 3 May 2022 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/ 4.0/). energies Article Assessing the Uncertainties of Simulation Approaches for Solar Thermal Systems Coupled to Industrial Processes José M. Cardemil 1,* , Ignacio Calderón-Vásquez 1, Alan Pino 2, Allan Starke 3, Ian Wolde 1, Carlos Felbol 4, Leonardo F. L. Lemos 3, Vinicius Bonini 3, Ignacio Arias 1, Javier Iñigo-Labairu 5, Jürgen Dersch 5and Rodrigo Escobar 1 1Department of Mechanical and Metallurgical Engineering, Pontificia Universidad Católica de Chile, Santiago 7820436, Chile; [email protected] (I.C.-V.); [email protected] (I.W.); [email protected] (I.A.); [email protected] (R.E.) 2Department of Energy Engineering, University of Seville, 41092 Sevilla, Spain; [email protected] 3 LEPTEN—Laboratory of Energy Conversion Engineering and Energy Technology, Department of Mechanical Engineering, Federal University of Santa Catarina, Florianopolis 88040-900, Brazil; [email protected] (A.S.); [email protected] (L.F.L.L.); [email protected] (V.B.) 4Center for Solar Energy Technologies, Fraunhofer Chile Research, Santiago 8580704, Chile; [email protected] 5German Aerospace Center (DLR), Institute of Solar Research, Linder Höhe, 51147 Köln, Germany; [email protected] (J.I.-L.); [email protected] (J.D.) *Correspondence: jmcar[email protected] Abstract: Industrial energy accounts for a large percentage of global consumption and, thus, it is a target for decarbonization by renewable and in particular solar energy adoption. Low uncertainty simulation tools can reduce the financial risk of solar projects, fostering the transition to a sustainable energy system. Several simulation tools are readily available to developers; differences exist in the format of input data and complexity of physical and numerical models. These tools can provide a variety of results from technical to financial and sensitivity analysis, often producing significant differences in yield assessment and uncertainty levels. IEA SHC Task 64/SolarPACES Task IV— Subtask C aims to address the lack of standard simulation tools for Solar Heating of Industrial Processes (SHIP) plants. This article describes the collaborative work developed by the researchers participating in the task. The identification and classification of several currently available simulation tools are performed on the basis of their capabilities and simulation approaches. A case study of solar heat supply to a copper mining operation is defined, allowing a comparison of the results produced by equivalent simulation tools. The proposed methodology identifies the main sources of differences among the simulation tools, the assessment of the deviation considering a series of statistical metrics for different time scales, and identifies their limitations and bias. The effects of physical characteristics of SHIP plants and different simulation approaches are discussed and quantified. The obtained results allow us to develop a basic guideline for a standardized yield assessment procedure with known uncertainties. Creating this common framework could partially reduce the risk perceived by the finance industry regarding SHIP systems. Keywords: solar process heat; simulation tools; yield assessment; solar thermal systems 1. Introduction Industrial activities represent approximately 44% of global energy consumption [ 1 ]. Such a high consumption is particularly important in developing countries, where most of the energy is used to deliver low to medium temperature heat to manufacturing processes [ 2 ]. Heat supply systems in manufacturing industries are commonly driven by fossil fuels, which entail significant greenhouse gas emissions [ 3 ]. In that context, the definition of transition pathways to adopt clean technologies is crucial for achieving the challenges that represent a sustainable development [4]. Energies 2022,15, 3333. https://doi.org/10.3390/en15093333 https://www.mdpi.com/journal/energies Energies 2022,15, 3333 2 of 29 Renewable energy technologies have been proposed as a promising alternative to reduce greenhouse gases emissions in industrial systems [ 5 , 6 ]. In particular, solar thermal technologies have been recognized by several authors as a reliable option for providing process heat to industrial processes [ 2 , 7 ]. Furthermore, the potential for integrating solar heat in industrial processes (SHIP) has been assessed for certain regions. For example, Kurup et al. [8] analyzed the potential of using solar concentrating collectors to deliver process steam in California, demonstrating that the competitiveness of large parabolic trough collectors to supply process heat is relatively narrow. Moreover, the same research group extended the analysis to other solar thermal technologies, allowing us to identify the potential applications in the United States [ 9 ]. Furthermore, Guillaume et al. [10] analyzed the potential for SHIP in Switzerland. The authors identified the industrial sectors that offer the largest opportunities and reported a theoretical potential to supply 13% of the Swiss thermal energy consumption by the industry. Similar analyzes have been carried out to assess the potential of SHIP in Australia [ 11 ], India [ 7 ], China [ 12 ], and Malaysia and Egypt [13]. All of these studies report significant opportunities for the deployment of solar thermal systems. Despite their remarkable potential, the number of solar plants coupled with industrial processes is still low. There are less than 1000 SHIP plants worldwide, totaling 1 million m2 of installed collector area [ 14 ]. The main entry barriers that hinder a faster deployment of SHIP systems are: the high investment costs and lack of finance options; the fossil fuel pricing and subsidies; the low public awareness of the technology; certain scaling issues to become competitive for small and medium companies; and the lack of suitable guidelines and design tools to aid the training process, as well as to deliver reliable information for the financing sector [ 3 ]. In this context, the Solar Heating and Cooling Program (SHC), a collaboration initiative of the International Energy Agency (IEA), has devoted significant efforts to increase the public awareness by implementing two projects (Tasks). The main objectives of the tasks are to study the potential benefits of SHIP systems, to disseminate integration strategies, and to study solar technologies especially developed for industrial applications. Task 33 and Task 49 endeavored, by joining international efforts, to develop a general methodology for the integration of solar thermal energy into industrial processes. A significant result was the demonstration that Pinch Analysis is the best approach for the integration of solar thermal systems into industrial processes, allowing the optimization of the heat exchanger network for the production system [ 15 ]. Additionally, the knowledge gathered by the scientists in the context of the task proved that adopting heat management strategies (operating heat storage) promotes a more efficient integration of solar thermal plants. Indeed, Task 49—Subtask B further developed simulation methodologies and software tools to raise information on the performance of the heat storage management strategies. These tools consider the time dependency on the production profiles, the integration of heat storage, and the design, optimization, and management of heat flows within the production system [16]. Despite efforts and progress made to build new knowledge and reduce the entry barriers facing solar thermal technologies in the market of heat for industrial processes, the number of SHIP plants has not increased substantially [ 14 ]. Therefore, between 2020 and 2023 Task 64/IV is in operation, a joint task held by the SHC and SolarPACES programs. It comprises a collaborative effort to address some of the entry barriers that hinder the further development of the solar thermal market. The research questions addressed in the context of the task are the standardization of integration schemes at the process and supply levels, as well as the combination with other efficient heat supply technologies such as combined heat and power plants, or power-to-heat solutions. Task 64/IV is organized in five subtasks: A, B, C, D, and E. In particular, Subtask C aims to address the lack of a standard simulation tool for SHIP installations. Currently, there are several simulation tools available, and the results delivered by each of them frequently present high variations. Consequently, the main objective of Subtask C is to develop a thorough analysis of the simulation and design tools available to assess the potential benefits of integrating solar Energies 2022,15, 3333 3 of 29 heat into industrial processes. Hence, allowing us to determine the uncertainty associated with the simulation assumptions and/or to software limitations. Several authors have analyzed the potential of solar thermal technologies integrated with industrial processes by employing different currently available simulation tools (commercial, open source, or in-house developed). Guisado et al. [17] analyzed the feasibility of using parabolic trough collectors to supply medium-temperature heat. The analysis was carried out using a one-dimensional model approach, based on the Modelica language. The developed model was then validated in [ 18 ] and employed to assess the potential to supply process heat to a pasta factory [ 19 ]. Moreover, Frasquet [20] developed an online and open source simulation tool for solar thermal systems coupled to an industrial process, with a special focus on Linear Fresnel Reflectors. Subsequently, it evolved into a web-based simulation tool called RESSSPI [ 21 ], which considers certain integration schemes based on those defined in [ 22 ]. In addition, TRNSYS software [ 23 ] has been widely utilized to assess solar thermal systems coupled with different industrial applications. Lugo et al. [24] performed a numerical simulation study of a SHIP system composed of evacuated tube collectors, which was experimentally validated when coupled with a gas boiler. The numerical model was developed employing the TRNSYS’s standard library; however, a self-developed model for taking into account the thermal losses of the connecting pipes between the storage tank and the solar field was included. Similarly, Quiñones et al. [25] studied the potential of solar thermal collectors for supplying heat to the Chilean copper mining industry. The potential assessment was performed utilizing a model developed in TRNSYS. The model was validated with the public available performance data; nevertheless, certain differences were observed depending on the technology analyzed. Also employing TRNSYS, Crespo et al. [26] analyzed the potential enhancement of an existing parabolic trough collector (PTC) for the production process of a concentrated grape juice factory depending on the integration scheme. The simulation allowed us to assess different integration scenarios that can lead to a significant improvement on solar energy utilization. The System Advisor Model (SAM) software [ 27 ] has also been used to assess the solar yield of concentrating collectors. For instance, SAM is able to model concentrating collectors using liquid heat transfer fluids (HTF) and linear Fresnel collectors for direct steam generation (DSG) [ 28 ]. The model was validated by comparing the daily energy output of the simulation with experimental data. The validation demonstrated good agreement for one integration scheme, but certain errors larger than 10% were also observed for liquid systems. Furthermore, the same model was applied to assess the potential of integrating concentrating solar collectors in a Californian brewery [ 29 ], also used to assess the potential of SHIP systems in selected Indian industries [ 30 ]. Recently, Eddouibi et al. [31] developed an analysis that extends the capabilities of SAM by integrating Python libraries to calculate the thermophysical properties of heat transfer fluids, significantly improving the precision of simulations. Considering the vast number of simulation tools available, and the significant differences that these tools exhibit in terms of yield assessment, the present study develops a methodology framework for assessing the uncertainties introduced into the simulation by taking into account the assumptions and simplifications that most of the tools include. To achieve this objective, a series of activities are carried out. Firstly, comprising the identification of the simulation tools currently available. Subsequently, the classification of such tools is performed according to their capabilities, simulation approaches, and software restrictions. Furthermore, four case studies are defined to conduct equivalent simulations in different simulation tools and to compare their results. Therefore, it is possible to identify the differences in the results and their impact on the main performance indicators. The methodology implemented allows us to identify the sources of uncertainty and establishing recommendations for performing yield assessments with known uncertainty levels. The present article describes the novel methodology framework developed (Section 2), a description of the case study considered for the evaluation (Section 3), the methodology used for the comparison between the simulation results (Section 5), and the assessment Energies 2022,15, 3333 4 of 29 of the impact of the most frequent assumptions used for the yield assessment of the SHIP systems. 2. Assessment of Simulation Tools for SHIP Systems The energy yield of a solar process heating system is commonly simulated during the feasibility study and has a decisive influence on the profitability of the investment. In fact, the software tools compared in this study are typically used during feasibility studies and in the project development phase. To assess the influence of different solar technologies, Task 64/IV Subtask C considered four case studies, which are based on actual SHIP plants currently in operation. For low-temperature processes, a large plant comprised of flat-plate collectors with a fixed mount is considered. The second case study considers the solar field of flat-plate collectors mounted on a 1-axis tracking system, which represents a new trend in the SHIP industry. Furthermore, to evaluate medium-temperature applications, linear Fresnel collectors are also studied, operating under a DSG scheme, and PTC using a mixture of water and glycol as heat transfer fluid (HTF) [32]. The study considers the interaction between different analysts and a core team responsible for preparing and distributing the case studies’ parameters and of running the comparison routines. Figure 1displays the flowchart of the process employed for the assessment of the simulation tools. First, a case study is defined by specifying the main features of the solar thermal installation and describing the detailed information available regarding the design (public or private) to model the system. The information includes: the model of the collector employed (efficiency curve), the size, orientation, and slope of the solar field; the size, geometry, and insulation characteristics of the thermal storage (if available); details of heat exchangers; the load profile, specifically the mass flow and temperature; and finally, the control philosophy (including pumps’ features). Figure 1. Methodology implemented to identify the sources of differences in the results of energy yield assessments employing different simulation tools (software). The technical information is compiled into a single database and distributed to the simulation specialist who develops their simulation models in their own simulation tool. Consequently, the results of the different analysts are received by the core team and compared according to the metrics described in Section 5.1. As a result of the comparison, the main sources of deviations between the results of each simulation tool and the results of the reference tool are identified and quantified. Such analysis enables the identification and classification of the source of differences despite the lack of information from the system design, the intrinsic limitations of the modeling approach, and the resolution strategy of the specific software employed. The final assessment comprises the last three stages of the flowchart displayed in Figure 1. The sources of differences are categorized according to the impact they have on the final energy yield. Since different software and different analysts might increase the bias and uncertainties in the analysis, a parametric analysis is performed varying the Energies 2022,15, 3333 5 of 29 parameters associated with the sources of differences previously identified. This parametric analysis is carried out employing one reference tool by one analyst, with the aim of isolating (or reducing) the impact of the human factor. Finally, the final impact assessment of the sources of difference is established and reported herein. 3. Case Study The analysis presented herein considers a case study based on an actual plant coupled to a copper mining process. This section summarizes the main plant parameters and the operation scheme of the system. Nonetheless, more information is available and is supplied to the analysts to build the simulation models, particularly regarding hourly load profile, the efficiency of the solar field, the geometry and insulation of the storage, the efficiency of the heat exchangers, the pump efficiency and mass flow rate, and control philosophy, among others. The system supplies heat to the electrowinning process of a copper processing plant. The plant is located in the Atacama Desert, Chile (lat. 23.45 ° S, long. 68.81 ° W), with an annual global horizontal irradiation (GHI) for the location of 2631kWh/m2 . The solar plant consists of a 39,300 m 2 fixed flat-plate collector solar field, with a thermal storage volume of 4300m3 . The collectors model is Arcon-Sumark HT Heat Boost 35-10. The respective incident angle modifier (IAM) coefficients are presented in Figure 2. The coupling scheme is at the process level through an external heat exchanger, between the storage tank and the process medium. A simplified plant layout is shown in Figure 3. The HTF considered in the solar field is a water-glycol mixture (33% glycol), while the thermal storage system uses demineralized water in a 17.62m heigh vertical tank, considering thermal losses of 0.923W/(m2K) . Furthermore, the working fluid for the process is water at a process temperature of 70°C and a return temperature of 40°C . The heat demand presents an annual constant profile, that is, 24 h a day, 7 days a week, with an annual load of 94,171 MWh [25]. Figure 2. IAM coefficients for the Flat Plate collectors. Figure 3. System diagram of the case study: flat plate collectors solar field coupled to a copper mining process. The operation of the solar field circuit is modeled using a differential temperature controller, which activates the circulation pump when the solar field outlet temperature is Energies 2022,15, 3333 6 of 29 higher than the temperature at the bottom of the storage tank plus a dead band of 10°C . In addition, a lower dead band of 2°C is considered to turn off the pump. The temperature at the top of the tank is monitored for safety purposes to avoid boiling, therefore, the pump is deactivated when the top of the tanks reaches 100°C . To avoid heating the water to the process over 82.6°C , there is a bypass for the heat exchanger to load (HX2), since the pump of the thermal storage-heat exchanger circuit has a fixed mass flow. Comparison of Simulation Tools Different simulation approaches and tools were employed to model the case study system and obtain energy yield results using the same input data. The results were compared to a tool considered as a reference. The reference tool is the one employed in [ 25 ], which passed through a validation process considering the public available data of the actual plant. The different simulation tools used for this preliminary assessment were Greenius, Polysun, SAM, the SHIP2FAIR tool, TRNSYS with its basic library and TRNSYS with the TESS library (sorted alphabetically, not necessarily as shown in Figure 4). The results of the solar fraction delivered by the different tools are summarized in Figure 4. In this exercise, the tools are not explicitly assigned to the results, with the aim of avoiding any conflict of interest. Figure 4. Annual solar fraction calculated by the different tools. It is observed in Figure 4that the difference between the yield estimations from different tools can be higher than 10% of the annual solar fraction. Furthermore, when analyzing solar fractions on a monthly and daily basis, the differences can reach about 15% and 20%, as shown in Figure 5a,b, respectively. (a) Differences in monthly solar fraction (b) Differences in daily solar fraction Figure 5. Differences between the different simulation tools in terms of the Solar Fraction. As observed, despite the fact that the simulation tools used for the assessment are frequently employed by system developers and researchers, the differences are significantly high, beyond the threshold accepted by the financing industry and/or investors. Energies 2022,15, 3333 7 of 29 4. Scenarios of Induced Errors/Simplifications The deviations between the simulation results evidenced important differences regarding the simulation approaches, the simplifications that the specialists implemented, and the inherent software’s limitations. By analyzing in detail the results and the documentation of the different software, and validating such information with the analysts, it was possible to identify the main sources of differences, described as follows: •Time shifting: Most of the simulation tools for solar thermal systems consider hourly radiation data as input, commonly in a TMY format (typical meteorological year format). In that context, the solar radiation is considered constant during the time step reported in the file. In addition, to compute the incident solar radiation on the collector’s plane, it is crucial to have a definition for the solar position during the time step. In this regard, important differences have been observed within the tools analyzed. Certain tools consider the solar position at the beginning of the time step, others at the middle, and others at the end; consequently, they may not agree with the timestamp of the TMY file. •Thermal capacitance: The thermal capacitance of the solar field is commonly ignored when simulating the performance of SHIP systems. The effect of this simplification is low for small systems; however, it is particularly high in large-scale plants, leading to important deviations in the results of the yield assessment. •Piping losses: Similarly, piping losses are commonly overlooked when simulating small-scale systems. Nonetheless, in large-scale plants, the length of distribution pipes may increase significantly, thus, the thermal losses also increase, leading to an overestimation of the plant’s energy yield. •Heat Exchanger modeling: The modeling approach commonly employed for heat exchangers is the consideration of a constant effectiveness. However, determining this parameter depends on information that is not always available. Furthermore, the effectiveness of the heat exchanger may also vary according to the variation of the fluid stream inlets, especially between the heat exchanger coupling the solar field and the TES system. Hence, depending on the proper determination of the effectiveness value and the magnitude of the heat exchanger inlets’ temperature variation, significant deviations can be observed. •TES modeling approach: The thermal energy storage (TES) system modeling approach has a large impact on the simulation results. The modeling approach may vary depending on the storage technology; however, in SHIP systems, it is common that the TES corresponds to a stratified liquid tank. To represent the temperature distribution associated with the stratification process, it is common to consider a plug flow modeling strategy, discretizing the storage tank in small volumes. Thus, depending on the number of nodes (volumes) considered, the simulation results may present important deviations. The approaches observed within the simulation tools analyzed range from simple approximations (e.g., 2 nodes) to highly detailed models, considering more than 20 nodes or even solving the differential equations that characterize the natural convection process inside the storage tank. •Load profile : The definition of the load profile represents an important challenge in the task of constructing the yield assessment of SHIP systems. Usually, there is not enough detailed information to build a detailed load profile, and, thus, it is common to make rough approximations in this regard. To analyze the impact of the load profile on yield estimation, two alternative scenarios are considered based on the standardized load profiles defined in [33]. To address the impact of the different modeling approaches, 20 different simulation scenarios were defined. Subsequently, the results for these scenarios were obtained by employing the reference model and then compared for the analysis. The summary of the scenarios analyzed is depicted in Table 1. The simulation of all scenarios was carried out in the TRNSYS software, with the aim of avoiding any bias associated with the software and human factors. Energies 2022,15, 3333 8 of 29 Table 1. Scenarios of induced errors in simulations. Source of Deviation Scenario ID Time Shifting [h] Thermal Capacitance [%] Thermal Insulation (cm) HX Efectiveness [%] TES Nodes [-] Load Reference Scenario 0 0 5 5 70 20 Std Time shifting Scenario 1 1 5 5 70 20 Std Scenario 2 0.5 5 5 70 20 Std Scenario 3 −1 5 5 70 20 Std Scenario 4 −0.5 5 5 70 20 Std Thermal capacitance Scenario 5 0 0.0001 5 70 20 Std Scenario 6 0 150 5 70 20 Std Scenario 7 0 200 5 70 20 Std Scenario 8 0 250 5 70 20 Std Scenario 9 0 300 5 70 20 Std Thermal insulation Scenario 10 0 5 Underground 70 20 Std Scenario 11 0 5 10 70 20 Std Scenario 12 0 5 5000 70 20 Std HX effectiveness Scenario 13 0 5 5 60 20 Std Scenario 14 0 5 5 80 20 Std Scenario 15 0 5 5 100 20 Std TES system Scenario 16 0 5 5 70 10 Std Scenario 17 0 5 5 70 2 Std Scenario 18 0 5 5 70 1 Std Load Scenario 19 0 5 5 70 20 0–0 Scenario 20 0 5 5 70 20 2–2 Energies 2022,15, 3333 9 of 29 Certain values in Table 1may seem odd, such as considering 5000cm of thermal insulation. The logic behind this is to evaluate the effect of disregarding thermal losses in the model, i.e., perfectly insulated, without modifying the modeling strategy. 5. Methodology for Comparing Time Series from Simulation Tools The simulation of the scenarios in Table 1delivers numerical results that are compared using the methodology described in the following sections. 5.1. Statistical Comparison To configure a flexible methodology for comparing the results of the simulations and to consider the common errors/limitations described in Section 4, a unified open source script for data collection was prepared. It takes into account the hourly, daily, monthly, and annual profiles of the energy delivered and the temperature levels, among other yield parameters. The procedure was programmed in Python using different open-source packages, such as Matplotlib, Pandas, Numpy, SciPy and skillmetrics packages [ 34 – 37 ]. These packages are useful for data visualization and for reading, processing, postprocessing, and calculating statistical comparison parameters. In addition to that, the Glob and Os packages were used to manipulate file paths. The differences observed in the comparison between the results profiles of each scenario and the reference are quantified in terms of statistical comparison metrics, such as bias (B), root-mean-square error (RMSE), normalized mean bias error (nMBE), relative difference, pattern root-mean-square difference (RMSD), Pearson correlation coefficient (R), and standard deviation ( σ ), which are well-known metrics in statistical analysis and described in depth in [ 38 ]. However, only at the hourly level, the RMSD, R and σ were correlated within a Taylor diagram to visualize their deviation from the reference case [ 39 ]. Therefore, these statistical metrics are defined as follows. B=yest −yre f (1) where yest and yre f refer to estimates and reference data sets. Therefore, B represents the bias between these. σis a well known statistical metric defined as follows. σ=s∑N i=1(yi−y) N−1(2) where y and yi represent the mean and the ith value of the time series analyzed. N is the number of points (length) of the time series analyzed. The correlation coefficient is also a widespread statistical metric, which for the present analysis is defined as R=COV(yest,yre f ) σyest ·σyre f (3) COV(yest,yre f )is the covariance function applied to each scenario and the reference data set. The normalized Mean Bias Error (nMBE) is defined as follows. nMBE = 1 N∑N i=1(yest,i−yre f ,i) Max(yre f )(4) The root mean square error (RMSE), on the other hand, is defined as RMSE =v u u t 1 N N ∑ i=1 (yest,i−yre f ,i)2(5) Energies 2022,15, 3333 16 of 29 Figure 8shows the daily energy profile for the different control volumes of the process. This figure shows the fit with respect to the reference of the different tools and the variability of the simulation results on a daily scale. However, the daily progression does not allow us to properly visualize the effect of outliers, quantify variability, or correctly visualize when a scenario under- or overestimates, or the similarity between the time series. For such purposes, another metric or geometry must be used to make a more reliable comparison. According to the above-mentioned, Table A1 shows the results obtained after applying Equations (7) – (11) to all scenarios analyzed (Table 1). The source of deviation related to Time Shifting adds uncertainties to the “Incident Radiation on SF” control volume; however, despite the induced error, the data set can reproduce the statistical distribution of the reference. Furthermore, as shown in the control volumes ‘Absorbed Solar Energy’ and ‘Energy to TES (HX1)’, the uncertainty introduced in the first control volume is transferred to these control volumes, consistent with as shown in Figure 7. Most of the uncertainty introduced is neglected in the “Energy to Load (HX2)” control volume, suggesting that the TES system helps to reduce the uncertainty. As shown, Thermal Capacitance, Thermal Insulation, HX Effectiveness, TES nodes and Load introduce uncertainties in all control volumes excepting “Incident Radiation on SF”. The TES system helps to reduce the uncertainty introduced, except for the scenario with a low number of TES nodes, which significantly affects the energy delivered to the load. Finally, regarding the load, the uncertainty introduced is due to differences in the load profile with respect to the reference, which even affects the “Absorbed solar energy” control volume due to the plant operation control logic. Figure 8. Progression of the daily totals for the different process’s control volumes. Energies 2022,15, 3333 17 of 29 In Figures 9and 10, the daily MBE is plotted against the daily DTW obtained from the hourly profiles, with respect to the energy delivered to the load. According to the methodology described in the previous section, the plots are referred to the scenarios considering different TES modeling approaches and load profiles. Additionally, a colormap is included indicating the day classification (DC), as proposed by Castillejo-Cuberos and Escobar [50] , which is a score ranging from 1 (completely overcast day) to 20 (completely cloudless clear day). As observed in Figure 9, there is a linear correlation between the DTW and the MBE values. Moreover, the DTW can reach values up to 12% of the daily demand for a fully mixed tank and a MBE of 10% of the hourly demand. Nevertheless, those values decrease (in modulus) as the TES nodes increase. The latter is due to the modeling approach of the stratification phenomena, since the reference simulation considered 20 nodes to fully characterize the storage tank, fewer nodes induce significant differences in the energy and temperature delivered to the load. It is worth mentioning that the MBE shows negative (energy-to-load overestimated) and positive (energy-to-load underestimated) values during the year. The positive values are mainly associated with clear days, ranging from class 16 to 20 [ 50 ]. The negative values, on the other hand, are mainly related to overcast days. In those cases, because of a lack of details regarding the stratification phenomena within the tank, the low temperatures in the TES are overestimated. As a consequence, during the discharge process, the energy delivered to the process is higher than the computed in the reference simulation. In contrast to the effect observed for the different TES modeling approaches, the behavior observed when the demand profiles vary is not significantly affected by the DC index (Figure 10). On the contrary, it is highly dependent on meteorological conditions, such as the solar resource available at the location and ambient temperature (the load profiles are temperature dependent according to [ 33 ]. The “v-shape” depicted in Figure 10 indicates that during the process, the daily energy delivered underestimates and overestimates the reference values. In Table A1 the values of the KS test are presented for the different scenarios proposed. According to the KS test, the TES models with 1 and 2 nodes are rejected, while the modeling using 10 nodes is accepted. This behavior is consistent with the dispersion of DTW observed in Figure 9, where using 1 and 2 nodes for modeling the TES system results in errors ranging from 2% to 13% of the normalized DTW, and from 0.2% to 3% when considering the 10 node approach. The same can be deduced from the test of the load profile scenarios and the behavior from Figure 10. Figure 9. Relationship between the daily DTW and MBE for different classification days for variation in TES nodes. Energies 2022,15, 3333 18 of 29 Figure 10. Relationship between the daily DTW and MBE for different classification days for variation in the load profiles. The hourly residuals distributions are presented from Figures 11–16, where the point density enables a visualization of whether the induced errors tend to underestimate or overestimate the values of the heat delivered to the load compared to the hourly demand. • An error in terms of time shifting , i.e., solar position, can induce a difference in the instantaneous heat delivered to the load up to 40% as observed in Figure 11. In this sense, evaluation can lead to errors in rating or sizing some operating systems in the plant, such as control schemes or feedback processes. Another behavior that is interesting to remark is that a +0.5 or +1 h of time shifting overestimates the values during the day and underestimates during the evening. On the other hand, a − 0.5 or −1 h presents an inversed impact. • The effect of thermal capacitance depends on whether the input is lower or larger than the reference. In the first case, there is a tendency on the residuals to be below zero ( qhx2 overestimated), reaching values higher than the reference up to 10% of the hourly demand. For input values above the reference, during the day the heat to the load is less than the reference, and during the evening it rises. This phenomenon is caused by an increase in the thermal capacity, which is a common behavior obtained due to thermal inertia. In these cases, the reference values are underestimated by 12% of the hourly demand (Figure 12). • The thermal insulation includes three cases: TES with 10cm of insulation, highly insulated ( 5000cm of insulation), and a case where the piping is buried underground. As observed, there are differences in the heat to the load with an amplitude of up to 3% (see Figure 13). Assuming an underground piping does not reflect a high impact on the heat delivered, compared to the reference case, due to the low thermal losses through the piping zones. Energies 2022,15, 3333 19 of 29 Figure 11. Residuals distribution for the time shifting error scenarios. Figure 12. Residuals distribution for thermal capacitance error scenarios. Energies 2022,15, 3333 20 of 29 Figure 13. Residuals distribution for thermal insulation induced error scenarios. • Regarding the heat exchanger modeling approach, the residual distribution for different HX effectiveness scenarios show values lower and higher than the reference (Figure 14). For the values lower than the reference, there is a tendency of increasing the energy delivered to the load during the night and decreasing it during the day. However, there is a higher amplitude in the overestimation as a result of the low value of the effectiveness. For input values of effectiveness larger than the reference, the behavior described is dissimilar. More energy is discharged to the load as there is better heat exchange in the component. In fact, the residuals range from [ − 5% to 11%], [ − 10% to 5%] and [ − 25% to 15%] for the effectiveness of the heat exchanger of 60%, 80%, and 100%, respectively. • The distribution of the residuals observed for the TES modeling induced errors are assessed considering scenarios with different numbers of nodes in the numerical model of the TES. The assessment considers ranging the TES nodes between 20 (reference), 10, 2, and 1 (full-mixed), as illustrated in Figure 15. The effect observed corresponds to an increase in the amplitude of the residual values as the TES nodes decrease. During hours with no solar radiation available, the heat delivered to the load is overestimated, because of the lack of stratification in the system. Hence, higher temperatures can be achieved in the discharging process of the TES as there are fewer nodes to interpolate to model the thermocline. Furthermore, a full mixed tank can underestimate the energy delivered to the load during the day by 50% of the hourly demand. Finally, despite having low values of DTW, using 10 nodes for modeling, stratification of TES underestimates the heat delivered to the process by 10% during the day. Energies 2022,15, 3333 21 of 29 Figure 14. Residuals distribution for induced error scenarios regarding HX effectiveness. • Considering a variable load profile dependent on the mean daily temperature of the surroundings is assessed though two scenarios: Case 0-0, which corresponds to an approximately constant demand during the week. In the left plot of Figure 16, it is observed that the values are concentrated in zero residuals, but with hourly variations up to 20% of the hourly demand. That behavior is caused by the seasonal variation in the temperature of the surroundings. Hence, the demand will also vary, affecting the heat delivered to the process. The case 2-2 corresponds to an extreme case where a significant difference in demand is observed between the working days and the weekend. The resulting variation of the residuals is of a similar shape to the case 0-0. Nonetheless, a higher amplitude is observed in the differences. In Figure 16 a maximum of 65% of the hourly demand is reached. Overall, the distribution indicates that with a temperature-dependent demand, during the early morning hours, the heat delivered is overestimated and then until 10 pm is underestimated. In Figure 17 the difference in terms of solar fraction between the reference case and each induced error scenario: ∆SF =SFc−SFre f is shown. Thus, this figure can be used to identify the impact of the analyzed parameters on the annual solar fraction. Taking into account the effects of each induced error scenario, the thermal insulation thickness employed and the consideration of the piping losses do not represent a significant impact on the solar fraction estimated for the system, since the overall losses are almost negligible, compared to the large energy demand considered for the case study. Furthermore, taking into consideration the dynamic distribution of the residuals (Figure 13) it is demonstrated that the small instantaneous differences do not significantly impact the estimation of the solar fraction. On the other hand, the time shifting, the number of TES nodes, and the load profile induced error causes a underestimation of the solar fraction. The first is due to the miscalculation of the total energy delivered by the solar field. The offset in the sun’s position causes a decrease on the energy provided each day and the solar fraction experiments an reduction of 3%, depending on the size of the time shifting (Figure 17). Regarding the TES modeling (number of nodes), in all cases the solar fraction estimated is lower than the reference due to a linearization of the stratification effect; therefore, using fewer nodes leads to an important underestimation of the temperature achieved within Energies 2022,15, 3333 22 of 29 the tank. Implementing a variable load profile leads to a reduction on the solar fraction estimated (Figure 17) because of its dependency on the daily mean temperature of the surroundings and in different scenarios regarding the energy delivered during the weekend. The solar fraction values are expected to be underestimated as the energy required during the morning and afternoon is lower than the reference case (Figure 16). Figure 15. Residuals distribution for the induced scenarios regarding the TES modeling approach. Figure 16. Residuals distribution for different load profiles scenarios. A thermal capacitance in the solar field lower than the reference value leads to an overestimation of the solar fraction, as part of the heat accumulated in the equipment Energies 2022,15, 3333 23 of 29 is disregarded and assumed to be transferred completely to the process. In cases where the thermal capacity is larger than the reference value, there is a higher amount of heat contained in the solar field and less energy provided to the process. This dynamic behavior impacts the solar fraction and can be overestimated by 1% or underestimated by 2% depending on the thermal capacitance, as observed in Figure 17. The assumption of the value considered for the HX effectiveness affects the solar fraction in a contrary way. For lower values, the solar fraction decreases, as the energy transferred is lower. Whereas in cases considering higher HX effectiveness, the solar fraction increases (Figure 17). Energies 2022,1, 0 22 of 29 estimation of the solar fraction. On the other hand, the time shifting, the number of TES nodes, and the load profile induced error causes a underestimation of the solar fraction. The first is due to the miscalculation of the total energy delivered by the solar field. The offset in the sun’s position causes a decrease on the energy provided each day and the solar fraction experiments an reduction of 3%, depending on the size of the time shifting (Figure 17). Regarding the TES modeling (number of nodes), in all cases the solar fraction estimated is lower than the reference due to a linearization of the stratification effect; therefore, using fewer nodes leads to an important underestimation of the temperature achieved within the tank. Implementing a variable load profile leads to a reduction on the solar fraction estimated (Figure 17) because of its dependency on the daily mean temperature of the surroundings and in different scenarios regarding the energy delivered during the weekend. The solar fraction values are expected to be underestimated as the energy required during the morning and afternoon is lower than the reference case (Figure 16) Figure 17. Difference between the reference solar fraction and the induced modification. A thermal capacitance in the solar field lower than the reference value leads to an overestimation of the solar fraction, as part of the heat accumulated in the equipment is disregarded and assumed to be transferred completely to the process. In cases where the thermal capacity is larger than the reference value, there is a higher amount of heat Figure 17. Difference between the reference solar fraction and the induced modification. 7. Discussion This section presents a discussion of the main outcomes of this study. It is divided in three primary subjects: the observations of the raw results obtained by different simulation tools and analysts, the findings observed from the quantitative comparison, and the scope of this study and its limitations. The raw results obtained from the different simulation tools for the case study were examined individually to check the coherence of the data and the expected seasonal behavior. Figures 4and 5a present the annual, monthly, and daily solar fractions estimated by all the tools analyzed. However, the comparison was also performed for the intermediate control volumes and hourly values, where the differences observed led to the development of the induced error scenarios. For instance, when there were differences in the heat Energies 2022,15, 3333 24 of 29 supplied to the TES at the start of the day, the time shifting in the radiation data and capacitance of the solar field and other components were identified as causes. In addition, when tools with similar sky model and radiation processors noticeably differed in the energy losses between the solar field and the TES system, the thermal losses in the piping and HX modeling approaches were identified as sources of the differences. In addition, when the TES output temperature and the energy delivered to the load on an hourly basis were observed, the impact of the TES stratification level was detected. Furthermore, the results comparison employing statistic metrics addressed the quantification of the impact of the uncertainty sources. First, commonly employed statistic metrics such as standard deviation, nRMSD, nMBE, and Pearson’s correlation coefficient were used for annual, monthly, and daily values. However, these metrics are not suitable for directly comparing the hourly values of time series. Therefore, the dynamic time warping (DTW) is employed and the residual distribution is calculated and plotted for hourly values. This approach allows us to identify the tendencies of under- or overestimation of the energy flows and the time of the day when they occur. Finally, it is necessary to note that this stage of the IEA SHC Task64/SolarPACES task IV—Subtask C, and particularly this study, aims to identify and classify the uncertainty sources from different simulation tools. Therefore, only results from simulation models were compared, and real operation data were not included in the analysis. However, a comparison with actual operational data is expected in the next stages. In the present study, there are certain limitations that can be separated into information exchange constraints and methodology limitations. The first is related to a misunderstanding of certain plant configuration parameters or the format of the output file by the analyst. For example, the method employed to introduce some parameters or coefficients into the simulation tools, since not all tools allow us to receive the input information in the same format. It is relevant to bear in mind that the simulation models were developed by different analysts from different countries, where the information was submitted remotely. Therefore, to avoid errors due to information misunderstanding, bilateral meetings were held between the core team and the different analysts to clarify doubts and receive comments. Regarding the limitations of the methodology, a key factor for time-dependent simulations is the definition of a suitable simulation time step. Since solar thermal systems have thermal inertia due to the materials and the fluid in the circuits, the system’s response speed might be different than the simulation time step. Therefore, it is worthwhile to estimate the time constant of the real system, commonly defined as τ , and employ a simulation time step of the same order of magnitude to allow the controller to make decisions with reliable variable magnitudes. The time constant describes the speed with which the measured process variable responds to changes in the controller output for a first-order control system. Specifically, the time that the variable takes to reach 63.2% of its final value when a step input is applied [ 51 ]. Nevertheless, since the time step cannot be modified in certain simulation software and the most frequent time step employed in the solar thermal sector for annual simulations is 1 h, this time step was employed for the maximum time resolution in the analysis. Furthermore, the inherent limitations of each simulation tool for representing solar thermal systems (such as numerical solver, number of allowable iterations, among others) have not been explicitly considered in the analysis since they are out of the control of the user. However, it was then identified that they might impact the uncertainty of the output, e.g., the energy yield. 8. Conclusions The present study describes a methodology approach for assessing the impact of common assumptions applied in yield assessment of SHIP systems. In this context, it was defined as a case study based on the general features of an actual plant. The methodology proposed allowed us to identify the main sources of differences among the simulation tools used for yield assessment in SHIP systems. Based on the sources of deviation identified, a Energies 2022,15, 3333 25 of 29 statistical assessment of the deviation was implemented, considering a series of statistical metrics selected for such purposes. The analysis carried out allowed us to quantify the errors in different time scales, identifying the limitations and the BIAS of considering an analysis based on a single time scale. In the next stages of this initiative, the size of the system should be considered, as well as the impact of the time constant of the subsystems and the solver utilized by the simulation tool. Although the sources of deviation might be considered as predictable, through the methodology presented herein, it is possible to determine the magnitude of the deviations associated with the induced errors. Hence, the results obtained constitute an important contribution to the solar community, allowing us to build a guideline for developing a yield assessment with known uncertainties associated with the simulation approach or software limitations. By creating a common framework for building yield assessment of solar thermal systems, it might be possible to partially reduce the risk perceived by the financing industry regarding SHIP systems. Thus, the methodology developed herein and the information collected through the proposed methodology could contribute significantly to fostering the deployment of SHIP systems. Author Contributions: Conceptualization, J.M.C.; Formal analysis, I.C.-V. and I.A.; Investigation, A.P., A.S., I.W., I.C.-V., I.A., C.F., V.B., J.D., J.I.-L. and L.F.L.L.; Methodology, J.M.C., A.P., A.S., I.C.-V. and I.A.; Project administration, J.M.C.; Resources, J.M.C. and R.E.; Software, A.P., A.S., I.C.-V., I.A., C.F., V.B. and L.F.L.L.; Supervision, J.M.C.; Visualization, I.C.-V., I.A. and C.F.; Writing—original draft, J.M.C., I.A., I.W., C.F. and I.C.-V.; Writing and editing, A.P., A.S., J.M.C., J.D., J.I.-L. and R.E. All authors have read and agreed to the published version of the manuscript. Funding: This research was funded by the projects ANID/REDES/190164, ANID/FONDAP 15110019 “Solar Energy Research Center”— SERC-Chile and CORFO/13CEI2-21803. Institutional Review Board Statement: Not applicable. Informed Consent Statement: Not applicable. Data Availability Statement: Not applicable. Acknowledgments: The authors wish to acknowledge the support of several parties that led to the completion of this work. Mario Nájera and Nagheli Ortega from CIMAV (México), Parthiv Kurup from NREL (USA) and Raphael Albert from CEA (France). Author I.A. would like to acknowledge the funding from ANID PFCHA/Doctorado Nacional 2021-21210053. A.P. acknowledges the financial support from ANID PFCHA/DOCTORADO BECAS CHILE/2017. I.C would like to acknowledge the financial support from ANID PFCHA/Doctorado Nacional 2021-21210778. I.W. would like to acknowledge the financial support from ANID PFCHA/Doctorado Nacional 2021-21211849. Conflicts of Interest: The authors declare no conflict of interest. Additionally, the funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results. Abbreviations The following abbreviations are used in this manuscript: CDF Cumulative Distribution Function DTW Dynamic Time Warping GHI Global Horizontal Irradiance HTF Heat Transfer Fluid HX Heat Exchanger KDE Kernel Density Estimation MBE Mean Bias Error nRMSE Normalized Root Mean Square Error RMSE Root Mean Square Error RMSD Root Mean Square Difference SHC Solar Heating and Cooling