Full text
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4268 SQUIRREL SEARCH GRADIENT OPTIMIZED DEEP BELIEF NETWORK CLASSIFIER FOR THYROID DISEASE PREDICTION R.VANITHA1, Dr.K. PERUMAL2 1 Research Scholar, Department of Computer Applications, Madurai Kamaraj University, Madurai, India 2 Professor, Department of Computer Applications, Madurai Kamaraj University, Madurai, India E-mail: 1 vanithachezian200[email protected], 2 peruma[email protected]m ABSTRACT Thyroid disease is a range of disorders that affect the thyroid gland, a butterfly-shaped organ located in the neck responsible for producing hormones that regulate metabolism, energy levels, and overall bodily functions. Early detection and management of thyroid disease are crucial, as untreated conditions leads to severe complications, including cardiovascular issues, infertility, and metabolic disorders. Advanced diagnostic methods, including machine learning and deep learning techniques, are increasingly used to improve the accuracy and timeliness of thyroid disease detection, facilitating better treatment outcomes. But, severity of thyroid disease prediction accuracy with minimal time is major challenging issues. In order to improve the accuracy of thyroid disease prediction, a novel Squirrel Search Gradient Optimized Deep Belief Neural Classifier (SSGODBNC) model is developed with minimal time consumption. The proposed Deep Belief Network (DBN) is a fully connected artificial feed-forward deep learning method comprising two visible layers such as the input and output layer and multiple hidden layers for processing the given input. In the layer-by-layer process, the first hidden layer receives weighted input and performs data preprocessing. Then extracting significant features and eliminates the insignificant features from the dataset using the Sparse Autoencoder model. These selected significant features are utilized to classify the severity level of thyroid disease using Sokal–Michener’s simple matching method. During fine-tuning, error back-propagation algorithms adjust the hyperparameters using Squirrel Search Gradient Optimization to increase the accuracy of thyroid disease classification. This optimized fine-tuning process significantly enhances the performance of the deep belief network and improves overall learning efficiency in classification tasks. Finally, the accurate thyroid disease severity prediction results with minimal error are obtained at the output layer. Experimental assessment is conducted with different evaluation metrics such as Accuracy, Precision, Recall, F1-score, specificity and Thyroid disease prediction time. The observed result shows the effectiveness of the proposed SSGODBNC model with higher accuracy in thyroid disease prediction with minimum time than the existing methods. Keywords: Thyroid Disease Prediction, Deep Belief Network, Fine-Tuning, Adaptive Gradient Method, Squirrel Search Gradient Optimization, Sokal–Michener’s Simple Matching Method. 1. INTRODUCTION Thyroid disease poses a substantial health risk, negatively impacting an individual's quality of life while also leading to increased medical expenses for diagnosis and treatment. Identifying thyroid disease particularly challenging, especially for less experienced healthcare professionals, as its symptoms often overlap with those of other conditions. Recent advancements in medical research have highlighted the potential of machine learning techniques as effective tools for diagnosing diseases. By analyzing patterns in clinical data, machine learning models supports practitioners in making accurate and timely diagnoses, thereby improving patient outcomes and reducing the burden on healthcare systems. The scopes of the DBNs suggest the potential path for predicting thyroid diseases, with the aid of early diagnosis and modified treatment. Its context extends to enhance the accuracy and efficiency in identifying different thyroid conditions. The DBNs can be trained to forecast the entity patient responses to various treatments, allowing for further personalized and management of thyroid disorder and utilized to determine the medical images such as, X-rays and CT scans for thyroid abnormalities. It
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4269 classifies and diagnoses thyroid conditions based on thyroid scintigraphy images, offering another tool for diagnosis. A Dynamic Selection Hybrid Model (DSHM) was proposed in [1] to predict thyroid disease and improve accuracy through robust feature selection. However, the DSHM model requires higher computational time for thyroid disease prediction. A Stacked Ensemble with IG feature selection model was designed in [2] with the aiming to enhance thyroid disease detection and reduce screening time and costs considering few clinical attributes. But it failed to predict the severity level of thyroid disease prediction. Different machine learning models were developed in [3] for detecting thyroid disease, incorporating a differential evolution (DE)-based optimization algorithm to fine-tune parameters and minimize errors. But, it did not address increasing the dataset size, limiting the ability to further analyze the performance of deep learning models. A generalized deep learning-based decision support system was proposed in [4] to improve thyroid cancer diagnosis and enhance overall diagnostic performance. However, challenges related to precision and recalls in thyroid cancer detection remain unresolved. To enhance the performance of precision and recall, a novel random forest-based self-stacking classifier model was developed in [5] for efficient thyroid disease detection. However, the time complexity of thyroid cancer prediction remained unaddressed. Various machine learning approaches were developed in [6] for predicting papillary thyroid cancer. However, deep learning models were not utilized to enhance the accuracy of cancer prediction while minimizing time consumption. A Quantum Support Vector Machine classifier model was developed in [7] for more accurate classification of thyroid cancer by selecting significant features using the Quantum Particle Swarm Optimization method. However, it failed to apply effective feature selection and classification algorithms to improve the performance of thyroid disease prediction and achieve better accuracy rates. Several machine learning techniques were proposed in [8] for classifying thyroid disease predictions, which include data preparation, feature selection, and hyperparameter tuning. However, these methods did not address the reduction of time complexity in thyroid disease prediction. A robust and effective machine learningbased method was developed in [9] for predicting thyroid disease by addressing class imbalance and performing feature selection. However, various feature selection techniques and robust handling of missing data were not adequately addressed. A finetuned Light Gradient Boosting Machine (LGBM) model was developed in [10] to achieve high accuracy in thyroid disease prediction. However, it did not incorporate deep learning models to further enhance the diagnostic performance for thyroid disease. Different machine learning algorithms were designed in [11] to predict hypothyroidism and hyperthyroidism by identifying the most significant features to distinguish thyroid diseases more accurately. However, it failed to develop a more effective feature selection scheme to further improve the results. An ensemble learning model was developed in [12] for automatic, reliable, and accurate thyroid recognition with the aim of improving prediction accuracy. However, it failed to construct a multiclass thyroid classification model. A three-stage hybrid classifier (3SHC) model was developed in [13] for disease prediction by reducing the dataset dimension and performing feature selection. But, the designed classifier model requires higher computational resources and results in increased computational costs. An optimized extreme gradient boosting multiclass classifier model was introduced in [14] to classify patients with different types of thyroid disease. However, sophisticated deep learning models have not been applied to achieve even more accurate and effective outcomes. The regressor and classifier model developed in [15] aimed to predict the occurrence of hypothyroidism by analyzing the features required for classification. However, it failed to optimize the model hyperparameters to minimize the statistical loss functions. 1.1 A Novel Contribution of The SSGODBNC Method The major contributions of the SSGODBNC model is listed as follows, To enhance the accuracy of thyroid disease prediction, the SSGODBNC model has been developed, incorporating preprocessing, data feature selection, and classification. A novelty of deep learning model performs data preprocessing and feature selection in the hidden layer using SSGODBNC model designed into minimize the training time of thyroid disease prediction
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4270 A novel method of Sokal–Michener’s simple matching technique is developed for analyzing the training and testing data samples and provides the multi class classification outcome to enhance the accuracy with minimum error. A novelty of squirrel Search Algorithm is obtained in fine-tuning process to optimize the error rate and improve the accuracy of thyroid disease prediction. Finally, an experimental evaluation is carried out to estimate the performance of the SSGODBNC model using various metrics and comparing it to other classification methods. 1.2 Problem Statement The thyroid disease prediction is improving the occurrence of thyroid disorders and require for correct and early detection to enhance the patient results and minimum healthcare costs. The thyroid disease prediction [1] designed to enhance accuracy by robust feature selection. But, the DSHM model was not reducing the computational time. The feature selection model [2] introduced with improved thyroid disease detection with lesser screening time and costs. However, the severity level of thyroid disease prediction was not determined. The different machine learning methods are designed in [6] to thyroid cancer. But, it failed to improve accuracy of cancer prediction with reduced time consumption. To overcome this issue, the proposed SSGODBNC model achieved with better accuracy in thyroid disease prediction with lesser time than the existing methods. 1.3 Organization The paper is structured as follows: Section 2 provides a review of related works in the field, highlighting issues. Section 3 introduces the proposed SSGODBNC model, offering a detailed explanation along with a diagram for better understanding. Section 4 outlines the experimental setup and provides a description of the dataset used for evaluation. In Section 5, the performance of the proposed model is compared with existing methods, considering various parameter configurations. Finally, Section 6 presents the conclusion. 2. RELATED WORKS A Light Gradient Boosting Classifier model was developed in [16] to achieve high performance in thyroid cancer diagnosis. However, the designed model failed to be effectively applied in clinical practice to improve its predictive accuracy. A new combination of K-Neighbors (KN) and Random Forest (RF) classifier models was developed in [17] for the effective identification of thyroid syndrome. However, it did not incorporate more advanced neural network-based approaches to further enhance the performance scores for thyroid syndrome detection. An ensemble machine learning classifier model was introduced in [18] to improve classification performance with higher specificity. But, it failed to extend the classification of thyroid disease using an explainable machine learning approach, which could enhance accuracy, transparency, and outcomes. A machine learning (ML) integration was developed in [19] by applying multi-criteria decision-making for thyroid prediction. However, the time complexity of the thyroid prediction was higher. A hybrid model combining ensemble stacking and an advanced feature selection technique was developed in [20] to enhance the accuracy of thyroid disorder detection. However, the performance of sensitivity analysis in thyroid disorder detection was not addressed. An interpretable thyroid categorization approach was introduced in [21] using explainable AI, achieving the highest accuracy performance. However, it did not apply a multiclass classification approach. A random forest model was developed in [22] to achieve improved prediction performance for thyroid papillary cancer. However, the issue of time consumption in predicting thyroid papillary cancer remained unresolved. A machine learning approach was developed in [23] to predict differentiated thyroid cancer based on hyper parameter tuning. However, it failed to explore these models on larger and more diverse datasets to validate the thyroid cancer prediction. In [24], machine learning algorithms were designed to predict medullary thyroid carcinoma. However, optimization and additional predictive factors were not incorporated into the carcinoma prediction. A convolutional neural network (CNN) prediction model was developed in [25] with the aim of detecting papillary thyroid cancer, achieving high sensitivity and specificity. But, an efficient optimization model was not applied to further enhance the thyroid cancer prediction. A machine learning model using eXplainable Artificial Intelligence (XAI) was introduced in [26] to improve thyroid disease prediction. However, multi-label thyroid disease prediction remained unaddressed. Risk prediction models were developed in [27] with the aim of predicting the cervical lymph node involvement in papillary thyroid carcinoma. However, the models
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4271 failed to validate the efficacy of these prediction models. An efficient nomogram model was developed in [28] by utilizing visualized multipopulation data to accurately classify thyroid carcinoma. But, a deep learning classifier model was not applied to enhance the accuracy of thyroid carcinoma prediction. A binary logistic regression and Lasso regression model was developed in [29] for variable selection and risk factor analysis in thyroid disease prediction. However, the error rate in the risk factor analysis was not effectively addressed. A novel conditional generative adversarial network model was developed in [30] with the aim of detecting thyroid disease by extracting multi-scale features. But, it failed to perform an in-depth analysis of thyroid disease prediction. 3. PROPOSAL METHODOLOGY Thyroid disease is a significant cause of mortality, highlighting the importance of early diagnosis to mitigate its impact. However, existing methods in healthcare diagnosis face challenges regarding performance consistency and accurate disease prediction within minimal time. This section introduces a novel methodology called SSGODBNC, developed for accurate thyroid disease prediction. The working methodology of the SSGODBNC model is divided into four primary processes namely data acquisition, data preprocessing, feature selection, and classification. Figure 1 provides an overview of the entire working process of the SSGODBNC model. Figure 1: Architecture Diagram of SSGODBNC Model Figure 1 above illustrates the architecture of the proposed SSGODBNC model, which aims to achieve accurate thyroid disease prediction in medical data processing. The SSGODBNC model integrates various fundamental processes that work collaboratively to enhance the prediction accuracy and efficiency. These processes include data preprocessing, feature selection, and evaluation, each playing a crucial role in refining the dataset and improving the performance of the disease prediction model. Through applying optimization, the model provides the better prediction results. In the following subsections, each of these processes is explained in detail, highlighting their significance in the overall framework of the proposed model. 3.1 Data Acquisition Data acquisition is the crucial step in the SSGODBNC model that involves gathering relevant and reliable data from the healthcare databases namely Thyroid disease dataset extracted from https://www.kaggle.com/datasets/emmanuelfwerr/thy roid-disease-data. This step ensures that sufficient information is available to train and validate the model effectively. In the context of thyroid disease prediction, data acquisition focuses on collecting patient-related information, including clinical features, test results, and demographic details, to create a comprehensive dataset for further processing. Accurate and high-quality data acquisition plays a vital role in enhancing the reliability and performance of the proposed SSGODBNC model. The dataset includes 9172 instances or records or data samples and 31 attributes or features for accurate thyroid disease prediction. The 31 attributes are listed as follows, age of the patient, sex of patient, on_thyroxine, query on thyroxine, on antithyroid meds, sick, pregnant, thyroid_surgery, I131_treatment, query_hypothyroid, query_hyperthyroid, lithium, goiter, tumor, hypopituitary, psych, TSH_measured, TSH, T3_measured, T3 level in blood from lab work (float), TT4_measured in the blood, TT4 level in blood, T4U_measured in the blood, T4U level in blood, FTI_measured , FTI level in blood, TBG_measured , TBG, referral_source, target, patient_id Let us consider the dataset ‘𝐷𝑆’ and samples as well as features are arranged in the form of matrix. Therefore, the input matrix is formulated as given below,
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4272 𝐼𝑀 = ⎣ ⎢ ⎢ ⎢ ⎡ 𝐹𝐹… 𝐹 𝑆 𝑆 … 𝑆 𝑆 𝑆 … 𝑆 ⋮ ⋮ … ⋮ 𝑆 𝑆 … 𝑆 ⎦ ⎥ ⎥ ⎥ ⎤ (1) Where, 𝐼𝑀 indicates an input matrix, each column indicates a number of features𝐹 = {𝐹,𝐹,…,𝐹}, each row indicates a number of samples or instances or records ‘𝑆 = {𝑆,𝑆,…,𝑆}’ respectively. 3.2 Proposed Deep Belief Neural Network The SSGODBNC model employs a Deep Belief Network (DBN), a specialized deep learning model designed to enhance the accuracy of thyroid diseases detection while reducing processing time. This approach improves the feature selection and classification, especially for handling the large volume of sequential data. A DBN architecture consists of multiple layers of Restricted Boltzmann Machines (RBMs) arranged hierarchically, functioning as a generative model. This layered architecture minimized the computational complexity while handling the large volume of data samples. Additionally, the proposed deep learning architecture effectively minimizes errors during training, leading to improved overall performance in the thyroid diseases prediction. Figure 2 depicts the architecture of a Deep Belief Network for accurate thyroid disease prediction. The learning process is divided into two primary processes namely layer-by-layer training and fine-tuning. During the layer-by-layer training phase, each layer of the Deep Belief Network processes weighted input data samples and transferred into the next layer. In the fine-tuning phase, error back propagation is Figure 2 : Construction of Deep Belief Network employed to adjust the network’s hyper parameters, by applying a Squirrel Search Gradient Optimization method for enhanced performance. In the layer-by-layer approach, Deep Belief Networks utilizes the Restricted Boltzmann Machines (RBMs), which are stochastic neural networks. Restricted Boltzmann Machines (RBMs) are a type of stochastic neural network used for unsupervised learning, particularly in feature extraction and dimensionality reduction tasks. An RBM consists of two layers such as a visible layer and a hidden layer. The visible layer represents the input data samples, while the hidden layer processes the data samples. The output generated by one RBM serves as the input to the visible layer of the next RBM, as illustrated in Figure 2. As exposed in the figure 2, the DBNs consist of training set {𝑆,𝑌} where 𝑆 denotes a input data samples 𝑆={𝑆,𝑆,𝑆,…𝑆}’ collected from the dataset and a label or output ‘𝑌’ representing its category which belongs to the different classes(𝑌∈ 1,2,3…𝑘). The input data samples is associated to a weight ‘ 𝜗,𝜗,…,𝜗’ and added with bias ‘𝐵’. The probability of the neuron activation in the visible layer is given below, 𝑃 = 𝐹∑𝑆 ⬚∗𝜗+𝐵 (2) Where, 𝑃 denotes a neuron activation probability in visible layer, 𝐹 symbolizes a sigmoid activation function, ‘𝑆’ indicates an input patient data samples, 𝜗 represents a weights in visible layer 𝐵 indicates a bias of visible layer. If the neuron activation probability 𝑃 = 1 , then the input data
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4273 samples are sent into the hidden layer. In that layer, data preprocessing is carried out by significantly improve the performance of predictive models by addressing issues of missing values in the given dataset. 3.2.1 Data Preprocessing Data preprocessing is essential for ensuring that the machine learning model learns from high-quality, structured, and relevant dataset, leading to more reliable and accurate disease predictions. In the preprocessing step, the proposed SSGODBNC model addresses the missing data in the given dataset through the nearest neighbor imputation method. The first step involves analyzing the dataset to recognize the distribution of missing values. After that, the nearest neighbor imputation method is then applied for finding the missing values. The values of the nearest neighbors are averaged to fill in the missing entries. The missing data imputation process is expressed as follows, 𝑆 =∑ ∑ (3) Where, 𝑆 indicates a missing data values, 𝑆 denotes an observed neighboring known data sample values available in dataset, 𝛿 designates a weights assigned to the neighboring known data sample values. After finding the missing data, the determined values are refined by applying a normalization process. It is used to reduce the dimensionality of the dataset and capture the most significant values that explain the variance in the data. This refinement process stabilizes the effect of both continuous and categorical variables which capture the underlying structure and relationships within the data. In this step, the mean of each known value is computed as follows, 𝜇 = ∑𝑆 (4) Where, 𝜇 denotes a mean of each value, 𝐾 denotes a number of neighboring data samples. After that, the normalization method is applied to rescales data into standard normal distribution. 𝑆 = () (5) Where,𝑆 denotes a normalization of the respective missing values ‘𝑆’ and 𝜇 denotes a mean, 𝜎 denotes a standard deviation. The missing values, imputed with the mean value to minimize deviation, ensure that the underlying structure of the data is accurately reflected. Finally, these imputed values refine the dataset, enhancing the accuracy of disease prediction while minimizing time consumption. 3.2.2 Feature Selection After the preprocessing, the feature selection process is performed to reduce its dimensionality. This step involves identifying and retaining the most important features while discarding less relevant or redundant ones. By focusing on the most informative attributes, feature selection not only simplifies the dataset but also enhances the efficiency and accuracy of subsequent modeling tasks. This process ensures that the model operates on a refined set of features, reducing computational complexity and improving predictive performance. The proposed SSGODBNC model utilizes the Convergent Propagated Sparse Auto encoder model for selecting the significant features by removing the other features. The Sparse Auto encoder is a variation of an auto encoder neural network that helps to enhance the learning of input samples and provides the output in terms of compact and meaningful representation. A Sparse Auto encoder performs two major processes namely forward propagation and backward propagation to minimize the dimensionality of the input dataset. The proposed auto encoder model consider the preprocessing output ‘𝑃𝑂’ as input for feature selection. Forward propagation is used to find the most significant feature that maximizes the objective function’ 𝐽’ as expressed as follows, 𝐹= 𝑎𝑟𝑔𝑚𝑎𝑥 𝐽𝑂𝑢𝑡+ 𝑃𝑂,𝑤ℎ𝑒𝑟𝑒 𝑃𝑂 ∈ 𝑂𝑢𝑡, 𝑃𝑂 ∉ 𝑂𝑢𝑡 (6) Where, 𝐹 features selection at the forward propagation, 𝑎𝑟𝑔𝑚𝑎𝑥 denotes argument of maximum function, 𝑂𝑢𝑡 denotes a forward propagation of the features combined with the preprocessing output ‘𝑃𝑂’ during the feature selection process. After the forward propagation identifies significant features, backward propagation is employed to eliminate insignificant features from the selected set. This ensures that the feature set is refined to retain only the most relevant and impactful features.
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4274 𝐹= 𝑎𝑟𝑔𝑚𝑎𝑥 𝐽𝑂𝑢𝑡− 𝑃𝑂,𝑤ℎ𝑒𝑟𝑒 𝑃𝑂 ∈ 𝑂𝑢𝑡,𝑃𝑂 ∉ 𝑂𝑢𝑡 (7) 𝐹𝑆 = (𝐹 ,𝐹) (8) Where, 𝐹 features elimination at the backward propagation, 𝑎𝑟𝑔𝑚𝑎𝑥 denotes argument of maximum function, 𝑂𝑢𝑡 denotes a backward propagation output combined with the preprocessing output ‘𝑃𝑂’ during the feature selection process, 𝐽 denotes a objective function, 𝐹𝑆 indicates a final dimensionality feature set output which includes the significant feature selection and elimination. The process converges when the total number of features in the thyroid disease dataset is fully evaluated (both selected and eliminated), ensuring that the final feature set ‘𝐹𝑆’ contains only the most relevant features. This approach enhances the model's performance by optimizing the feature set through iterative refinement. The selected significant features are transferred into the third hidden layer. 3.2.3 Classification After the feature extraction phase, the classification process is performed to analyze the extracted features from the training and testing datasets. This phase is crucial for building and validating the predictive model. The Sokal– Michener’s simple matching method is a statistical method which applied to analyze the training and testing data samples based on the correlation measure. It is mathematically computed as follows, 𝑐𝑜𝑟𝑟 (𝑆,𝑆)= 1−| ∆ | (9) 𝑌 = 𝑐𝑜𝑟𝑟 (𝑆,𝑆) (10) Where, 𝑌 denotes an analysis outcomes, 𝑐𝑜𝑟𝑟 (𝑆,𝑆)indicates a correlation between the testing data samples ‘𝑆’ and training samples ‘𝑆’,’ 𝑛’ denotes a number of samples,𝑆 ∆ 𝑆 denotes a deviation between the samples. Based on the Sokal–Michener’s simple matching method, the correlation provides the similarity outcomes from ‘0’ to ‘1. The maximum correlation results provide the final classification outcomes. 3.2.4 Fine Tuning Fine-Tuning is a vital process in deep learning where a classifier model is further optimized to perform a specific task. It is used to refine the weights of the network for improved classification performance. In fine tuning process, the error rate is measured based on squared difference between the actual and predicted classification output as follows, 𝐸𝑅 = 𝑌 −𝑌 (11) Where, ‘𝐸𝑅’ symbolizes the error rate, 𝑌signifies the actual classification output, 𝑌 symbolizes the predicted classification output. In order to minimize the error, the adaptive Gradient method is employed to update the weight. 𝜗 = 𝜗 − 𝜂 (12) Where, 𝜗 indicates a new weight, 𝜗specifies a current weight, 𝜂 indicates a learning rate, signifies the first-order derivative to find out a local minimum of a function (i.e. error rate) by updating the current weight ‘𝜗’ In order to find optimal weight value, Squirrel Search Optimization algorithm is employed to reduce the error and enhance the accuracy of thyroid disease prediction. Squirrel Search Optimization (SSO) is a meta-heuristic algorithm inspired by the adaptive foraging behavior of squirrels. During warm weather, squirrels actively glide between trees in search of food resources, showcasing dynamic exploration patterns. In this optimization algorithm, squirrels symbolizes weights, while food resources represented by a fitness function. In colder periods, their activity decreases as they conserve energy to meet their basic needs. When the weather becomes constructive again, the squirrels resume their active foraging and exploration behaviors. This cyclic pattern continues throughout the lifespan of the squirrels, forming the basis of the optimization process. First, populations of squirrels (i.e. weights) are initialized in search space, 𝜗= 𝜗,𝜗,𝜗,….𝜗 (13) Where, 𝜗 denotes a ‘𝑏’ number of updated weighs. For each squirrel (i.e. weight), the fitness is measured based on the error rate. 𝑓(𝜗) = 𝑎𝑟𝑔𝑚𝑖𝑛𝐸𝑅(14) Where,𝑓(𝜗) represents a fitness of weight, 𝑎𝑟𝑔𝑚𝑖𝑛 indicates an argument of minimum function,
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4275 𝐸𝑅 indicates an error rate of the classifier model. Based on the fitness estimation, the current best weight is selected among the population. Then executes a different behaviors of the squirrels as follows, New Locations Generation Through Gliding In this behavior, new locations are generated by mimicking the gliding behavior of squirrels, which reflects their natural foraging habits. This gliding mechanism enables the algorithm to efficiently explore the solution space in detection of optimal results. 𝑋 = 𝑋+𝐷𝐺∗ |𝑋−𝑋| (15) Where, 𝑋 indicates a new location of the squirrels, 𝑋 indicates old location of the squirrel, 𝐷 denotes a random gliding distance, 𝐺 indicates a gliding constant, |𝑋−𝑋| indicates a deviation between the current position of squirrel ‘𝑋’ and 𝑋’ indicates a best position of the squirrel. Verify Seasonal Monitoring Condition The foraging patterns of flying squirrels are significantly influenced by seasonal variations. To address this, a seasonal monitoring mechanism is implemented, ensuring the algorithm avoids becoming stuck in local optima. 𝑍𝑆 = (𝑋− 𝑋) (16) Where, 𝑍𝑆 denotes a seasonal constant, 𝑋 indicates a current solution, 𝑋 designates an best position of squirrel. 𝑍𝑆 = [] ∗. (17) Where𝑍𝑆indicates a minimum seasonal constant, 𝐼𝑡𝑒𝑟indicates an iteration, 𝐼𝑡𝑒𝑟designates a maximum iteration. When 𝑍𝑆 < 𝑍𝑆 indicating the end of winter, flying squirrels lose their ability to navigate the forest efficiently and instead begin randomly exploring new locations in search of food. This cycle continues until the maximum number of iterations is achieved. If not, the process of generating new positions and evaluating seasonal monitoring conditions is repeated. Figure 3 : Flow Chart of Squirrel Search Optimization Figure 3 demonstrates the flow diagram of the squirrel search optimization for selecting the optimal weight with minimum error. As a result, then the optimally selected weights are used to enhance the disease prediction. Finally, the disease prediction results are obtained at the output layer as follows, 𝑌 = 𝐹 ( 𝛿ℎ∗ ℎ) (18) Where 𝑌 indicates a multiclass classification output, 𝐹 indicates a softmax activation function, ℎ indicates an output of the previous hidden layer, 𝛿 denotes a weight between the hidden and output layer. A softmax activation function ‘𝐹’ in the output layer for multi class classification output is formulated as follows. 𝐹 =() ∑() (19) From the above (19), the softmax activation function is used to make a multiple classification results, 𝑌 denotes a raw output for the 𝐾 class, 𝐶 denotes a total number of classes. The algorithmic process of Squirrel Search Gradient Optimized Deep Belief Neural Classifier model is given below. // Algorithm 1: Squirrel Search Gradient Optimized Deep Belief Neural Classifier model Input: dataset ‘ 𝐷𝑆 ’ , number of features 𝐹 = { 𝐹 , 𝐹 , … , 𝐹 } , samples ‘ 𝑆 = { 𝑆 , 𝑆 , … , 𝑆 } ’ Output: Increase the disease prediction accuracy
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4276 Begin 1. Collect number of features 𝐹 = {𝐹,𝐹,…,𝐹} and samples ‘𝑆 = {𝑆,𝑆,…,𝑆}--- input layer 2. For each sample 𝑆 3. Formulate the neuron activation probability using (1) 4. End For 5. Preprocessing the data samples using (3) (4) (5)–[hidden layer 1] 6. For each preprocessing samples ‘𝑷𝑶’ 7. Perform forward propagation to extract significant features as given in (6) 8. Perform backward propagation process to eliminate insignificant features (7) 9. Obtain the feature set ‘FS’ using (8) 10. End for 11. End for 12. For each training and testing data samples 13. Apply Sokal–Michener’s simple matching method using (9) 14. Obtain the classification results (10) 15. End for 16. For each classification outcomes-- 17. Compute the error rate ‘𝐸𝑅’ using (11) 18. Apply adaptive Gradient method to update weight using (12) 19. End for 20. Initialize the population of the weights 𝜗= 𝜗,𝜗,𝜗,….𝜗 21. For each weight in populations 22. Compute the fitness ‘𝐹’ using (14) 23. While (𝐼𝑡𝑒𝑟<𝐼𝑡𝑒𝑟) 24. Select the current best using 25. Generate new location using (15) 26. Verity Seasonal Monitoring Condition using (16) (17) 27. 𝒊𝒇(𝑍𝑆 < 𝑍𝑆)then 28. Relocate the search space 29. 𝐼𝑡𝑒𝑟 = 𝐼𝑡𝑒𝑟 +1 30. go to step 23 31. Else 32. Find the optimal weight 33. End if 34. End while 35. Obtain the final classification results using (18) (19) with softmax activation function at output layer End Algorithm 1 outlines the process for predicting different types of thyroid diseases with minimal time consumption. For each input data sample, weights and biases are assigned to the visible layer of the deep belief network (DBN) architecture. The input is then transferred to the neurons in the hidden layer, where data preprocessing is performed to handle missing values within the dataset. Next, significant features are selected in the subsequent hidden layer. Classification is carried out in third hidden layer using the Sokal–Michener's simple matching method to compare training and testing data samples. Based on this similarity, different types of thyroid diseases are classified. After classification, a fine-tuning process is performed using the Squirrel Search optimization algorithm. Initially, the number of weights is determined, and a population of squirrels (representing the weights) is initialized within the search space. The fitness of each squirrel is computed based on the classification error. The position of each squirrel is then updated iteratively. This process continues until the maximum number of iterations is reached. Through this iterative approach, the Squirrel Search algorithm identifies the optimal weight values that minimize the classification error. Finally, the prediction outcomes are determined by minimizing the classification error at the output layer. 4. Experimental Settings In this section, experimental evaluation of the proposed, SSGODBNC and two existing methods DSHM [1] and Stacked Ensemble with IG feature selection [2] are implemented in Python high-level general-purpose programming language. In order to conduct the experiment, Thyroid disease dataset is applied and it taken from the https://www.kaggle.com/datasets/emmanuelfwerr/thy roid-disease-data. This step ensures that sufficient information is available to train and validate the model
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4283 2840 – 2855. DOI: 10.1109/TAI.2023.3327981 [14] Mona Alnaggar, Mohamed Handosa, Tamer Medhat, M. Z. Rashad, “Thyroid Disease Multi-class Classification based on Optimized Gradient Boosting Model”, Egyptian Journal of Artificial Intelligence, Volume 2, Issue 1, 2023, Pages 113. DOI:10.21608/ejai.2023.205554.100 8 [15] Munisamy Shyamala Devi, Venkatesan Dhilip Kumar, Adrian Brezulianu, Oana Geman and Muhammad Arif, “A Novel Blunge Calibration Intelligent Feature Classification Model for the Prediction of Hypothyroid Disease”, Sensors, Volume 23, Issue 3, 2023, Pages 130.https://doi.org/10.3390/s23031128 [16] Wojciech Ksiazek, “Explainable Thyroid Cancer Diagnosis Through Two-Level Machine Learning Optimization with an Improved Naked Mole-Rat Algorithm”, Cancers, Volume 16, Issue 24, 2024, Pages 1-25. https://doi.org/10.3390/cancers16244128 [17] Muhammad Asad Abbas,Kashif Munir ,Ali Raza,Madiha Amjad,Nagwan Abdel Samee ,Mona M. Jamjoom,Zahid Ullah, “A novel meta learning based stacked approach for diagnosis of thyroid syndrome”, PLoS ONE, Volume 19, Issue 11, 2024, Pages 120.https://doi.org/10.1371/journal.pone.0 312313 [18] Khandaker Mohammad Mohi Uddina, Abdullah Al Mamun, Anamika Chakrabarti, Rafid Mostafiz, “An ensemble machine learning-based approach to predict thyroid disease using hybrid feature selection”, Biomedical Analysis, Elsevier, Volume 1, Issue 3, September 2024, Pages 229-239. https://doi.org/10.1016/j.bioana.2024.08. 001 [19] Ahmed M. Ali, and Said Broumi, “Machine Learning with Multi-Criteria Decision Making Model for Thyroid Disease Prediction and Analysis”, Multicriteria Algorithms with Applications, Volume 2, 2024, Pages 80–88. https://doi.org/10.61356/j.mawa.2024.26 961 [20] Muhammad Armghan Latif, Zohaib Mushtaq, Saad Arif, Sara Rehman, Muhammad Farrukh Qureshi, Nagwan Abdel Samee, Maali Alabdulhafith, Yeong Hyeon Gu and Mohammed A. Al-masni, “Improving Thyroid Disorder Diagnosis via Ensemble Stacking and Bidirectional Feature Selection”, Computers, Materials, & continua, Volume 78, Issue 3, 2024, Pages 4225-4241.DOI: 10.32604/cmc.2024.047621 [21] Ananda Sutradhar, Sharmin Akter, F M Javed Mehedi Shamrat, Pronab Ghosh, Xujuan Zhou, Mohd Yamani Idna Bin Idris, Kawsar Ahmed, Mohammad Ali Moni, “Advancing thyroid care: An accurate trustworthy diagnostics system with interpretable AI and hybrid machine learning techniques”, Heliyon, Elsevier, Volume 10, Issue 17, 2024, Pages 117.https://doi.org/10.1016/j.heliyon.2024.e3 6556 [22] Hongxi Wang, Chao Zhang, Qianrui Li, Tian Tian, Rui Huang, Jiajun Qiu & Rong Tian, “Development and validation of prediction models for papillary thyroid cancer structural recurrence using machine learning approaches”, BMC Cancer, Springer, Volume 24, 2024, Pages 112.https://doi.org/10.1186/s12885-02412146-4 [23] Elizabeth Clark, Samantha Price, Theresa Lucena, Bailey Haberlein , Abdullah Wahbeh and Raed Seetan, “Predictive Analytics for Thyroid Cancer Recurrence: A Machine Learning Approach”, Knowledge, Volume 4, Issue 4, 2024, Pages 114.https://doi.org/10.3390/knowledge40400 29 [24] Zhen-Tian Guo, Kun Tian, Xi-Yuan Xie, YuHang Zhang, and De-Bao Fang, “Machine Learning for Predicting Distant Metastasis of Medullary Thyroid Carcinoma Using the SEER Database”, International Journal of Endocrinology, Hindawi, Volume 2023, December 2023, Pages 1-10. https://doi.org/10.1155/2023/9965578 [25] Zhongzhi Wang, Limeng Qu, Qitong Chen, Yong Zhou, Hongtao Duan, Baifeng Li, Yao Weng, Juan Su and Wenjun Yi, “Deep learning-based multifeature integration robustly predicts central lymph node metastasis in papillary thyroid cancer”, BMC Cancer, Springer, Volume 23, 2023, Pages
Journal of Theoretical and Applied Information Technology 31st May 2025. Vol.103. No.10 © Little Lion Scientific ISSN: 1992-8645 www.jatit.org E-ISSN: 1817-3195 4284 1-17.https://doi.org/10.1186/s12885023-10598-8 [26] Sumya Akter, Hossen A. Mustafa, “Analysis and interpretability of machine learning models to classify thyroid disease”, PLoS ONE, Volume 19, Issue 5, 2024, Pages 130.https://doi.org/10.1371/journal.pone.0 300670 [27] Qiong Chen, Xiaofen Ye, Kangjian Wang and Haolin Shen, “Prediction of papillary thyroid metastases to the central compartment: proposal of a model taking into consideration other thyroid conditions”, Frontiers in Endocrinology, Volume 14, 2023, Pages 1-8. https://doi.org/10.3389/fendo.2023.1299 290 [28] Jiaqiang Dan, Jingya Tan, Yao Guo, Yang Xu, Lin Zhou, Junhua Huang, Zhiying Yuan, Xiang Ai, Junyan Li, “Construction and validation of a nomogram for predicting lateral lymph node metastasis in pediatric and adolescent with differentiated thyroid carcinoma”, Endocrine, Springer, Volume 84, 2024, Pages 1088–1096. https://doi.org/10.1007/s12020-02403730-6 [29] Jianning Liu, Zhuoying Feng, Ru Gao, Peng Liu, Fangang Meng, Lijun Fan, Lixiang Liu and Yang Du, “Analysis of risk factors for papillary thyroid carcinoma and the association with thyroid function indicators”, Frontiers in Endocrinology, Volume 15, 2024, Pages 112. https://doi.org/10.3389/fendo.2024.1 429932 [30] Anping Song, Tianyi Li, Xuehai Ding, Mingye Wu and Ren Wang, “TSE-GAN: strain elastography using generative adversarial network for thyroid disease diagnosis”, Frontiers in Bioengineering and Biotechnology, Volume 12, 2024, https://doi.org/10.3389/fbioe.2024.13307 13