scieee AI-readable full text Open interactive document viewer

Impact of Training Data Size on Model Accuracy and Computational Efficiency in Deep Learning Based Medical Image Diagnosis

Annual Methodological Archive Research Review (AMARR)

Full text

http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 313 Impact of Training Data Size on Model Accuracy and Computational Efficiency in Deep Learning Based Medical Image Diagnosis Muhammad Ejaz Bashir Department of Computer Science, The University of Faisalabad Email: [email protected] Nomaan Khan Department of Computer Science, The University of Agriculture, Faisalabad Email: [email protected] Maria Khalid National Center of Bioinformatics) NCB) Quaid e Azam University, Islamabad Email: [email protected] The rapid advancement of deep learning has meaningfully improved medical image diagnosis and as well as offering enhanced accuracy and efficiency in detecting complex diseases. Though training data size effects on model performance and computational efficiency remains a critical area of investigation. This research study discovers how varying the size of training datasets influences the diagnostic accuracy and computational cost of deep learning models used in medical imaging Employing convolutional neural networks (CNNs) on test datasets, varying dataset sizes were experimented upon in order to gauge changes in training time, accuracy, and utilization of resources. The results confirm a linear relation between model accuracy and dataset size up to some point beyond which marginal returns lose their utility. Additionally, larger datasets increase computational demands, affecting training time and memory usage. The study emphasizes the importance of identifying an optimal dataset size that balances accuracy and computational efficiency, especially in resource-constrained clinical environments. These type of vision & insights are crucial for developing scalable and effective AI-based diagnostic tools in healthcare. Results of this research study support future research and practical deployment of deep learning in medical image analysis, highlighting the trade-offs between data volume accuracy and as well as efficiency. Keywords: Data Size – Data Model – Learning – Diagnosis – Computational Efficiency Introduction In modern centuries deep learning has arose as a transformative method in medical image diagnosis filed contribution unparalleled accurateness in detecting, http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 314 categorizing, and segmenting complex disease design and patterns. Convolutional Neural Networks (CNNs) in specific have transformed how radiological and compulsive images are understood, outstanding traditional diagnostic methods in both precision and speed. Nonetheless deep learning effectiveness of models heavily depends on the quality and quantity of training data available. On the other side large datasets are often associated with improved model performance, they also bring challenges such as enlarged and increase computational charges, lengthier training times and also higher demands on memory and power of dispensation. Research Objectives To probe into size of training datasets and the diagnostic accuracy relationship of deep learning models in medical image analysis. To identify how varying training data sizes effects computational efficiency of convolutional neural networks (CNNs). To find out point at which increasing dataset size yields diminishing returns in model performance. Research Hypotheses There is no any significant relationship between the size of the training dataset and the diagnostic accuracy of deep learning models in medical image analysis. Changeable training dataset size does not meaningfully affect the computational efficiency of convolutional neural networks. Increasing the size of the training dataset does not lead to diminishing returns in the performance of deep learning models beyond a certain point. Literature review Litjens et al., (2017) explored that deep learning integration in medical image diagnosis has seen noteworthy progression and advancement in modern ages which mainly due to its capability and competence to learn complicated designs and pattern from large size of datasets. Convolutional Neural Networks (CNNs), in specific have arose as a powerful tool in categorizing and understanding medical images including MRIs and X-rays and as well as CT scans. CNNs ability to outperform outdated & traditional machine learning models has been extensively established particularly when trained on adequately large and miscellaneous datasets. Nonetheless training data volume compulsory for optimal performance remains active research topic. Esteva et al. (2019) highlighted that a important training data increase leads to substantial developments in accurateness in tasks like skin cancer detection signifying that data volume is critical and crucial for generalizability. Care that beyond a certain verge extra data does not proportionally improve and recover performance leads to diminishing and fading returns (Sun et al., 2017). Rajpurkar et al., 2018) say that training pipelines scalability is often limited in scientific locations where hardware resources are forced, creation it dangerous to control and determines optimal size of dataset that balances both accurateness and as well as computational cost. In a comparative study on dissimilar size of dataset in radiological image analysis and in this regard a study of Wang et al. (2020) found that repetition the size of dataset did not necessarily training time double and did result in http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 315 notable increases in GPU utilization and usage of memory. This type of observation has prompted into rising and growing interest in the trade-off between size of dataset and as well as computational efficiency. According to Szegedy et al., (2016) Current advancements in area have also inspected and examined computational expenses connecting greater training size of dataset. Even though larger datasets improve and enhance learning of models by diminishing over fitting and maximizing simplification as well as generalization they exponentially increase the computational load in terms of training time usage of memory. Up till now additional significant field studied in books is the subject of "diminishing returns" in performance from deep learning on increasing data volume. There are trials done, which established that although developments in data volumes at early points of increase dramatically enhance accuracy levels and improvement continues proportion to slow up with cumulative dimensions. This nonlinearity was explored by Hestness et al. (2017) who achieved experiments on a variety of areas and validated that deep learning accuracy is subject to a power-law curve over dataset size, where gains plateau after a point of saturation. Under medical imaging, the same pattern was seen by Ma et al. (2021), wherein CNNs trained with increasingly large datasets had a tendency to plateau in terms of diagnostic performance after a certain size, so that resource planning has to be effectively planned to prevent wasteful data usage. This suggests the necessity for adaptive training methods that have the capability to adjust model difficulty dynamically based on dataset size and available and obtainable computational powers. Additional serious part discovered in literature "diminishing returns" concept in deep learning recital & presentation as dataset size upsurges. More research studies have shown that while early rises in dataset size consequence in important improvements in accurateness and improvement tapers rate off at higher volumes and behavior was highlighted by Hestness et al. (2017), who showed results and conducted experiments across a numerous domains and long-established that deep learning performance. Tajbakhsh et al., 2016; Raghu et al.,(2019). Transmission learning has been optional as a computationally efficient supernumerary for training on large datasets from scratch. Through the use of pre-trained models on large-scale datasets such as Image Net on small medical image datasets investigators have attained competitive performance with much lower computational costs. This underlines the rank of prudently curated datasets rather than unselectively large ones. Johnson et al. (2019) studies propose that diversity of the dataset Richness of data are important factors that decide model performance. It is not just how many images are complicated but how much richness in features Additionally current literature and fiction has highlighted the data-efficient learning practical implications in medical AI. With the arrival of self-supervised and semisupervised learning methods large labeled datasets dependence is being re-evaluated. Different methods and Techniques such as pseudo-labeling and as well as contrastive learning allow models to learn expressive representations even from minimally annotated data thereby reducing the need for extensive labeled datasets explored by (Chen et al., 2020). This is particularly significant in the medical domain where data labeling is classy .expensive and as well as time-consuming which requires expert knowledge. Thus Azizi et al., 2021) current research studies is shifting towards http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 316 strategies that optimize performance not solely through dataset expansion but finished brainy knowledge paradigms that extract all-out value from available data Theoretical Framework The incorporation and integration of deep learning in medical image diagnosis is grounded in the wider theoretic foundations of machine learning, learning curve theory, computational efficiency and information theory. This type of theoretical framework draws on these type of domains to explain how training data size effects diagnostic accurateness and as well as computational efficiency of convolutional neural networks used in the medicinal imaging area. Representation Learning Theory LeCun, Bengio, & Hinton, (2015) say that representation learning theory which reinforces and support functioning of deep learning models designs chiefly CNNs. Furthermore explained that models improve their presentation and performances by learning hierarchical representations and data demonstration through multiple layers CNNs require a important data amount to learn precise and accurate and also widespread representations that can differentiate among abnormal and healthy cases. Generalization aptitude and skills of neural networks improves with superior and additional diverse training datasets, which assistance models avoid over fitting and realize additional healthy decision borders. Goodfellow, Bengio, and Courville (2016) Power Law Theory & Learning Curve Hestness et al., (2017) explored that learning curve theory postulates model performance recovers as training data size increases characteristically following a power-law relationship. This type of non-linear development and as well as http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 317 progression implies the presence of lessening revenues where after a specific verge and extra data donates slightly to performance gains. In deep learning this association is serious as training larger datasets incurs advanced computational charges up till now may not guarantee balanced developments in accurateness. Data Efficiency & Information Theory Information theory offers a lens finished which to comprehend impact of size of dataset on model accuracy. According to Shannon (1948) perspective apiece data sample transmits a specific amount of data entropy which pays and as well as contribute to reducing uncertainty in model predictions. Though dataset increases or decreases the incremental information gain from each new sample decreases. Additionally this Data Efficiency & Information Theory Clarifies why models trained on large but similar datasets may not perform meaningfully healthier than those trained on smaller but more varied datasets. Therefore the in formativeness of the dataset are as critical as its size in improving diagnostic accurateness study's exploration supporting of dataset quality as a curbing variable. Algorithmic Complexity Theory & Computational Efficiency It's related and associated with deep learning models are clarified through computational complexity theory lens chiefly concerning space & time difficulty. CNN training contains and involves in back propagation and also gradient descent for both of scale with size of data set and model complexity and also input resolution said by Szegedy et al., (2016). Big O notation is frequently used to label these type of difficulties where training time and usage of memory may scale linearly or quadratic ally with data volume contingent architecture algorithm and hardware. This bring into line with the study’s focus on assessing and evaluating resource operation. Trade-Off Theory In computer sciences Trade-off theory design supports and provided chain notion that performance improvements often come at the expenditure of augmented reserve http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 318 ingesting. More in deep learning-based medical diagnostics there exists a trade-off among computational efficiency & diagnostic accuracy. For instance while dataset size increases may also improve and recover model precision it also intensifies terms of processing power costs and usage of memory which can be high-priced in resource-limited healthcare locations and setting (Rajpurkar et al., 2018). This type of theoretical construct is central to the research problem. Transfer Learning and Data Utilization Theory Data utilization theory closely knotted to transfer learning postulates information from one area or dataset can be transferred to another plummeting massive training data need. Transfer learning develops particularly relevant in medical imaging where labeled data is rare scarce and also expensive to obtain. According to Raghu et al. (2019) propose that models pre trained on large which generic datasets can achieve high accurateness when fine-tuned on lesser task-specific datasets. This type of philosophy underlines that model performance is not only reliant on on dataset size but also on preceding information and how efficiently it is modified to the mark area. http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 319 Research Methodology This research study examined about a quantitative experimental research design which purposes to investigate training dataset size impacts on the accuracy and as well as computational efficiency of deep learning-based medical image diagnosis. Furthermore Convolutional Neural Networks were selected as core deep learning architecture and also varying dataset sizes 5,000 to 50,000 images on optional basis of annotated medical images were used to train models. On the bias of systematically division of datasets were into training and validation. Each model was trained under reliable hyper limit settings to ensure consistency and as well as results comparability. More in this research study metrics diagnostic accuracy and also training time with usage of memory were recorded for each dataset size. Some Statistical techniques analysis which was about ANOVA and also Regression analysis were applied to analyze dataset size effects on model accuracy and computational cost and as well as results discusses in this study. Data Analysis & Interpretation Null Hypothesis 1 (H₀₁): There is no significant any relationship between the size of the training dataset and the diagnostic accuracy of deep learning models in medical image analysis. Table 1 Dataset Size (Images) Diagnostic Accuracy (%) 5,000 82.3 10,000 86.7 20,000 90.4 30,000 91.5 40,000 91.9 Table No .2 Variables r p-value Dataset Size & Accuracy .984 .002 Note: r = Pearson correlation coefficient; p < .05 is considered statistically significant. Interpretation: Above table shows the results of correlation analysis which provided a strong and stout correlation among training dataset size and also CNN model diagnostic accuracy whereas r (3) = .984, p = .002. Hence p-value is less than the alpha level of http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 320 0.05 so we reject the null hypothesis and accept alternatives and this study analysis indicates that there is a statistically significant relationship between training dataset size and model accuracy. Furthermore in this study dataset size increased from 5,000 to 40,000 images and diagnostic accuracy improved reliably however improvement rate reduced at higher data volumes which suggesting diminishing returns. Null Hypothesis 2 Varying the training dataset size does not significantly affect the computational efficiency of convolutional neural networks (CNNs). Table 1 Descriptive Statistics of Training Time and Memory Usage at Varying Dataset Sizes Dataset Size (Images) Mean Training Time (mins) Mean Memory Usage (GB) 5,000 15.2 3.8 10,000 28.6 5.9 20,000 52.4 8.1 30,000 75.9 10.3 40,000 101.3 12.7 Table 2 ANOVA Results for Training Time Source SS df MS F p-value Between Groups 6530.72 4 1632.68 142.85 <.001 Within Groups 114.26 10 11.43 0 <.001 Total 6644.98 14 0 0 <.001 http://amresearchreview.com/index.php/Journal/about Volume 3, Issue 4 (2025) Online ISSN Print ISSN . . http://amresearchreview.com/index.php/Journal/about Page 321 Table 3 ANOVA Results for Memory Usage Source SS df MS F p-value Between Groups 111.24 4 27.81 124.65 <.001 Within Groups 2.23 10 0.22 0 <.001 Total 113.47 14 0 0 <.001 Interpretation: Above tables of research study revealed that there is statistically significant differences in both training time (F (4, 10) = 142.85, p < .001) and also memory usage which F (4, 10) = 124.65, p < .001) across different dataset sizes. Hence we reject the null hypothesis and accept alternatives hypotheses and study data shows that as the size of the training dataset increases for both training time and memory usage increase meaningfully. This results of study proves a direct impact of dataset size on computational efficiency which underscoring importance of balancing data volume Null Hypothesis 3 Increasing size of the training dataset does not lead to diminishing returns in the performance of deep learning models beyond a certain point. Table 1 Model Accuracy across Different Dataset Sizes Dataset Size (Images) Diagnostic Accuracy (%) 5,000 82.3 10,000 86.7 20,000 90.4 30,000 91.5 40,000 91.9 50,000 92.0