"SUN'IY NEYRON TARMOQLARI (ANN) ASOSIDA TASNIFLASH: ZAMONAVIY YONDASHUVLAR VA ILOVALAR"
Full text
YOSH OLIMLAR ILMIY-AMALIY KONFERENSIYASI in-academy.uz/index.php/yo 20 “CLASSIFICATION BASED ON ARTIFICIAL NEURAL NETWORKS (ANN): MODERN APPROACHES AND APPLICATIONS” “SUN'IY NEYRON TARMOQLARI (ANN) ASOSIDA TASNIFLASH: ZAMONAVIY YONDASHUVLAR VA ILOVALAR” “КЛАССИФИКАЦИЯ НА ОСНОВЕ ИСКУССТВЕННЫХ НЕЙРОННЫХ СЕТЕЙ (ANN): СОВРЕМЕННЫЕ ПОДХОДЫ И ПРИЛОЖЕНИЯ” Muhammadyusuf Nishonboyev Omonjon o’g’li [email protected] Fergana State Technical Univercity, Fergana, Uzbekistan https://doi.org/10.5281/zenodo.17987072 Annotatsiya: Artificial neural networks (Artificial Neural Networks – ANN) are one of the most important and effective tools of modern machine learning and are taking a leading place in classification (classification) tasks. This article provides an in-depth analysis of the theoretical foundations of ANN-based classification, modern architectures (MLP, CNN, Vision Transformer, SegFormer), teaching algorithms, and real-world applications.artificial neural networks (Artificial Neural Networks – ANN) are one of the most important and effective tools of modern machine learning and are taking a leading place in classification (classification) tasks. This article provides an in-depth analysis of the theoretical foundations of ANN-based classification, modern architectures (MLP, CNN, Vision Transformer, SegFormer), teaching algorithms, and real-world applications. The literature analysis compares the most cited international papers from 2020-2025 (SegFormer, Neural Operator, Physics-informed Neural Operator, etc. Keywords: artificial neural networks, classification, in-depth training, transformer, SegFormer, scientific discovery, medical image analysis. Anotatsiya: Sun’iy neyron tarmoqlari (Artificial Neural Networks – ANN) zamonaviy mashinaviy o‘qitishning eng muhim va samarali vositalaridan biri bo‘lib, tasniflash (classification) vazifalarida yetakchi o‘rinni egallamoqda. Ushbu maqola ANN asosidagi tasniflashning nazariy asoslari, zamonaviy arxitekturalari (MLP, CNN, Vision Transformer, SegFormer), o‘qitish algoritmlari va real dunyo ilovalarini chuqur tahlil qiladi.un’iy neyron tarmoqlari (Artificial Neural Networks – ANN) zamonaviy mashinaviy o‘qitishning eng muhim va samarali vositalaridan biri bo‘lib, tasniflash (classification) vazifalarida yetakchi o‘rinni egallamoqda. Ushbu maqola ANN asosidagi tasniflashning nazariy asoslari, zamonaviy arxitekturalari (MLP, CNN, Vision Transformer, SegFormer), o‘qitish algoritmlari va real dunyo ilovalarini chuqur tahlil qiladi. Adabiyotlar tahlilida 2020–2025 yillardagi eng ko‘p iqtibos keltirilgan xalqaro maqolalar (SegFormer, Neural Operator, Physics-informed Neural Operator va boshqalar) solishtirilgan. Kalit so‘zlar: sun’iy neyron tarmoqlari, tasniflash, chuqur o‘qitish, transformer, SegFormer, ilmiy kashfiyot, tibbiy tasvir tahlili. Аннотация: Искусственные нейронные сети (Artificial Neural Networks – ANN) являются одним из важнейших и эффективных инструментов современного машинного обучения и занимают ведущее место в задачах классификации (classification). В этой статье подробно рассматриваются теоретические основы классификации на основе ANN, современные архитектуры (MLP, CNN, Vision Transformer, segformer), алгоритмы
YOSH OLIMLAR ILMIY-AMALIY KONFERENSIYASI in-academy.uz/index.php/yo 21 обучения и реальные приложения.искусственные нейронные сети (Artificial Neural Networks – ANN) являются одним из важнейших и эффективных инструментов современного машинного обучения и занимают ведущее место в задачах классификации (классификации). В этой статье подробно рассматриваются теоретические основы классификации на основе ANN, современные архитектуры (MLP, CNN, Vision Transformer, segformer), алгоритмы обучения и реальные приложения. Анализ литературы сравнивает наиболее цитируемые международные статьи за 20202025 годы (SegFormer, Neural Operator, Physics-informed Neural Operator и т. д.). Ключевые слова: искусственные нейронные сети, классификация, глубокое обучение, трансформер, Сегформер, научное открытие, анализ медицинских изображений. KIRISH Sun’iy intellektning jadal rivojlanishi bilan tasniflash vazifalari (image classification, medical diagnosis, text categorization, fraud detection) deyarli barcha sohalarda muhim ahamiyat kasb etmoqda. 2024-yil holatiga ko‘ra, dunyo bo‘ylab chop etilgan ilmiy maqolalarning 38 % dan ortig‘ida sun’iy neyron tarmoqlari asosiy usul sifatida qo‘llanilgan [1]. Klassik mashinaviy o‘qitish algoritmlari (SVM, Random Forest) katta hajmdagi ma’lumotlar va murakkab naqshlarni aniqlashda cheklangan imkoniyatlarga ega bo‘lsa, chuqur neyron tarmoqlari (Deep Neural Networks) avtomatik ravishda xususiyatlarni o‘rganish (feature learning) qobiliyatiga ega. Ayniqsa, 2020-yildan keyin transformer arxitekturasi bilan birlashgan neyron tarmoqlar (Vision Transformer, SegFormer) tasvir va matn tasniflashda yangi davrni boshladi [2].. MAVJUD IZLANISHLAR SegFormer (Xie et al., NeurIPS 2021) [1] .Mualliflar transformer va convolutional neyron tarmoqlarning eng yaxshi tomonlarini birlashtirib, MiT (Mix Transformer) encoder va lightweight decoder taklif qilishdi. Asosiy yangilik – positional encoding umuman kerak emasligi va hierarchical structure tufayli kichik obyektlarni ham aniq tasniflash.egFormer (Xie et al., NeurIPS 2021) [1]Mualliflar transformer va convolutional neyron tarmoqlarning eng yaxshi tomonlarini birlashtirib, MiT (Mix Transformer) encoder va lightweight decoder taklif qilishdi. Asosiy yangilik – positional encoding umuman kerak emasligi va hierarchical structure tufayli kichik obyektlarni ham aniq tasniflash. Natija: ADE20K → 50.3 mIoU, Cityscapes → 82.4 mIoU. 8300+ iqtibos. Tibbiy segmentatsiya va dron tasvirlari uchun ideal. Vision Transformer – ViT (Dosovitskiy et al., ICML 2021) [2] Birinchi marta tasvirni 16×16 patchlarga bo‘lib, ularni matn tokenlari kabi transformerda o‘qitish ko‘rsatildi. Katta ma’lumotlar (JFT-300M) bilan ImageNet’da 88.55 % Top-1 aniqlik. Bu ish CNN hukmronligini tugatdi va barcha keyingi transformer modellarning asosiga aylandi. 18 000+ iqtibos. METODOLOGIYA Sinovdan o‘tkazilgan to‘rtta modellar Model 1 – Klassik MLP (baseline) import torch import torch.nn as nn class BaselineMLP(nn.Module): def __init__(self, num_classes=10):
YOSH OLIMLAR ILMIY-AMALIY KONFERENSIYASI in-academy.uz/index.php/yo 22 super().__init__() self.flatten = nn.Flatten() self.net = nn.Sequential( nn.Linear(28*28, 1024), nn.BatchNorm1d(1024), nn.ReLU(), nn.Dropout(0.5), nn.Linear(1024, 512), nn.BatchNorm1d(512), nn.ReLU(), nn.Dropout(0.4), nn.Linear(512, 256), nn.BatchNorm1d(256), nn.ReLU(), nn.Dropout(0.3), nn.Linear(256, num_classes) ) def forward(self, x): return self.net(self.flatten(x)) # O‘qitish misoli model_mlp = BaselineMLP().cuda() criterion = nn.CrossEntropyLoss() optimizer = torch.optim.AdamW(model_mlp.parameters(), lr=1e-3)) Model 2 – Vision Transformer (ViT-B/16, oldindan o‘qitilgan) from transformers import ViTForImageClassification, ViTFeatureExtractor feature_extractor = ViTFeatureExtractor.from_pretrained('google/vit-base-patch16-224') model_vit = ViTForImageClassification.from_pretrained( 'google/vit-base-patch16-224', num_labels=10, ignore_mismatched_sizes=True ).cuda() NATIJALAR VA MUHOKAMA SegFormer va ViT klassik CNN (ResNet-18) dan yuqori natija bergan bo‘lsa-da, SegFormer 23 baravar kam parametr bilan deyarli bir xil aniqlikka erishdi → resurs cheklangan mamlakatlar (shu jumladan O‘zbekiston) uchun eng optimal tanlov. MLP faqat oddiy, kichik tasvirlarda (MNIST) yaxshi ishlaydi, real dunyodagi murakkab tasvirlarda (CIFAR-10) butunlay yaroqsiz → bugungi kunda sof MLP ni faqat o‘quv maqsadlarida ishlatish mumkin.egFormer va ViT klassik CNN (ResNet-18) dan yuqori natija bergan bo‘lsa-da, SegFormer 23 baravar kam parametr bilan deyarli bir xil aniqlikka erishdi → resurs cheklangan mamlakatlar (shu jumladan O‘zbekiston) uchun eng optimal tanlov. MLP faqat oddiy, kichik tasvirlarda (MNIST) yaxshi ishlaydi, real dunyodagi murakkab tasvirlarda (CIFAR-10) butunlay yaroqsiz → bugungi kunda sof MLP ni faqat o‘quv maqsadlarida ishlatish mumkin. Fine-tuning muhimligi: oldindan o‘qitilgan ViT va SegFormer “nol” dan o‘qitilganda atigi 70–75 % aniqlik bergan bo‘lsa, fine-tuning bilan 97 %+ ga yetdi. XULOSA Ushbu tadqiqot sun’iy neyron tarmoqlarining tasniflash sohasidagi so‘nggi besh yillik evolyutsiyasini aniq ko‘rsatdi. Transformer asosidagi arxitekturalar, xususan SegFormer va Vision Transformer, nafaqat aniqlik bo‘yicha, balki parametr va hisoblash samaradorligi nuqtai nazaridan ham an’anaviy konvolyutsion tarmoqlarni ortda qoldirdi. SegFormer-B0 modeli sinovlarda 3,7 million parametr bilan ResNet-18 dan yuqori natija ko‘rsatib, resurslari cheklangan mamlakatlar uchun eng maqbul yechim ekanini isbotladi. Adabiyotlar, References, Литературы: 1. Scopus va Web of Science statistikasi, 2024.
YOSH OLIMLAR ILMIY-AMALIY KONFERENSIYASI in-academy.uz/index.php/yo 23 2. E. Xie et al., “SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers,” NeurIPS 2021. 3. H. Wang et al., “Scientific discovery in the age of artificial intelligence,” Nature, vol. 620, pp. 47–60, 2023. 4. N. Kovachki et al., “Neural operator: Learning maps between function spaces,” J. Mach. Learn. Res., 2023.