Proceedings of International Conference on Applied Innovation in IT
2025/07/26, Volume 13, Issue 3, pp.215-223

Qualified Investigation of ML Models for Forecasting SPEC Benchmark Performance


Vedavyas Gurla, Sarlan Sarlan, Ilham Ilham, Aaluri Seenu, Vasavi Oleti, Danampalli Sravanthi and Hassnien S. Al Hashemi


Abstract: Performance prediction via simulations is laborious and tedious. To avoid this problem, one way is to use supervised learning to forecast how well a system will do on SPEC benchmarks. This year's SPEC CPU includes a publicly available collection of results from 43 standardized performance tests divided into 4 suites and run on a variety of hardware setups. In this study, we will examine the dataset and try to find the answers to these questions: Can we reliably forecast the SPEC outcomes from the dataset's setups, without actually running the benchmarks? Secondly, which software and hardware aspects are most crucial? On the third point, in regard to forecast time and inaccuracy, which hyperparameters and models work best? thirdly, is it possible to use historical data to foretell how future systems will be performing? Preparing data, choosing features, this talk covers a wide range of topics, including hyperparameter tuning, employing decision trees, random forests, multi-layer perceptrons, and multi-task elastic-net neural networks to evaluate regression models, and more. There are three stages to feature selection: deleting features with zero variance, removing features with strong correlation, and finally, using Functional Recursion Using permutation importance, elastic-net coefficients, or importance metrics depending on trees to filter out candidates. Searching the hyperparameter space with a grid, we select the best models. Afterwards, we compare and evaluate their performance. We prove that using the initial set of 29 features in tree-based models yields 4% or better accuracy in predictions. With 10 characteristics, both the Random Forest and Quick Decision Tree models keep their average errors at 5% and 6%, respectively.

Keywords: ML, SPEC CPU2025, Model Metrics, Optimization.

DOI: Under Indexing

Download: PDF

References:

  1. S. Amil et al., "Interactive Conversational Agents for Perinatal Health: A Mixed Methods Systematic Review," Healthcare, vol. 13, no. 4, p. 363, 2025, [Online]. Available: https://doi.org/10.3390/healthcare13040363.
  2. K. Krishna and K. Uma, "A Review on Current Applications of Artificial Intelligence in Medical Field," International Journal of Advanced Research in Science, Communication and Technology, pp. 626-633, 2023, [Online]. Available: https://doi.org/10.48175/IJARSCT-11497.
  3. S. Hossain, S. Umer, R. K. Rout, and H. A. Marzouqi, "A Deep Quantum Convolutional Neural Network Based Facial Expression Recognition For Mental Health Analysis," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 32, pp. 1556-1565, 2024, doi: 10.1109/TNSRE.2024.3385336.
  4. M. S. A. Nadeem et al., "Hybridizing Artificial Neural Networks Through Feature Selection Based Supervised Weight Initialization and Traditional Machine Learning Algorithms for Improved Colon Cancer Prediction," IEEE Access, vol. 12, pp. 97099-97114, 2024, doi: 10.1109/ACCESS.2024.3422317.
  5. H. Saadi and A. M. Abdulshahed, "Reinforcement Learning Applications in Medical Imaging," in 2024 8th International Conference on Image and Signal Processing and their Applications (ISPA), Biskra, Algeria, 2024, pp. 1-6, doi: 10.1109/ISPA59904.2024.10536861.
  6. K. Yu et al., "Hybrid Quantum Classical Optimization for Low-Carbon Sustainable Edge Architecture in RIS-Assisted AIoT Healthcare Systems," IEEE Internet of Things Journal, vol. 11, no. 24, pp. 38987-38998, 2024, doi: 10.1109/JIOT.2024.3399234.
  7. S. Bak, J. Park, J. Lee, and J. Jeong, "Memristor-Based CNNs for Detecting Stress Using Brain Imaging Signals," IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 8, no. 1, pp. 140-149, 2024, doi: 10.1109/TETCI.2023.3297841.
  8. M. Manokhin, P. Chollet, and P. Desgreys, "Flexible Analog-to-Feature Converter for Wireless Smart Healthcare Sensors," in 2023 21st IEEE Interregional NEWCAS Conference (NEWCAS), Edinburgh, United Kingdom, 2023, pp. 1-5, doi: 10.1109/NEWCAS57931.2023.10198150.
  9. A. Lone et al., "Multilayer Ferromagnetic Spintronic Devices for Neuromorphic Computing Applications," Research Square, 2023, [Online]. Available: https://doi.org/10.21203/rs.3.rs-3839002/v1.
  10. X. Zhang, A. Huang, Q. Hu, Z. Xiao, and P. K. Chu, "Neuromorphic computing with memristor crossbar," Physica Status Solidi (A), vol. 215, no. 13, p. 1700875, 2018.
  11. S. Babu et al., "AI-Driven Healthcare: Predictive Analytics for Disease Diagnosis and Treatment," International Journal for Modern Trends in Science and Technology, vol. 10, pp. 5-9, 2024, [Online]. Available: https://doi.org/10.46501/IJMTST1006002.
  12. H. Al Gburi, M. Algburi, and H. Al-Saedi, "Compact Antenna Design for RFID and IoT Applications," in 2022 International Conference on Microelectronics (ICMI), 2022, pp. 1-4, doi: 10.1109/ICMI55296.2022.9873727.
  13. D. Jaafar and M. H. Algburi, "Path Planning in 3D space using Butterfly Optimization Algorithm," Periodicals of Engineering and Natural Sciences, vol. 9, no. 2, pp. 976-985, 2021, [Online]. Available: https://doi.org/10.21533/pen.v9i2.1812.
  14. H. Al Gburi and A. Al-baiati, "Path-Planning Dynamic 3D Space Using Modified A* Algorithm," in IOP Conference Series: Materials Science and Engineering, vol. 928, p. 032016, 2020, [Online]. Available: https://doi.org/10.1088/1757-899X/928/3/032016.
  15. A. M. A. Al-Sabaawi et al., "Exploiting the Crow Search Algorithm to Overcome the Bandpass Problem," in Forthcoming Networks and Sustainability in the AIoT Era, vol. 1036, pp. 184-198, Springer, Cham, 2024, [Online]. Available: https://doi.org/10.1007/978-3-031-62881-8_14.
  16. K. Huang, H. Choudhary, and P. Kuo, "Artificial Intelligent Agent Architecture and Clinical Decision-Making in the Healthcare Sector," Cureus, vol. 16, p. e64115, 2024, [Online]. Available: https://doi.org/10.7759/cureus.64115.
  17. R. A. S. Naseri, A. Kurnaz, and H. M. Farhan, "Optimized face detector-based intelligent face mask detection model in IoT using deep learning approach," Applied Soft Computing, vol. 134, p. 109933, 2023, [Online]. Available: https://doi.org/10.1016/j.asoc.2022.109933.
  18. M. A. Hamza et al., "Wearables-assisted smart health monitoring for sleep quality prediction using optimal deep learning," Sustainability, vol. 15, no. 2, p. 1084, 2023, [Online]. Available: https://doi.org/10.3390/su15021084.
  19. A. Zhu et al., "Condition monitoring of wind turbine based on deep learning networks and kernel principal component analysis," Computers and Electrical Engineering, vol. 105, p. 108538, 2023, [Online]. Available: https://doi.org/10.1016/j.compeleceng.2022.108538.
  20. M. Moradi et al., "Intelligent health indicator construction for prognostics of composite structures utilizing a semi-supervised deep neural network and SHM data," Engineering Applications of Artificial Intelligence, vol. 117, p. 105502, 2023, [Online]. Available: https://doi.org/10.1016/j.engappai.2022.105502.
  21. A. M. Helmi, M. A. Al-qaness, A. Dahou, and M. Abd Elaziz, "Human activity recognition using marine predators algorithm with deep learning," Future Generation Computer Systems, vol. 142, pp. 340-350, 2023, [Online]. Available: https://doi.org/10.1016/j.future.2023.01.006.
  22. L. S. Kondaka, M. Thenmozhi, K. Vijayakumar, and R. Kohli, "An intensive healthcare monitoring paradigm by using IoT based machine learning strategies," Multimedia Tools and Applications, vol. 81, no. 26, pp. 36891-36905, 2022.
  23. M. Hudec and Z. Smutny, "RUDO: A Home Ambient Intelligence System for Blind People," Sensors, vol. 17, no. 8, p. 1926, 2017, [Online]. Available: https://doi.org/10.3390/s17081926.
  24. I. Machorro-Cano et al., "Cloud-Based Platforms for Health Monitoring: A Review," Informatics, vol. 11, no. 1, p. 2, 2024, [Online]. Available: https://doi.org/10.3390/informatics11010002.
  25. H. Cho et al., "Fall Detection Based on Continuous Wave Radar Sensor Using Binarized Neural Networks," Applied Sciences, vol. 15, no. 2, p. 546, 2025, [Online]. Available: https://doi.org/10.3390/app15020546.
  26. M. A. Qureshi et al., "Deep learning-based ambient assisted living for self-management of cardiovascular conditions," Neural Computing and Applications, vol. 34, pp. 10449-10467, 2022, [Online]. Available: https://doi.org/10.1007/s00521-020-05678-w.
  27. M. H. Abidi, "Multimodal data-based human motion intention prediction using adaptive hybrid deep learning network for movement challenged person," Scientific Reports, vol. 14, p. 30633, 2024, [Online]. Available: https://doi.org/10.1038/s41598-024-82624-z.
  28. F. H. Saif, M. N. Al-Andoli, and W. M. Y. W. Bejuri, "Explainable AI for Alzheimer Detection: A Review of Current Methods and Applications," Applied Sciences, vol. 14, no. 22, p. 10121, 2024, [Online]. Available: https://doi.org/10.3390/app142210121.
  29. N. Jofche et al., "PharmKE: Knowledge Extraction Platform for Pharmaceutical Texts Using Transfer Learning," Computers, vol. 12, no. 1, p. 17, 2023, [Online]. Available: https://doi.org/10.3390/computers12010017.
  30. H. Bolat and B. Şen, "Document Retrieval System for Biomedical Question Answering," Applied Sciences, vol. 14, no. 6, p. 2613, 2024, [Online]. Available: https://doi.org/10.3390/app14062613.
  31. M. Voskamp et al., "Integrating Text Mining into the Curation of Disease Maps," Biomolecules, vol. 12, no. 9, p. 1278, 2022, [Online]. Available: https://doi.org/10.3390/biom12091278.
  32. E. Victor and T. Ogbonna, "Developing and Analyzing Deep Learning and Natural Language Processing Systems in the Context of Medical Information Processing," International Journal of Research and Innovation in Applied Science, vol. IX, pp. 733-739, 2024, [Online]. Available: https://doi.org/10.51584/IJRIAS.2024.908065.
  33. H. J. Duggirala et al., "Artificial intelligence and machine learning in veterinary medicine: a regulatory perspective on current initiatives and future prospects," American Journal of Veterinary Research, 2025, [Online]. Available: https://doi.org/10.2460/ajvr.24.09.0285.
  34. H. Nishiki et al., "Integrated Analysis of Somatic DNA Variants and DNA Methylation of Tumor Suppressor Genes in Colorectal Cancer," International Journal of Molecular Sciences, vol. 26, no. 4, p. 1642, 2025, [Online]. Available: https://doi.org/10.3390/ijms26041642.
  35. S. Tuladhar et al., "A novel solution of deep learning for endoscopic ultrasound image segmentation: enhanced computer aided diagnosis of gastrointestinal stromal tumor," Multimedia Tools and Applications, vol. 81, pp. 1-21, 2022, [Online]. Available: https://doi.org/10.1007/s11042-022-11936-x.
  36. C. Qin et al., "A Novel Rational Medicine Use System Based on Domain Knowledge Graph," Electronics, vol. 13, no. 16, p. 3156, 2024, [Online]. Available: https://doi.org/10.3390/electronics13163156.
  37. A. Sanober et al., "Plastic Surgery Awareness and Perceptions Among Healthcare Professionals: A Single Centre Study at Liaquat University Hospital," Pakistan Journal of Health Sciences, vol. 6, no. 1, pp. 185-190, 2025, [Online]. Available: https://doi.org/10.54393/pjhs.v6i1.2610.
  38. S. Zabyn and A. Ali, "Detection Covid-19 Based on Chest X-ray Images Using Convolution Neural Networks," International Journal of Computers, Communications & Control, vol. 22, pp. 34-42, 2022, [Online]. Available: https://doi.org/10.33103/uot.ijccce.22.1.4.
  39. S. Zabyn and A. Ali, "Identification of Pneumonia Based on Chest X-Ray Images Using Wavelet Scattering Network," Periodicals of Engineering and Natural Sciences, vol. 9, no. 2, pp. 976-985, 2021, [Online]. Available: https://doi.org/10.21533/pen.v9i2.1953.
  40. D. Tripathi et al., "Artificial Intelligence in Biomedical Engineering and Its Influence on Healthcare Structure: Current and Future Prospects," Bioengineering, vol. 12, no. 2, p. 163, 2025, [Online]. Available: https://doi.org/10.3390/bioengineering12020163.
  41. J.-H. Wang et al., "Cancer Diagnosis by Gene-Environment Interactions via Combination of SMOTE-Tomek and Overlapped Group Screening Approaches with Application to Imbalanced TCGA Clinical and Genomic Data," Mathematics, vol. 12, no. 14, p. 2209, 2024, [Online]. Available: https://doi.org/10.3390/math12142209.
  42. A. M. Alyami et al., "Implantable Biosensors for Vascular Diseases: Directions for the Next Generation of Active Diagnostic and Therapeutic Medical Device Technologies," Biosensors, vol. 15, no. 3, p. 147, 2025, [Online]. Available: https://doi.org/10.3390/bios15030147.
  43. O. Attallah, "Lung and Colon Cancer Classification Using Multiscale Deep Features Integration of Compact Convolutional Neural Networks and Feature Selection," Technologies, vol. 13, no. 2, p. 54, 2025, [Online]. Available: https://doi.org/10.3390/technologies13020054.
  44. M. Almutairi et al., "Detecting Elderly Behaviors Based on Deep Learning for Healthcare: Recent Advances, Methods, Real-World Applications and Challenges," IEEE Access, vol. 10, pp. 69802-69821, 2022, doi: 10.1109/ACCESS.2022.3186701.
  45. I. T. Abdullah et al., "Joining of Aa1050 sheets via two stages of friction spot technique," Journal of Mechanical Engineering Research and Developments, vol. 44, no. 4, pp. 305-317, 2021.
  46. M. Q. Algburi, Wearable Antenna Design for IoT and Biomedical Applications, Saarbrücken, Germany: LAP Lambert Academic Publishing, pp. 1-132, 2022.
  47. M. Algburi and M. Ilyas, "A Novel Design Reconfigurable Antenna Based on the Metamaterial for Wearable Applications," in Journal of Physics: Conference Series, vol. 1973, p. 012042, 2021.
  48. R. M. H. et al., "Computer Vision and Image Processing the Challenges and Opportunities for New Technologies Approach: A paper review," Journal of Physics: Conference Series, vol. 1973, p. 012002, 2021, [Online]. Available: https://doi.org/10.1088/1742-6596/1973/1/012002.
  49. Q. H. Mohammed and A. Namburu, "HYBRID MODEL AND FRAMEWORK FOR PREDICTING AIR POLLUTANTS IN SMART CITIES," Journal of Engineering and Sustainable Development, vol. 28, no. 3, pp. 392-406, 2024, [Online]. Available: https://doi.org/10.31272/jeasd.28.3.9.
  50. G. A. Aramice, A. H. Miry, and T. M. Salman, "OPTIMAL LONG-RANGE-WIDE-AREA-NETWORK PARAMETERS CONFIGURATION FOR INTERNET OF VEHICLES APPLICATIONS IN SUBURBAN ENVIRONMENTS," Journal of Engineering and Sustainable Development, vol. 27, no. 6, pp. 754-770, 2023, [Online]. Available: https://doi.org/10.31272/jeasd.27.6.7.
  51. W. A. C. Castañeda and P. Bertemes Filho, "Improvement of an Edge-IoT Architecture Driven by Artificial Intelligence for Smart-Health Chronic Disease Management," Sensors, vol. 24, no. 24, p. 7965, 2024, [Online]. Available: https://doi.org/10.3390/s24247965.
  52. K. Mani, K. K. Singh, and R. Litoriya, "IoT-Driven Revolution: Transforming Elderly Healthcare Through Dynamic Heart Health Monitoring and Analysis," in 2024 International Conference on Advances in Computing Research on Science Engineering and Technology (ACROSET), Indore, India, 2024, pp. 1-8, doi: 10.1109/ACROSET62108.2024.10743704.
  53. M. R. Ananda et al., "Design of Application Framework for Vital Monitoring Mobile-Based System," Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 10, no. 2, pp. 252-264, 2024, [Online]. Available: https://doi.org/10.26555/jiteki.v10i2.28416.
  54. A. N. Muhi et al., "Innovative Designs for Enhanced Connectivity for 3G and 4G Cellular Networks," in 2024 International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications (ICRAMET), Bandung, Indonesia, 2024, pp. 56-61, doi: 10.1109/ICRAMET62801.2024.10809318.


    HOME

       - Conference
       - Journal
       - Paper Submission to Journal
       - Paper Submission to Conference
       - For Authors
       - For Reviewers
       - Important Dates
       - Conference Committee
       - Editorial Board
       - Reviewers
       - Last Proceedings


    PROCEEDINGS

       - Volume 13, Issue 3 (ICAIIT 2025)
       - Volume 13, Issue 2 (ICAIIT 2025)
       - Volume 13, Issue 1 (ICAIIT 2025)
       - Volume 12, Issue 2 (ICAIIT 2024)
       - Volume 12, Issue 1 (ICAIIT 2024)
       - Volume 11, Issue 2 (ICAIIT 2023)
       - Volume 11, Issue 1 (ICAIIT 2023)
       - Volume 10, Issue 1 (ICAIIT 2022)
       - Volume 9, Issue 1 (ICAIIT 2021)
       - Volume 8, Issue 1 (ICAIIT 2020)
       - Volume 7, Issue 1 (ICAIIT 2019)
       - Volume 7, Issue 2 (ICAIIT 2019)
       - Volume 6, Issue 1 (ICAIIT 2018)
       - Volume 5, Issue 1 (ICAIIT 2017)
       - Volume 4, Issue 1 (ICAIIT 2016)
       - Volume 3, Issue 1 (ICAIIT 2015)
       - Volume 2, Issue 1 (ICAIIT 2014)
       - Volume 1, Issue 1 (ICAIIT 2013)


    PAST CONFERENCES

       ICAIIT 2025
         - Photos
         - Reports

       ICAIIT 2024
         - Photos
         - Reports

       ICAIIT 2023
         - Photos
         - Reports

       ICAIIT 2021
         - Photos
         - Reports

       ICAIIT 2020
         - Photos
         - Reports

       ICAIIT 2019
         - Photos
         - Reports

       ICAIIT 2018
         - Photos
         - Reports

    ETHICS IN PUBLICATIONS

    ACCOMODATION

    CONTACT US

 

        

         Proceedings of the International Conference on Applied Innovations in IT by Anhalt University of Applied Sciences is licensed under CC BY-SA 4.0


                                                   This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License


           ISSN 2199-8876
           Publisher: Edition Hochschule Anhalt
           Location: Anhalt University of Applied Sciences
           Email: leiterin.hsb@hs-anhalt.de
           Phone: +49 (0) 3496 67 5611
           Address: Building 01 - Red Building, Top floor, Room 425, Bernburger Str. 55, D-06366 Köthen, Germany

        site traffic counter

Creative Commons License
Except where otherwise noted, all works and proceedings on this site is licensed under Creative Commons Attribution-ShareAlike 4.0 International License.