Integrating Evolutionary Algorithms and Mathematical Modeling for Efficient Neural Network Optimization

Abstract

Arnav Gupta, Ananya Sharma, Chen Li Wei and Mehta Ravi

Optimizing neural network architectures presents significant challenges due to the vast search spaces and computational costs involved. This study explores the integration of evolutionary algorithms (EAs) and mathematical modeling techniques to enhance neural network optimization. We propose a novel framework combining EAs with dimensionality reduction, surrogate modeling, and hybrid optimization strategies to reduce computational complexity and improve performance. Our results demonstrate that the adapted EAs significantly increase accuracy and F1-scores while reducing the number of generations required for convergence. The hybrid approach, combining EAs with local search techniques, achieves superior performance and robustness across various datasets. These findings provide a foundational basis for future research in advanced optimization methods for neural networks.

PDF