Computer and Modernization ›› 2020, Vol. 0 ›› Issue (12): 78-82.

Previous Articles     Next Articles

Application of Improved Spark System Based on ANN in Big Data Processing of Air Traffic Management#br#

  

  1. (Air Traffic Management College, Civil Aviation Flight University of China, Guanghan 618307, China)
  • Online:2021-01-07 Published:2021-01-07

Abstract: A new method based on artificial neural network (ANN) was proposed to automatically adjust the configuration parameters of the Spark system to improve the performance of the Spark system in processing ATM big data and solving time-consuming and inefficient issues. The Dell PowerEdge T430 server was used to test 5 commonly used datasets of different sizes in air traffic control big data to verify the method. Research shows that compared with the default parameter configuration, this method can improve the performance of the Spark system by about 35% on average. As the size of the dataset increases, the performance shows a trend of further improvement. This method can effectively guarantee the parameter adjustment efficiency of the Spark system and achieve the purpose of efficiently processing the ATM big data.

Key words: big data, Spark, ANN, data processing, ATM