Computer and Modernization

Previous Articles     Next Articles

 
PBS-based Job Management for Exploration Data Processing

  

  1.  
    (Institute of Geophysics, Research Institute of Exploration and Development of Xinjiang Oilfield, PetroChina, Urumqi 830013, China)
  • Received:2013-10-21 Online:2014-02-14 Published:2014-02-14

Abstract: High performance cluster does not have the functions of job automatic scheduling and load balancing. We use open source job management system to develop cluster management system in order to solve the problem that the cluster is difficult to use or manage. As an open source queue management and job scheduling system, PBS has been widely used in cluster management. Through developinga number of Shell scripts, the different types ofjobs are transformedinto the corresponding PBSjob scripts. Based on the actual situation of work mode in the enterprise cluster and the premise of less changing scientific research personnel work habit, by using the PBS system to make the necessary custom development work, the Paradigm company EPOS system cluster queue management and job distribution management are implemented.

Key words: computer cluster, PBS (portable batch system), exploration and processing, queue management, job scheduling

CLC Number: