计算机与现代化 ›› 2020, Vol. 0 ›› Issue (11): 56-59.

• 数据库与数据挖掘 • 上一篇    下一篇

基于分布式技术的气象系统数据服务平台构建

  

  1. (天津市气象信息中心,天津300074)
  • 出版日期:2020-12-03 发布日期:2020-12-03
  • 作者简介:雷鸣(1976—),男,山东莱州人,高级工程师,博士,研究方向:大数据应用,图像匹配,E-mail: lmeagle01@163.com。
  • 基金资助:
    国家自然科学基金资助项目(41575156); 天津市气象局科研项目(201914ybxm12)

Construction of Meteorological System Data Service Platform Based on Distributed Technology

  1. (Tianjin Meteorological Information Center, Tianjin 300074, China)
  • Online:2020-12-03 Published:2020-12-03

摘要: 现有气象系统建设和设计缺乏统一规划,导致各系统林立,数据管理散、乱、差,整体安全防护能力较弱,集约化差。本文利用分布式技术,构建基于“分布式关系型数据库+事务性数据库+列式数据库+表格系统+分布式文件系统”的混合型模式大数据服务中心,进行数据的存储、管理和服务,并通过MUSIC接口与省级CIMISS系统无缝衔接在一起,有效实现了数据的共享、流程的高度集约,并极大提升了数据的影响能力。相同条件下,10年自动站数据查询的性能提升了22倍多,而随着时间维度的增加,这种提升的优势会更大。

关键词: 数据共享, 分布式数据库; MUSIC; CIMISS; 文件存储

Abstract: The lack of unified planning for the construction and design of the existing meteorological system has resulted in a large number of systems, scattered, disordered and poor data management, weak overall safety protection capability and poor intensification. Using distributed technology, this paper constructs a hybrid model big data service center based on “distributed relational database+transactional database+columnar database+table system+distributed file system”, which stores, manages and serves data, and seamlessly connects with provincial CIMISS system through MUSIC interface, which effectively realizes data sharing and highly integrated process about, and greatly improve the ability of data impact. Under the same conditions, the performance of automatic station data query in 10 years has increased by more than 22 times, and with the increase of time dimension, the advantage of this improvement will be greater.

Key words: data sharing, distributed database, MUSIC, CIMISS, file storage