Meteorological Data Storage and Retrieval System Based on MongoDB

doi:10.3969/j.issn.1006-2475.2020.08.016

Abstract

Abstract: In recent years, meteorological data shows a trend of multi-source and explosive growth, the traditional relational database can not meet the needs of meteorological data development. In combination with the geospatial characteristics of meteorological data, a MongoDB-based meteorological data storage and retrieval system is proposed. The system establishes spatial index of meteorological data, which speeds up the query efficiency of meteorological data and provides a strong support for fine and lattice forecast. The experimental results show that MongoDB has strong storage and retrieval capability for massive meteorological data, and its performance in all aspects is obviously better than that of relational database.

Key words: meteorological data, MongoDB, storage, retrieval

CLC Number:

TP311.132.4

CHEN Hao, ZHANG Ya, LUO Xi-chang, ZHANG Ya-li, LIU Wen-jing. Meteorological Data Storage and Retrieval System Based on MongoDB[J]. Computer and Modernization, 2020, 0(08): 100-104.

References ［23］

［1］	马廷淮,穆强,田伟,等. 气象数据挖掘研究［J］. 武汉理工大学学报, 2010,32(16):110-114．
［2］	张霭琛. 现代气象观测［M］. 北京:北京大学出版社, 2000.
［3］	KOGAN F, KUSSUL N, ADAMENKO T. Winter wheat yield forecasting in Ukraine based on earth observation, meteorological data and biophysical models［J］. International Journal of Applied Earth Observation and Geoinformation, 2013,23:192-203.
［4］	彭昱忠,王谦,元昌安,等. 数据挖掘技术在气象预报研究中的应用［J］. 干旱气象, 2015,33(1):19-27.
［5］	王若曈,黄向东,张博,等. 海量气象数据实时解析与存储系统的设计与实现［J］. 计算机工程与科学, 2015,37(11):245-2054.
［6］	MASELLI F, PASQUI M, CHIRICI G, et al. Modeling primary production using a 1 km daily meteorological data set［J］. Climate Research, 2012,54(3):271-285.
［7］	师春香,潘旸,谷军霞,等. 多源气象数据融合格点实况产品研制进展［J］. 气象学报, 2019,77(4):774-783.
［8］	王海军,杨志彪,杨代才,等. 自动气象站实时资料自动质量控制方法及其应用［J］. 气象, 2007,33(10):102-109.
［9］	BARTOK J, HABALA O, BEDNAR P, et al. Data mining and integration for predicting significant meteorological phenomena［J］. Procedia Computer Science, 2010,1(1):37-46.
［10］	孟执中,李卿. 中国气象卫星的进展［J］. 中国航天, 2001(5):7-17.
［11］	李恒年. 地球静止卫星轨道与共位控制技术［M］. 北京:国防工业出版社, 2010.
［12］	张晓虎,陆风,窦芳丽,等. 国外地球同步轨道气象卫星成像观测模式发展分析［J］. 气象科技进展, 2016,6(1):126-130.
［13］	王旻燕. CIMISS中气象卫星数据存储和服务模型［J］. 安徽农业科学, 2012,40(8):4785-4789.
［14］	王立,冯海霞,胡宪林,等. 自动气象站与人工观测数据差异的原因分析［J］. 成都信息工程学院学报, 2006,21(4):567-570.
［15］	陈海泉,陈立宏,曾祥标,等. 雷达和自动气象站资料在GIS中的同步显示［J］. 广东气象, 2011,33(1):64-66.
［16］	CHODOROW K, DIROLF M. MongoDB: The Definitive Guide［M］. USA:OReilly, 2010.
［17］	郭殿升,吴小竹,巫建伟,等. 基于MongoDB的矢量空间数据云存储与处理系统［J］. 地球信息科学学报, 2014,16(4):507-516.
［18］	GU Y H, WANG X, SHEN S, et al. Analysis of data storage mechanism in NoSQL database MongoDB［C］// IEEE International Conference on Consumer Electronics-Taiwan. 2015.
［19］	KANADE A, GOPAL A, KANADE S. A study of normalization and embedding in MongoDB［C］// 2014 IEEE International Advance Computing Conference. 2014:416-421.
［20］	VATHY-FOGARASSY A, HUGYAK T. Uniform data access platform for SQL and NoSQL database systems［J］. Information Systems, 2017,69:93-105.
［21］	金安,程承旗,宋树华,等. 基于Geohash 的面数据区域查询［J］. 地理与地理信息科学， 2013,29(5):31-35.
［22］	MOUSSALLI R, SRIVATSA M, ASAAD S W, et al. Fast and flexible conversion of Geohash codes to and from Latitude/Longitude Coordinates［C］// IEEE International Symposium on Field-Programmable Custom Computing Machines. 2015:179-186.
［23］	DIMIDUK N, KHURANA A． HBase in Action［M］． New York: Manning Publications, 2012:203-235．

[1]	WANG Hong, GE Hong. Cross Modal Hash Retrieval Based on Attention Mechanism and Semantic Similarity [J]. Computer and Modernization, 2023, 0(08): 44-53.
[2]	ZHANG Jun, SU Wen-hao. Optimization Method of Hadoop File Archiving Based on LZO [J]. Computer and Modernization, 2023, 0(06): 1-6.
[3]	WANG Xin-yi, YIN Si-qing, HONG Jun. Asymmetric Deep Supervised Hashing with Attention Mechanism [J]. Computer and Modernization, 2023, 0(05): 26-31.
[4]	QIU Jin-shui, ZHUANG Hui-fu, JIN Tao. Design of Intelligent Retrieval System for Massive Plant Images [J]. Computer and Modernization, 2022, 0(10): 62-67.
[5]	ZENG Yi-bin, GE Hong. Cross-modal Retrieval Based on Context Fusion and Multi-similarity Learning [J]. Computer and Modernization, 2022, 0(08): 50-56.
[6]	SHAN Ke, ZHANG Yi-ming, LIU Rui-xia, . Research and Design of Science and Technology Service Resource Pool Oriented to Central Plains Urban Agglomeration [J]. Computer and Modernization, 2022, 0(07): 91-96.
[7]	WANG Zhen-yu, ZHENG Yang-fei. An Intelligent Information Retrieval System Based on Ranking Learning Algorithm [J]. Computer and Modernization, 2021, 0(10): 35-40.
[8]	LIU Zheng, WU Ke-hua, YE Chun-xiao. Security-enhanced Data Access Control for Multi-authority Cloud Storage [J]. Computer and Modernization, 2021, 0(10): 119-126.
[9]	LEI Ming, JIANG Han-sheng, WU Guo-liang, ZHAO Yu-juan, LIANG Jian. Load Balancing Technology Under Big Data Architecture Based on HBase [J]. Computer and Modernization, 2021, 0(06): 91-95.
[10]	LEI Ming, ZHAO Yu-juan, JIANG Han-sheng, WU Guo-liang, LIANG Jian. Construction of Meteorological System Data Service Platform Based on Distributed Technology [J]. Computer and Modernization, 2020, 0(11): 56-59.
[11]	WANG Zhen-ting, CHEN Yong-fu, LIU Tian. Multi-robot Scheduling Method in Intelligent Warehouse [J]. Computer and Modernization, 2020, 0(07): 65-70.
[12]	CAO Yong-ming. A Fuzzy Keyword Search Encryption Scheme Without Secure Channel [J]. Computer and Modernization, 2020, 0(04): 42-.
[13]	ZHANG Xi, WANG Jian. A Public Integrity Auditing Scheme Based on Blind Signature for Shared Data in Cloud [J]. Computer and Modernization, 2020, 0(04): 60-.
[14]	ZHENG Mo-li1, ZHAO Yan-ke1, YAN Min2, SUN Jun2, LIU Yong-rong1. Intelligent Evaluation Method for Loss in Postpartum Storage#br# of Grain Based on RDPSO-SVM Model [J]. Computer and Modernization, 2020, 0(03): 72-.
[15]	SU Lin-ping, AN Ran, LI Wei, CUI Wen-chao, ZHANG Xiao-liang. Design of Power Operation and Maintenance Audit System Based on Hadoop [J]. Computer and Modernization, 2020, 0(01): 49-.