DOP：ASimpleOpenDataFrameworkandItsApplication

doi:10.3969/j.issn.1006-2475.2018.07.002

Abstract

Abstract: Open-dataisthetrendoftheeraofbigdata,thustocarryoutopen-dataplatformthroughgeneralengineeringapproachesisthemainproblem.Referringtotheideasofthemetadatamanagementandthebig-datastorage,thepaperproposestheDOP(Data-Open-Pool)frameworkandCDD(Catalog-Dataset-Distribution)datadescriptionmodel,whichrealizestheservicelogicfrompublishingadatasetaftercollectingdatatoopeningtothepublicfinally,aswellasthedescriptionandmanagementofdataresourcesinthethreelevels,andfinallyimplementsaneasyopen-dataapplicationwiththeDOPandCDDhierarchicaldescriptionmodel,givesthegeneralalgorithmtoreleasethestandarddatasetfromunordereddatasources,aswellasthediscussiononsomeproblemsoftheframework.

Key words: bigdata, open-data, metadata, datadescription, datastorage

CLC Number:

TP311.13

MOCheng-wei,FANBing-bing. DOP：ASimpleOpenDataFrameworkandItsApplication[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2018.07.002.

References

［1］程学旗,靳小龙,王元卓,等.大数据系统和分析技术综述［J］.软件学报,2014,25(9):1889-1908.
［2］GlobalOpenDataIndex.TrackingtheStateofOpenGovernmentData［EB/OL］.https://index.okfn.org/,2017-06-15.
［3］KohigashiK,TakahashiK,HarumotoK,etal.APeer-to-PeerinformationsharingmethodforRDFtriplesbasedonRDFschema［C］//Proceedingsofthe10thInternationalWork-ConferenceonArtificialNeuralNetworks:PartII:DistributedComputing,ArtificialIntelligence,Bioinformatics,SoftComputing,andAmbientAssistedLiving.2009:646-650.
［4］HylandB,Villazón-TerrazasB,AtemezigG.BestPracticesforPublishingLinkedData［EB/OL］.https://www.w3.org/TR/ld-bp/,2014-01-09.
［5］花开明,陈家训,杨洪山.基于本体与元数据的语义检索［J］.计算机工程,2007,33(24):220-221.
［6］MaaliF,EricksonJ.DataCatalogVocabulary(DCAT)［EB/OL］.https://www.w3.org/TR/vocab-dcat/,2014-01-16
［7］ProjectOpenData.ProjectOpenDataMetadataSchema［EB/OL］.https://project-open-data.cio.gov/v1.1/schema/,2015-02-01.
［8］中国裁判文书网.文书总量［EB/OL］.http://wenshu.court.gov.cn/,2017-05-16.
［9］刘海房,莫世鸿,范冰冰.开放数据最新进展及趋势［J］.情报杂志,2016,35(9):163-167.
［10］周大铭.我国政府数据开放现状和保障机制［J］.大数据,2015,1(2):19-30.
［11］陈明艳.政府开放数据的语义描述与实体同一性研究［D］.广州:华南理工大学,2015.
［12］东方.国内外政府数据开放平台调查与分析［J］.现代情报,2017,37(10):93-98.
［13］赵文硕.关系型与非关系型数据库的应用研究［D］.北京:华北电力大学(北京),2016.
［14］郭远威.大数据存储:MongoDB实战指南［M］.北京:人民邮电出版社,2015.
［15］廖雪龙,谢雨来,荣震,等.对象存储下的溯源收集与存储研究［J/OL］.http://fcst.ceaj.org/CN/10.3778/j.issn.1673-9148.1611041,2017-05-15.
［16］GudivadaVN,RaoD,RaghavanVV.NoSQLsystemsforbigdatamanagement［C］//2014IEEEWorldCongressonServices.2014:190-197.
［17］RFC2413,DublinCoreMetadataforResourceDiscovery［S］.
［18］曹守欣,赵琉涛,金翊.基于对象存储的云存储系统研究［J］.计算机科学与应用,2014,4(12):333-343.
［19］陈曦,朱建涛,何晓斌.一种面向高性能计算的分布式对象存储系统［J］.计算机工程,2017,43(8):69-73.

[1]	ZHANG Zi-ye1, LIU Yu-long1, HU Bei2 . Multi-source Data Integration Method Based on Data Virtualization Technology [J]. Computer and Modernization, 2019, 0(11): 18-.
[2]	JIAO Li1, SUN Song-zhou2, LIU Tian-xu2, ZHANG Xue-yang2, WANG Zhen-ji1， WANG Ya-jun1 . Metadata Driven Distributed Data Resource Management Technology [J]. Computer and Modernization, 2019, 0(03): 78-.
[3]	LIU Chun-xia， LU Jian-bo， WU Ling-mei. A Movie Recommendation Model: Solving Cold Start Problem [J]. Computer and Modernization, 2018, 0(11): 83-.
[4]	LIJian，YANGXing，LIJun-cheng，HUANGHan-wen. DesignofEmploymentInformationManagementPlatform#br# BasedonBigDataTechnologyandFeatureRecommendation [J]. Computer and Modernization, 2018, 0(06): 103-.
[5]	JIANG Kang， FENG Jun， TANG Zhixian， WANG Chao. A Water Conservancy Metadata Searching and Sharing Platform Based on ElasticSearch [J]. Computer and Modernization, 2015, 0(2): 117-.
[6]	WANG Meng-xue. Spatial Data Access Based on Data Registration Center and World Wind [J]. Computer and Modernization, 2014, 0(2): 55-58+85.
[7]	ZHANG Guiping. General Form Dynamic Generation Technology Based on Metadata [J]. Computer and Modernization, 2013, 1(11): 196-198.
[8]	CAI Yan-Feng;FAN Bing-bing. Research and Design for Implementation of Multi-tenant Website [J]. Computer and Modernization, 2012, 1(6): 200-203.
[9]	HAN Pu-jie;KANG Mu-ning;ZHANG Xiao. Research on Method to Reclaim Storage in Thin-Provisioning Storage Systems [J]. Computer and Modernization, 2012, 208(12): 168-173,.
[10]	LAN Tian;WANG Wenshuang;CHENG Jihong. Research on Navy Weapons Security Metadata Building Method Based on Ontology [J]. Computer and Modernization, 2011, 194(10): 156-159.
[11]	YUAN Dong-liang;SUN Zhong-lin;TIAN Gang;ZHAO Fang-fang. Application Research on Information Resource Sharing Technology Based on JSON Format [J]. Computer and Modernization, 2010, 1(9): 175-178.
[12]	LI Zhenhua;;LIU Peng;WANG Zhen;XIA Lei;;GAO Chengdong;. Research on Geospatial Metadata Management for Web Service [J]. Computer and Modernization, 2009, 1(6): 106-109.