Function Dependence Algorithm Based on Water Census Data

doi:10.3969/j.issn.1006-2475.2014.08.021

Abstract

Abstract:

Conditional Functional Dependencies (CFDs) can be made extensive use of data inconsistency and data

cleaning. In order to check the consistency of water conservancy survey data, this paper, according to the

characteristics of the data, divided the data into two parts, including measurement and dimensions, and clustered

the measurement data, imported the concept of Conditional Functional Dependencies(CFDs),redefined the Conditional

Functional Dependencies, improved CTANE algorithm which finds the functional dependencies; taking reservoir

engineering data for example, this paper verified that the improved algorithm could accurately find the

Conditional Functional Dependencies of water conservancy survey data, which is good for the detection of data

consistency.

Key words: water census data, conditional functional dependencies, measure, dimensions, CTANE algorithm

CLC Number:

TP311.131

QIAN Zhen-xing, WAN Ding-sheng, LI Shi-jin, CHENG Xi-feng. Function Dependence Algorithm Based on Water Census Data[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2014.08.021.

References ［15］

［1］	Bohannon P, Fan W, Geerts F, et al. Conditional functional dependencies for data cleaning［C］// IEEE 23rd
	International Conference on Data Engineering. 2007:746-755.
［2］	Fan Wenfei, Geerts F, Li Jianzhong, et al. Discovering conditional functional dependencies［J］. IEEE
	Transactions on Knowledge and Data Engineering, 2011,23(5):683-698.
［3］	韩京宇,徐立臻,董逸生. 数据质量研究综述［J］. 计算机科学, 2008,35(2):1-5.
［4］	余宇峰,张建新,朱跃龙,等. 水文数据库数据质量控制与管理应用研究［J］. 水文, 2013,33(3):65-68.
［5］	Fan Wenfei, Geerts F, Jia Xibei, et al. Conditional functional dependencies for capturing data
	inconsistencies［J］. ACM Transactions on Database Systems(TODS), 2008,33(2):No. 6.
［6］	周健昌,刘波. 一种条件函数依赖挖掘算法的分析与实现［J］. 计算机与数字工程, 2012,40(9):8-11.
［7］	庞进武,程益联,罗志东. 水利普查与信息化［J］. 水利信息化, 2012(1):19-22.
［8］	Li Jiuyong, Liu Jixue, Toivonen H, et al. Effective pruning for the discovery of conditional functional
	dependencies［J］. The Computer Journal, 2013,56(3):378-392.
［9］	耿寅融,刘波. 基于条件函数依赖的数据库一致性检测研究［J］. 计算机工程与应用, 2012,48(3):122-125.
［10］	胡艳丽,张维明. 条件依赖理论及其应用展望［J］. 计算机科学, 2009,36(12):115-118.
［11］	朱玉全,周李威,陈耿. 数据库理论教学中关联规则与函数依赖之间联系的探讨［J］. 计算机应用研究, 2014,31(7):2085-
20	87.
［12］	Diallo T, Novelli N, Petit J M. Discovering (frequent) constant conditional functional dependencies［J］.
	International Journal of Data Mining, Modelling and Management, 2012,4(3):205-223.
［13］	Yeh P Z, Puri C A. Discovering conditional functional dependencies to detect data inconsistencies［C］//
	Proc. of the 36th International Conference on Very Large Data Bases. 2010:256-270.
［14］	曹步文,刘先锋,汤小康. 数据挖掘技术——聚类算法研究［J］. 计算机与现代化, 2006(11):1-4.
［15］	李庆阳,彭宏. 面向数据质量的ETL框架的设计与实现［J］. 计算机工程与设计, 2010,31(9):2057-2060.

[1]	WANG Shao-hua, OUYANG Hui-dan, SUN Dan, WANG Kang, WU Hong-ping, ZHONG Xun, CHU Xing-ping, YANG Song-tao. Association Rule Mining of Undergraduate Physical Test Items Based on Apriori Algorithm [J]. Computer and Modernization, 2023, 0(03): 66-70.
[2]	WANG Ji-wei, QU Huai-jing, WEI Ya-nan, XIE Ming, XU Jia, ZHANG Zhi-sheng, ZHANG Han-yuan. Multi-focus Image Fusion Based on Quadtree Decomposition and Adaptive Focus Measure [J]. Computer and Modernization, 2022, 0(08): 106-113.
[3]	XU Lin, HE Yue-shun, SONG Wei-ning, XU Ting-ting. Real-time Self-correction of Digital Twin Model Based on Consistency Measurement [J]. Computer and Modernization, 2022, 0(07): 67-73.
[4]	WEI Li-jun, WU Hai-bo, ZHANG Ruo-bing. A Multi-attribute Decision Making Method Based on Information Measure [J]. Computer and Modernization, 2022, 0(06): 27-31.
[5]	XU Wen-jin, GUAN Ke-hang, MA Yue, HUANG Hai-guang. Track Data Hot Spot Mining Algorithm Based on K-means [J]. Computer and Modernization, 2021, 0(10): 23-28.
[6]	MA Ji-ke, YIN Fei, ZHU Yong-jin, DOU Long-long, LI Jian. A Semi-supervised Learning Method for Operating State Identification of #br# Energy Measurement Devices [J]. Computer and Modernization, 2020, 0(03): 82-.
[7]	LIANG Yong-zhen1, PAN Bin2, GUO Xiao-ming2, LIANG Yuan2. Image Shadow Detection and Removal Method Based on LAB Color Space [J]. Computer and Modernization, 2019, 0(10): 88-.
[8]	Maierziyan Abudula， FENG Xiang-ping. Non-contact Horse Body Measurement Method Based on Machine Vision [J]. Computer and Modernization, 2019, 0(10): 108-.
[9]	QIN Wen-xiang, GUO Ling, LIN Shu-hong. Box Dimension Measurement and Packing Optimization Based on RGBD [J]. Computer and Modernization, 2019, 0(05): 46-.
[10]	ZHANG Qin1,2, JIA Yuan1, WANG Yao-bin1. A Part Image Mosaic Method Based on Sparse Feature Points [J]. Computer and Modernization, 2019, 0(02): 19-.
[11]	WANG Xiang， FAN Zhi-qiang， XU Luo. Information Quality Evaluation of Command and Control Systems at Architecture Level [J]. Computer and Modernization, 2018, 0(10): 89-.
[12]	CHEN Xiao, SUN Ying-hao， ZHAO Pan, LIU Qian. Component Measurement Based on Fuzzy Inference [J]. Computer and Modernization, 2018, 0(05): 50-.
[13]	REN Fei, WANG Jiarun, LI Xiaojuan, YIN Hui. Construction and Optimization Implementation of 3D Radar Detection Range Based on OSG [J]. Computer and Modernization, 2018, 0(04): 111-.
[14]	FAN Xin-nan, WU Jing-jing, SHI Peng-fei, ZHANG Xue-wu. A Novel Underwater Dam Crack Extraction Algorithm Based on Lorentz Information Measure [J]. Computer and Modernization, 2018, 0(03): 73-.
[15]	ZHANG Yong-ju1, GU Xu-bo1, ZHANG Jian1, WANG Bing2, GUO Ling2. 3D Measurement Based on Combination of Structured Light and Binocular Vision [J]. Computer and Modernization, 2018, 0(02): 118-.