Design and Implementation of HBase Query Based on SQL

doi:10.3969/j.issn.1006-2475.2017.07.004

Abstract

Abstract: In the age of the Internet and big data, SQL relational database can not adapt to the growing amount of data, NoSQL database such as HBase becomes very important. But HBase database operation is more complex, this paper designs and implements a query method of HBase based on SQL, which can enable HBase users to operate the HBase database through the familiar SQL query statement. This paper first builds the compiler of SQL language, translates the SQL statement into the syntax tree, and then translates the syntax tree into the operation of HBase. The coprocessor is used to deal with the aggregate functions and complex expressions in the SQL query statement.

Key words: query, SQL, HBase

CLC Number:

TP311.138

YUAN Zhao-zheng1, SHAO Xiu-li1, YAN Kai-jing2, LI Dan2, GUO Jian-jun3. Design and Implementation of HBase Query Based on SQL[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2017.07.004.

References

［1］Murugesan S. Understanding Web 2.0［J］. It Professional, 2007,9(4):34-41.
［2］Thusoo A, Sarma J S, Jain N, et al. Hive—A petabyte scale data warehouse using Hadoop［C］// Proceedings of International Conference on Data Engineering. 2010:996-1005.
［3］Li Chongxin. Transforming relational database into HBase: A case study［C］// 2010 IEEE International Conference on Software Engineering and Service Sciences (ICSESS). 2010:683-687.
［4］Bastiao Silva L A, Beroud L, Costa C, et al. Medical imaging archiving: A comparison between several NoSQL solutions［C］// IEEE-EMBS International Conference on Biomedical and Health Informatics. 2014:65-68.
［5］Vora M N. Hadoop-HBase for large-scale data［C］// International Conference on Computer Science and Network Technology. 2011:601-605.
［6］唐韬. 基于HBase的SQL转化引擎研究［D］. 成都：电子科技大学, 2014.
［7］杨寒冰,赵龙,贾金原. HBase数据库迁移工具的设计与实现［J］. 计算机科学与探索, 2013,7(3):236-246.
［8］王海燕,杨鹤标. 基于ANTLR的SQL语法分析策略与实现［J］. 计算机应用与软件, 2013(11):68-70.
［9］Cao Danyang, Bai Donghui. Design and implementation for SQL parser based on ANTLR［C］// The 2nd International Conference on Computer Engineering and Technology(ICCET). 2010:V4-276-V4-279.
［10］Wang Haiyan, Yang Hebiao. ANTLR-based SQL grammatical analysis strategy and its implementation［J］. Computer Applications & Software, 2013,30(11):68-70,101.
［11］George L. HBase: The Definitive Guide［M］. OREILLY Media Inc., 2011.
［12］李旭帅,毛宇光. SQL语言的形式语义［J］. 计算机技术与发展, 2005,15(3):14-16.
［13］阳国贵,昌月楼. 发展中的SQL语言［J］. 计算机工程与应用, 1995(4):1-3.
［14］张美华,李海. 详析SQL语言的WHERE子句与HAVING子句［J］. 怀化学院学报(自然科学版), 2008,27(8):101-102.［15］聂晓旭,于凤芹,钦道理. 基于Protobuf的数据传输协议［J］. 计算机系统应用, 2015,24(8):112-116.
［16］Ayham H M, Nikolaev A B. Data transmission over the network using Protobuf protocol［J］. Automation and Control in Technical Systems, 2015(2):3-12.
［17］聂晓旭,于凤芹,钦道理. 基于Protobuf的数据传输协议［J］. 计算机系统应用， 2015，24（8）：112-116.

[1]	GUAN Hui, SHENG Jing-yuan, CAO Tong-zhou. A SQL Injection Attack Detection Algorithm Based on Improved TF-IDF [J]. Computer and Modernization, 2022, 0(06): 122-126.
[2]	XU Hui, TIE Zhi-xin, SHU Ying. Fast Dimensionality Reduction Sorting Search Method Based on Feature Matching [J]. Computer and Modernization, 2022, 0(02): 85-91.
[3]	LEI Ming, JIANG Han-sheng, WU Guo-liang, ZHAO Yu-juan, LIANG Jian. Load Balancing Technology Under Big Data Architecture Based on HBase [J]. Computer and Modernization, 2021, 0(06): 91-95.
[4]	WEI Dong-ping, LUO Dan. An XML Keyword Query Algorithm Based on Interval Reserved Coding [J]. Computer and Modernization, 2019, 0(10): 17-.
[5]	LIANG Jun-xiu, XU Jian-qiu. Range Pattern Match Query Based on Spatial-temporal Label Trajectories [J]. Computer and Modernization, 2018, 0(08): 79-.
[6]	WANG Liang-yu. Knowledge Graph Construction Method for Carbon Trading [J]. Computer and Modernization, 2018, 0(08): 114-.
[7]	SHAOLu-yi,WANGQin-xue,GUOShuai. AlgorithmforMulti-usersSkylineQueryBasedonPriorityofAttribute [J]. Computer and Modernization, 2018, 0(07): 11-.
[8]	HU Wang-sheng. Learning Semantically Related Words in Software Through Word Embedding [J]. Computer and Modernization, 2017, 0(9): 19-23,49.
[9]	WANG Jian-rong, JI Gang. Design of Storage and Retrieval System for Mass Automatic Weather Station Minute Data [J]. Computer and Modernization, 2017, 0(9): 40-44.
[10]	YIN Ji-dong1， LIU Hong1， PENG Song1， ZHANG Hui2. Design and Implementation of Information Query System [J]. Computer and Modernization, 2017, 0(5): 123-126.
[11]	ZHANG Yu-jie, YU Shuang-yuan. Overview on Big Data Query [J]. Computer and Modernization, 2017, 0(4): 82-88.
[12]	ZHANG Jin, FENG Jun, LU Jia-min. Spatial Keyword Index Method Based on Hadoop [J]. Computer and Modernization, 2017, 0(11): 76-83.
[13]	WANG Qian-qian, LUO Wen-bing. Markov Network Query Expansion Model Based on Term Importance [J]. Computer and Modernization, 2017, 0(11): 89-94.
[14]	LI Jin-yang, CHEN Jia-liang. Probabilistic Skyline Queries over Uncertain Moving Objects Based on Manhattan Distance [J]. Computer and Modernization, 2017, 0(10): 42-48.
[15]	DAI Sheng, WANG Bo. Relational Query in Large-scale Configuration Management Database Based on Graph Database [J]. Computer and Modernization, 2017, 0(1): 51-56.