Spatial Keyword Index Method Based on Hadoop

doi:10.3969/j.issn.1006-2475.2017.11.015

Abstract

Abstract: With the rise of the mobile Internet, huge amounts of data are generated from mobile terminal, these data contain not only traditional text information but also spatial location information. In order to effectively process and utilize these data, highly efficient methods of spatial keyword index have become a hot research topic in the field. But in the face of huge amounts of spatial data, the existing methods of spatial keyword index still have problems such as the lack of scalability and extensibility, easy to generate query hotspots. In order to deal with the above problems, two improvements measures are proposed in this paper: the method of spatial keyword index based on Hadoop and optimized parallelizable algorithm of index. Finally, we compare the spatial keyword index method proposed in this paper with the existing spatial keyword index methods and verify its effectiveness.

Key words: spatial keyword, index, distributed query, Hadoop

CLC Number:

TP301.6

ZHANG Jin, FENG Jun, LU Jia-min. Spatial Keyword Index Method Based on Hadoop[J]. Computer and Modernization, doi: 10.3969/j.issn.1006-2475.2017.11.015.

References

[1] 周傲英,杨彬,金澈清,等. 基于位置的服务:架构与进展[J]. 计算机学报, 2011,34(7):1155-1171.

[2] Li Guoliang, Hu Jin, Feng Jianhua, et al. Effective location identification from microblogs[C]// Proceedings of the 30th IEEE International Conference on Data Engineering (ICDE). 2014:880-891.

[3] Cao Xin, Chen Lisi, Cong Gao, et al. Spatial keyword querying[C]// Proceedings of the 31st International Conference on Conceptual Modeling. 2012:16-29.

[4] Chen Lisi, Cong Gao, Jensen C S, et al. Spatial keyword query processing: An experimental evaluation[J]. Proceedings of the VLDB Endowment, 2013,6(3):217-228.

[5] Luo Siqiang, Luo Yifeng, Zhou Shuigeng, et al. Distributed spatial keyword querying on road networks[C]// Proceedings of the 17th International Conference on Extending Database Technology. 2014:235-246.

[6] De Felipe I, Hristidis V, Rishe N. Keyword search on spatial databases[C]// Proceedings of the 24th IEEE International Conference on Data Engineering. 2008:656-665.

[7] Guttman A. R-trees: A dynamic index structure for spatial searching[C]// Proceedings of the 1984 ACM SIGMOD International Conference on Management of Data. 1984:47-57.

[8] Tao Yufei, Papadias D, Shen Qiongmao. Continuous nearest neighbor search[C]// Proceedings of the 28th International Conference on Very Large Databases. 2002:287-298.

[9] 邵奇峰,李枫. 一种基于HBase的空间关键字查询算法[J]. 计算机工程与科学, 2015,37(11):2084-2090.

[10] Zhou Yinghua, Xie Xing, Wang Chuang, et al. Hybrid index structures for location-based Web search[C]// Proceedings of the 14th ACM International Conference on Information and Knowledge Management. 2005:155-162.

[11] Wu Dingming, Yiu M L, Cong Gao, et al. Joint top-k spatial keyword query processing[J]. IEEE Transactions on Knowledge and Data Engineering, 2012,24(10):1889-1903.

[12] Vaid S, Jones C B, Joho H, et al. Spatio-textual indexing for geographical search on the Web[C]// Proceedings of the 9th International Conference on Advances in Spatial and Temporal Databases. 2005:218-235.

[13] Tao Yufei, Sheng Cheng. Fast nearest neighbor search with keywords[J]. IEEE Transactions on Knowledge and Data Engineering, 2014,26(4):878-888.

[14] Samet H. The quadtree and related hierarchical data structures[J]. ACM Computing Surveys, 1984,16(2):187-260.

[15] Wu Sai, Wu Kun-Lung. An indexing framework for efficient retrieval on the cloud[J]. IEEE Data Engineering Bulletin, 2009,32(1):75-82.

[16] Zhou Xin, Zhang Xiao, Wang Yanhao, et al. Efficient distributed multi-dimensional index for big data management[C]// Proceedings of the 14th International Conference on Web-Age Information Management. 2013:130-141.

[17] Zou Yongqiang, Liu Jia, Wang Shicai, et al. CCIndex: A complemental clustering index on distributed ordered tables for multi-dimensional range queries[C]// Proceedings of the 2010 IFIP International Conference on Network and Parallel Computing. 2010:247-261.

[18] Dittrich J, Quiané-Ruiz J A, Richter S, et al. Only aggressive elephants are fast elephants[J]. Proceedings of the VLDB Endowment, 2012,5(11):1591-1602.

[19] 马友忠,孟小峰.云数据管理索引技术研究[J]. 软件学报, 2015,26(1):145-166.

[20] Chang W W, Schek H J. A signature access method for the Starburst database system[C]// Proceedings of the 15th International Conference on Very Large Databases. 1989:145-153.

[21] Gremillion L L. Designing a Bloom filter for differential file access[J]. Communications of the ACM, 1982,25(9):600-604.

[22] Orenstein J A, Merrett T H. A class of data structures for associative searching[C]// Proceedings of the 3rd ACM SIGACT-SIGMOD Symposium on Principles of Database Systems. 1984:181-190.

[23] Kirsch A, Mitzenmacher M. Less hashing, same performance: Building a better Bloom filter[C]// Proceedings of the 14th Conference on Annual European Symposium. 2006,14:456-467.