当前位置>主页 > 期刊在线 > 信息技术 >

信息技术21年18期

SanssouciDB 应用列式存储和内存数据管理研究
范晶
(中国人民大学,北京 100872)

摘  要:内存数据管理和列式存储与内存数据库的结合是解决海量数据实时查询的可行方案之一,其代表之一是 SAP 的HANA 内存数据库。SanssouciDB 作为 HANA 的原型内存数据库是一个很好的研究对象。文章将从内存数据管理、内存中数据存储布局(包括行式和列式存储布局)、日志机制等方面研究 SanssouciDB 如何实现存储优化,查询优化。文章还将通过计算来对比列式和行式扫描的性能。最后分享实际工作中使用内存数据库所遇到的问题。


关键词:内存数据库;内存数据管理;列式存储



DOI:10.19850/j.cnki.2096-4706.2021.18.004


中图分类号:TP311                                      文献标识码:A                                  文章编号:2096-4706(2021)18-0013-05


Research on Application of Column Storage and Memory Data Management in SanssouciDB

FAN Jing

(Renmin University of China, Beijing 100872, China)

Abstract: The combination of memory data management, column storage and memory database is one of the feasible solutions to solve the real-time query of massive data. One of its representatives is SAP’s HANA memory database. As the prototype memory database of HANA, SanssouciDB is a good research object. This paper will study how SanssouciDB realizes storage optimization and query optimization from the aspects of in memory data management, in memory data storage layout (including row and column storage layout), logging mechanism and so on. It will also compare the performance of column and row scanning through calculation. Finally, the problems encountered in using memory database in practical work are shared.

Keywords: memory database; memory data management; column storage


参考文献:

[1] PLATTNER H. A Course in In-MemoryData Management The Inner Mechanics of In-Memory Databases [M].Berlin:Springer,2013.

[2] 哈索 . 内存数据管理教程 [M]. 程志国,曹乃刚,译 . 北京:清华大学出版社,2014.

[3] 庄辰弘 . 基于 SAP HANA 的内存数据库应用研究 [D]. 上海:上海交通大学,2013.

[4] BREMER R,BREDDEMANN L. SAP HANA Administration [M].Germany:Rheinwerk,2015.

[5] ZHOU J,SHEN Y,LI S,et al. NVHT:an efficient keyvalue storage library for non-volatile memory [C]//BDCAT '16: Proceedings of the 3rd IEEE/ACM International Conference on Big Data Computing,Applications and Technologies.New York:ACM, 2016:227-236.

[6] XIA F,JIANG D J,XIONG J,et al. HiKV:a hybrid index key-value store for DRAM-NVM memory systems [C]//USENIX ATC '17:Proceedings of the 2017 USENIX Conference on Usenix Annual Technical Conference.Berkeley:USENIX Association,2017:349-362.


作者简介:范晶(1982.04—),男,汉族,江苏常州人,工程师, 在职硕士,研究方向:内存数据库、列式存储。