HSE: Heterogeneous-memory storage engine designed for SSDs

栏目: IT技术 · 发布时间: 5年前

内容简介:HSEis an embeddable key-value store designed for SSDs based on NAND flash or persistent memory. HSE optimizes performance and endurance by orchestrating data placement across DRAM and multiple classes of SSDs or other solid-state storage.HSE is ideal for p

HSE: Heterogeneous-Memory Storage Engine

HSEis an embeddable key-value store designed for SSDs based on NAND flash or persistent memory. HSE optimizes performance and endurance by orchestrating data placement across DRAM and multiple classes of SSDs or other solid-state storage.

HSE is ideal for powering NoSQL, Software-Defined Storage (SDS), High-Performance Computing (HPC), Big Data, Internet of Things (IoT), and Artificial Intelligence (AI) solutions.

Key Features

  • Standard and advanced key-value operators
  • Full transactions with snapshot-isolation spanning multiple independent key-value collections
  • Cursors for iterating over snapshot views
  • Data model for optimizing mixed use-case workloads in a single data store
  • Flexible durability controls
  • Configurable data orchestration schemes
  • C API library that can be embedded in any application

Benefits

  • Scales to terabytes of data and hundreds of billions of keys per store
  • Efficiently handles thousands of concurrent operations
  • Dramatically improves throughput, latency, write-amplification, and read-amplification versus common alternatives for many workloads
  • Optionally combines multiple classes of solid-state storage to optimize performance and endurance

Getting Started

The HSE Wiki contains all the information you need to get started with HSE.

YCSB Performance Results

YCSB (Yahoo!® Cloud Serving Benchmark) is an industry-standard benchmark for databases and storage engines supporting key-value workloads. The following table summarizes several YCSB workload mixes, with application examples taken from the YCSB documentation.

YCSB Workload Operations Application Example
A 50% Read; 50% Update Session store recording user-session activity
B 95% Read; 5% Update Photo tagging
C 100% Read User profile cache
D 95% Read; 5% Insert User status updates

We integrated HSE with YCSB to make it easy to compare its performance and scalability to that of other storage engines for YCSB workloads. Below are throughput results from running YCSB with HSE.

For comparison, we include results from RocksDB , a popular and widely-deployed key-value store. For these YCSB workloads, HSE delivered up to nearly 6x more throughput than RocksDB.

HSE: Heterogeneous-memory storage engine designed for SSDs

System configuration details and additional performance results can be found in the YCSB section of the HSE Wiki.

We also integrated HSE with MongoDB® , a popular NoSQL database, to validate its benefits within a real-world storage application. Below are throughput results from running YCSB with MongoDB using HSE (MongoDB/HSE).

For comparison, we include results from MongoDB using the default WiredTiger storage engine (MongoDB/WiredTiger). For these YCSB workloads, MongoDB/HSE delivered up to nearly 8x more throughput than MongoDB/WiredTiger.

HSE: Heterogeneous-memory storage engine designed for SSDs

System configuration details and additional performance results can be found in the MongoDB section of the HSE Wiki.


以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持 码农网

查看所有标签

猜你喜欢:

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

技术赋权

技术赋权

郑永年 / 邱道隆 / 东方出版社 / 2014-4-1 / CNY 45.00

在本书中,作者对中国互联网的历史做了一次突破性的研究,细致又全面地观察了中国互联网对于国家和社会的影响,发现互联网给中国的社会—政治变革带来了新的动力。政府权力和社会力量在以互联网为媒介的公共领域中转换。 从大量的数据梳理和事实分析中,作者得出了四重的研究结论。首先,互联网给政府和社会都增加了权力。互联网在促进政治自由化中扮演了重要的角色,使政府更加开放、透明和负责任。第二,互联网产生了大量......一起来看看 《技术赋权》 这本书的介绍吧!

MD5 加密
MD5 加密

MD5 加密工具

HEX CMYK 转换工具
HEX CMYK 转换工具

HEX CMYK 互转工具

HEX HSV 转换工具
HEX HSV 转换工具

HEX HSV 互换工具