Data-storage Processing Unit – Placing Intelligence in Storage
Shenzhen DAPU Microelectronics Co., Ltd
Dr. Yafei Yang is an expert in chipset development and information security, with many years of research and management experience in semiconductor industry. From May 2008 to March 2016, he worked at Qualcomm Inc., responsible for Qualcomm product security strategy, including smartphone chipsets, automotive chipsets, networking chipsets, IoT chipsets and server chipsets. In April 2016, Dr. Yang Co-founded Shenzhen DAPU Microelectronics Co. Ltd and received initial funding from Shenzhen Peacock Plan, a very prestigious fund for high tech startups. Dr. Yang graduated from Univ. of Rhode Island and holds 7 US patents. He was invited to perform expert reviews on the technical proposals submitted under BTOP (White House Broadband Technology Opportunities Program) in 2010. To honor Dr. Yang's outstanding contribution to US economic recovery, US Secretary of Commerce (Gary Locke) and Assistant Secretary (Lawrence Strickling) wrote appreciation letters to him.
为此，我们首次提出一个新概念——数据存储处理器（Data-storage Processing Unit，简称DPU）。DPU是一种专门针对大数据、云计算特性而定制设计，用于管理、控制和分析大数据并对数据进行分类。DPU把智能带入到SSD存储设备中，通过机器学习算法来不断学习和优化I/O性能，提高数据可靠性、安全性和可用性，从而针对各种不同的大数据应用达到最优的管理和控制性能。
Traditionally, storage devices such as HDD and SSD are managed and controlled by standard MCUs and firmware running on them. As new storage technologies emerge such as flash memory, PCM, Memristor, and MRAM, management and control of storage devices have become more and more complex. On the other hand, data that are stored in storage devices grow exponentially encompassing all kinds of data including structured and unstructured data, which further complicates data storage management. In addition, variety of big data applications demands high I/O performance and high data reliability/availability, placing stringent requirements on storage devices. Therefore, it has come to a historical point where we should reconsider storage controller’s architecture to keep pace with the explosive growth of big data and fast emergence of new storage media technologies.
We introduce and have built a storage controller ASIC with built-in intelligence, referred to as DPU for Data-storage Processing Unit. DPU manages, controls, analyzes, and classifies big data at the place where they are stored. The idea is to place sufficient intelligence closest to the storage devices that are experiencing revolutionary changes with the emergence of storage class memories. Machine learning logics are a major part of DPU that learns I/O behaviors inside the storage to optimize adaptively I/O performance, data reliability, security, and availability for a variety of applications.