Risks and Future Outlooks
• Scaling of 3D Xpoint – Current 3D XPoint is PCM based, which may have scaling issue – Density may not persistently increase year by year – Affect the cost • Dependency on Intel execution • But, some other kinds of SCM may be introduced in the future under the same framework – STT-RAM Memorize the Future – Z-NAND (Samsung) – ReRAM (Toshiba/WD/Crossbar)
1 A New Physics: 3D XPoint
• Jointly developed by Intel and Micron
• Available as Intel Optane DC Persistent Memory in Q2 2019
– A NEW addition to Optane SSD product available since 2017
• Volatile Memory Mode
– Bigger capacity than DRAM (3TB/socket in 2019, 6TB/socket in 2020) • Block Storage Mode
– Lower latency than NVMe SSDs (100-250ns)
• App Direct Mode
– New Persistent Memory programming model
2 But…
• What distributed storage software stack shall I use? – Existing distributed storage software are not designed for media of this speed
• Can I expand my memory beyond the persistent memory of a single node
• Can I use it both for memory expansion and storage acceleration, without modifying my application logic?
3 Memory Converged Infrastructure Platform
Machine Big Data Analytics Search and Queries Learning ...
MemVerge Distributed Memory Objects
Memory APIs Storage APIs
Memory Objects Efficient Storage Objects for Main Memory Metadata with PMEM- Expansion Management optimized tiering Global Namespace of Persistent Memories
ZeroIO Datapath
Compute Node 1 Compute Node 1 Compute Node 1 Compute Node 1 … Compute Node 1 DRAM DRAM DRAM DRAM DRAM 3DXP 3DXP 3DXP 3DXP 3DXP SSD SSD SSD SSD SSD 4 Memory Converged Infrastructure 10x IO Speed 10x Memory Size 1-click App Deployment
RDBMS Data Lake Risks and Future Outlooks
• Scaling of 3D Xpoint – Current 3D XPoint is PCM based, which may have scaling issue – Density may not persistently increase year by year – Affect the cost • Dependency on Intel execution • But, some other kinds of SCM may be introduced in the future under the same framework – STT-RAM Memorize the Future – Z-NAND (Samsung) – ReRAM (Toshiba/WD/Crossbar)
6