SCSI RDMA Protocol

From Infogalactic: the planetary knowledge core
Jump to: navigation, search

In computing the SCSI RDMA Protocol (SRP) is a protocol that allows one computer to access SCSI devices attached to another computer via remote direct memory access (RDMA).[1][2] The SRP protocol is also known as the SCSI Remote Protocol. The use of RDMA makes higher throughput and lower latency possible than what is possible through e.g. the TCP/IP communication protocol. RDMA is only possible with network adapters that support RDMA in hardware. Examples of such network adapters are InfiniBand HCAs and 10 GbE network adapters with iWARP support. While the SRP protocol has been designed to use RDMA networks efficiently, it is also possible to implement the SRP protocol over networks that do not support RDMA.

SRP was published as an ANSI standard (ANSI INCITS 365-2002) in 2002 and renewed in 2007.[3]

As with the ISCSI Extensions for RDMA (iSER) communication protocol, there is the notion of a target (a system that stores the data) and an initiator (a client accessing the target) with the target performing the actual data movement. In other words, when a user writes to a target, the target actually executes a read from the initiator and when a user issues a read, the target executes a write to the initiator.

While the SRP protocol is easier to implement than the iSER protocol, iSER offers more management functionality, e.g. the target discovery infrastructure enabled by the iSCSI protocol.

In order to use the SRP protocol, an SRP initiator implementation, an SRP target implementation and networking hardware supported by the initiator and target are needed. The following software SRP initiator implementations exist:

  • Linux SRP initiator, available since November 2005 (kernel version 2.6.15).
  • Windows SRP initiator, available through the winOFED InfiniBand stack.[4]
  • VMWare SRP initiator, available since January 2008 through Mellanox' OFED Drivers for VMware Infrastructure 3 and vSphere 4.[5]
  • Solaris 10 SRP initiator, available through Sun's download page.[6]
  • Solaris 11 and OpenSolaris SRP initiator, integrated as a component of project COMSTAR.[7]
  • The IBM POWER virtual SCSI client driver for Linux (ibmvscsi), available since January 2008 (kernel version 2.6.24[8]). Virtual SCSI allows client logical partitions to access I/O devices (disk, CD, and tape) that are owned by another logical partition.[9][10]

The following SRP target implementations exist:

  • The SCST SRP target implementation.[11] This is a mature SRP target implementation available since 2008 via both SCST and OFED.[12]
  • Linux LIO SRP target,[13] available since January 2012 (kernel version 3.3[14]), based on the SCST SRP target.
  • The IBM POWER virtual SCSI target driver (ibmvstgt), available since January 2008 (kernel version 2.6.24[8]).[9][10]
  • DataDirect Network's (DDN) disk subsystems such as the S2A9900 and SFA10000, which use the SRP target implementation in the disk subsystem's controllers to present LUNs to servers (the servers act as SRP initiators).[15][16]
  • IBM's FlashSystem.[17]
  • The Solaris COMSTAR target, available since early 2009 in OpenSolaris and Solaris 11.[18]

Bandwidth and latency of storage targets supporting the SRP or the iSER protocol should be similar. On Linux, there are two SRP and two iSER storage target implementations available that run inside the kernel (SCST[11] and LIO) and an iSER storage target implementation that runs in user space (STGT). Measurements have shown that the SCST SRP target has a lower latency and a higher bandwidth than the STGT iSER target. This is probably because the RDMA communication overhead is lower for a component implemented in the Linux kernel than for a user space Linux process, and not because of protocol differences.[19]

See also

References

  1. ↑ ANSI T10 SRPr16a, www.t10.org.
  2. ↑ ANSI T10 SRPr16a, web.archive.org
  3. ↑ ANSI webstore for purchasing standards - ANSI INCITS 365-2002
  4. ↑ OpenFabrics Enterprise Distribution for Windows.
  5. ↑ Mellanox OFED Drivers for VMware Infrastructure 3 and vSphere 4.
  6. ↑ Sun's download page.
  7. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  8. ↑ 8.0 8.1 Linux kernel version 2.6.24 change log.
  9. ↑ 9.0 9.1 D. Boutcher and D. Engebretsen, Linux Virtualization on IBM POWER5 Systems, Proceedings of the Linux Symposium, Vol. 1, July 2004, pp. 113-120.
  10. ↑ 10.0 10.1 IBM Systems Hardware Information Center, Virtual SCSI.
  11. ↑ 11.0 11.1 The SCST Project, an open source SCSI target implementation for Linux that includes an SRP target implementation.
  12. ↑ OFED 1.5.4.1 Release Notes, OpenFabrics website, January 2012.
  13. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  14. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  15. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  16. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  17. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  18. ↑ Lua error in package.lua at line 80: module 'strict' not found.
  19. ↑ Performance of SCST versus STGT.
Retrieved from "https://infogalactic.com/w/index.php?title=SCSI_RDMA_Protocol&oldid=4150946"