Index of /downloads/dapl

Icon  Name                    Last modified      Size  Description
[DIR] Parent Directory - [TXT] README.html 07-Nov-2008 15:23 3.7K [   ] WEB_README 30-Apr-2008 16:46 326 [DIR] archive/ 15-Feb-2008 11:01 - [   ] compat-dapl-1.2.8.ta..> 23-Jun-2008 12:32 654K [   ] compat-dapl-1.2.9.ta..> 21-Aug-2008 14:21 657K [   ] compat-dapl-1.2.10.t..> 01-Sep-2008 19:56 658K [   ] compat-dapl-1.2.11.t..> 06-Oct-2008 10:07 659K [   ] compat-dapl-1.2.12.t..> 07-Nov-2008 15:16 660K [   ] dapl-1.2.3.tar.gz 31-Oct-2007 12:47 605K [   ] dapl-1.2.4.tar.gz 28-Jan-2008 16:28 605K [   ] dapl-1.2.5.tar.gz 15-Feb-2008 10:58 606K [   ] dapl-1.2.6.tar.gz 01-May-2008 10:38 611K [   ] dapl-1.2.7.tar.gz 21-May-2008 15:23 625K [   ] dapl-2.0.3.tar.gz 20-Nov-2007 12:39 625K [   ] dapl-2.0.4.tar.gz 28-Jan-2008 16:26 633K [   ] dapl-2.0.5.tar.gz 29-Jan-2008 16:40 633K [   ] dapl-2.0.6.tar.gz 04-Feb-2008 16:22 633K [   ] dapl-2.0.7.tar.gz 15-Feb-2008 10:58 634K [   ] dapl-2.0.8.tar.gz 01-May-2008 10:38 641K [   ] dapl-2.0.9.tar.gz 21-May-2008 15:23 656K [   ] dapl-2.0.10.tar.gz 23-Jun-2008 12:32 691K [   ] dapl-2.0.11.tar.gz 22-Jul-2008 00:06 695K [   ] dapl-2.0.12.tar.gz 21-Aug-2008 14:21 698K [   ] dapl-2.0.13.tar.gz 01-Sep-2008 19:56 698K [   ] dapl-2.0.14.tar.gz 06-Oct-2008 10:08 702K [   ] dapl-2.0.15.tar.gz 07-Nov-2008 15:16 703K [DIR] documentation/ 26-Feb-2008 22:27 -

Direct Access Transport Libraries - v1 and v2

User space libraries/utilities for Direct Access Transport (DAT). DAT is a transport-independent, platform-independent Application Programming Interface that supports RDMA (remote direct memory access) devices. Directory includes packages that include libdat, libdapl, and utilities for both DAT API Spec Version 1.2 and 2.0.

New Feature Summary

1. The new socket CM provider, introduced in 1.2.8 and 2.0.11 packages, assumes homogeneous cluster and will setup the QP's based on local HCA port attributes and exchanges QP information via socket's using the hostname of each node. IPoIB and rdma_cm are NOT required for this provider. QP attributes can be adjusted via the following environment parameters:

  • DAPL_ACK_TIMER (default=16 5 bits, 4.096us*2^ack_timer. 16 == 268ms)
  • DAPL_ACK_RETRY (default=7 3 bits, 7 * 268ms = 1.8 seconds)
  • DAPL_RNR_TIMER (default=12 5 bits, 12 == 64ms, 28 == 163ms, 31 == 491ms)
  • DAPL_RNR_RETRY (default=7 3 bits, 7 == infinite)
  • DAPL_IB_MTU (default=1024 limited to active MTU max)

    The new socket cm entries in /etc/dat.conf provide a link to the actual HCA device and port. Example v1 and v2 entries for a Mellanox connectx device, port 1:

  • OpenIB-mlx4_0-1 u1.2 nonthreadsafe default libdaplscm.so.1 dapl.1.2 "mlx4_0 1" ""
  • ofa-v2-mlx4_0-1 u2.0 nonthreadsafe default libdaploscm.so.2 dapl.2.0 "mlx4_0 1" ""

    This new socket cm provider, was successfully tested on the TATA CRL cluster (#8 on Top500) with Intel MPI, achieving a HPLinpack score of 132.8TFlops on 1798 nodes, 14384 cores at ~76.9% of peak. DAPL_ACK_TIMER was increased to 21 for this scale.

    2. New v2 definitions for IB unreliable datagram extension (only supported in scm provider, libdaploscm.so.2)

  • Extended EP dat_service_type, with DAT_IB_SERVICE_TYPE_UD
  • Add IB extension call dat_ib_post_send_ud().
  • Add address handle definition for UD calls.
  • Add IB event definitions to provide remote AH via connect and connect requests
  • See dtestx (-d) source for example usage model

    Latest Packages (see ChangeLog for recent changes):

    For 1.2 and 2.0 support on same system, including development, install RPM packages as follow:

    Summary of changes for last 2 releases:

    For more details see the following:

    uDAT/uDAPL source git tree is located at git://git.openfabrics.org/~ardavis/scm/dapl.git