DDS is a tool-set that automates and significantly simplifies the deployment of user-defined processes and their dependencies on any resource management system using a given topology.
DDS is a tool-set that automates and significantly simplifies the deployment of user-defined processes and their dependencies on any resource management system using a given topology.
Key Features:
- Works with any batch system (SLURM, LSF, PBS) or standalone via SSH
- No pre-installation required on worker nodes
- Supports distributed task communication via key-value properties
- Provides isolated sandboxes for each deployment
- Handles complex task dependencies and execution rules
- Install DDS: Installation Guide
- First Run: Quick Start Guide
- Learn by Example: Tutorials
- Requirements - System and network requirements
- Download - Get DDS releases
- Installation - Build and install from source
- Quick Start - Run your first DDS deployment
- How to Start - Detailed usage guide
- User Defaults Configuration - Customize DDS behavior
- Topology description - Define your task workflows
- Tutorials - Step-by-step examples
- dds-session - Session management
- dds-commander - Core server component
- dds-user-defaults - Configuration management
- dds-submit - Agent deployment
- dds-info - Status and monitoring
- dds-test - Testing utilities
- dds-topology - Topology management
- dds-agent-cmd - Agent commands
- dds-tools - C++ API for DDS integration
- dds-intercom - High-level communication API for custom commands and key-value store
- DDS Agent Architecture - Agent internals, lifecycle management, and shared memory transport
- User Task Development Guide - Comprehensive guide for developing DDS tasks with environment variables, communication APIs, custom environments, and file assets
- Low-Level Protocol - Binary protocol specification and transport layer
- High-Level Protocol - Custom commands, key-value store, and Intercom API
- localhost - Local machine deployment
- ssh - SSH-based deployment
- slurm - SLURM integration
- lsf - LSF integration
- pbs - PBS integration
- For Plug-in developers - Creating custom plugins
- Build 3rd-party dependencies - Development setup