graph LR
Workflow_Orchestrator["Workflow Orchestrator"]
Data_State_Management["Data & State Management"]
Execution_Backends["Execution Backends"]
User_Interface["User Interface"]
System_Configuration["System Configuration"]
Workflow_Orchestrator -- "Delegates to" --> Execution_Backends
Workflow_Orchestrator -- "Interacts with" --> Data_State_Management
Data_State_Management -- "Provides services to" --> Workflow_Orchestrator
Data_State_Management -- "Used by" --> Execution_Backends
Execution_Backends -- "Receives tasks from" --> Workflow_Orchestrator
Execution_Backends -- "Utilizes" --> Data_State_Management
User_Interface -- "Initiates actions in" --> Workflow_Orchestrator
User_Interface -- "Queries" --> Data_State_Management
System_Configuration -- "Provides settings to" --> Workflow_Orchestrator
System_Configuration -- "Provides settings to" --> Execution_Backends
click Workflow_Orchestrator href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/redun/Workflow_Orchestrator.md" "Details"
click Data_State_Management href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/redun/Data_State_Management.md" "Details"
click Execution_Backends href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/redun/Execution_Backends.md" "Details"
click User_Interface href "https://github.com/CodeBoarding/GeneratedOnBoardings/blob/main/redun/User_Interface.md" "Details"
Final Architecture Overview for redun
Workflow Orchestrator [Expand]
The core intelligence of Redun, responsible for defining, scheduling, and managing the execution of tasks within a computational graph. It handles dependency resolution, caching logic, and asynchronous operations, acting as the central coordinator for workflow execution.
Related Classes/Methods:
Data & State Management [Expand]
Manages the persistence, serialization, hashing, and retrieval of all workflow metadata, task values, and files. This component is fundamental to Redun's reproducibility, caching mechanisms, and historical analysis capabilities.
Related Classes/Methods:
redun.backends.db(1:1)redun.value(1:1)redun.file(1:1)redun.hashing(1:1)redun.tags(1:1)
Execution Backends [Expand]
An extensible layer that abstracts the execution of tasks across various computational environments. It provides a unified interface for running tasks locally, in Docker containers, or on cloud-specific services like AWS Batch, GCP Batch, or Kubernetes.
Related Classes/Methods:
redun.executors.base(1:1)redun.executors.local(1:1)redun.executors.docker(1:1)redun.executors.aws_batch(1:1)redun.executors.aws_glue(1:1)redun.executors.gcp_batch(1:1)redun.executors.k8s(1:1)
User Interface [Expand]
Provides the primary means for users to interact with Redun. This includes the command-line interface (CLI) for initiating and managing workflows, and an interactive console (TUI) for monitoring and inspecting execution history.
Related Classes/Methods:
Centralized management of Redun's operational settings. It allows users to customize various aspects of the system, including executor parameters, database connections, and default behaviors, ensuring flexible deployment and operation.
Related Classes/Methods: