DAG Scheduler Pattern

Pasted image 20231107164615.png

DAG is Directed Acyclic Graph scheduling pattern is used when we need things to be processed in parallel with the control of which tasks go first which tasks go second or which tasks are grouped together.

And you also have a control over of the worker (some is powerful, some is not) and assign the task respectively for each one

This might have more benefits than a Alexu System Design Interview/1. Scale from zero to millions of users/Message queue system.

Components

DAG Scheduler

Take in the DAG Config files and prioritise it:

Pasted image 20231107180115.png

Resource Manager

Pasted image 20231107180918.png

From the task we can manually select the optimal worker for that task and save the resource of redundant worker hanging as part of a Resource manager

Pasted image 20230904183809.png