Skip to content

Better link size estimates

Matthieu Schaller requested to merge better_link_size_estimates into master

Fixes #521 (closed).

This modifies the strategy used to estimate the number of links needed for a given run. Instead of using some relatively complex heuristic we first create the basic tasks and split them. Based on the number of tasks created at this point, we multiply that by a constant factor (10) to get the number of links. At this stage, all that is left is the creation of the MPI tasks and the linking. So we have a very good estimate of the number of tasks that will be created altogether.

The multiplication factor can be optionally modified.

An additional check is used. We make sure that the derived number of links is at least 1.2x the actual number of links that were used in the previous step. That should garanty in reasonable scenarios that when we survive the first step, we survive throughout the run.

The next step is to tackle the estimation of the number of tasks that is also quite off.

Merge request reports