Super cells

Allocate a list of direct pointers to the "super" cells in the space.

This is usefull for mappers that currently operate on the cells, but actually just recurse and do things at, or below, the super cells. This finer-grained input to the threadpool will likely parallelize better.

Added 1 commit:

• 787d5fa4 - update function documentation.

mentioned in issue #344 (closed)

Is this ready for testing ?

Yes!

That ran smoothly over night for me.

Yay! Can we get a few threadpool mapper plots to see if it has any effect on the runner_do_unskip mappers? Thanks!

@jwillis did you manage to run this branch on your node ?

No not yet. So you just want some threadpool mapper plots? Or a scaling test?

@jwillis, both would be cool, but I'm more interested in the threadpool mapper plots. Thanks!

1 thread:

• http://icc.dur.ac.uk/~rsrd54/super_cell/task_plots_1/index.html
• http://icc.dur.ac.uk/~rsrd54/super_cell/threadpool_plots_1/threadpool-index.html

16 threads:

• http://icc.dur.ac.uk/~rsrd54/super_cell/task_plots_16/index.html
• http://icc.dur.ac.uk/~rsrd54/super_cell/threadpool_plots_16/threadpool-index.html

@jwillis, awesome, thanks!

So it looks like there is no improvement here. Next step is the new re-entrant threadpool, i.e. with task insertion.

I guess we can close this ?

Yeah, thanks for cleaning up!

Status changed to closed