WIP: Smarter sends
Started a merge request to keep track of what I'm doing here, since it's all a bit convoluted.
-
[done] Instead of adding send/recv tasks at the level of sub-cell density tasks, recurse down the sub-cell tree and only add them whenever we have an actual density computation. This is done in two passes, i.e. first run through the cells and mark them for send/recv (see
engine_mark_cells_for_hydro_send_recv
inengine_maketasks.c
), and then attach the tasks. - [done] When activating sub-cell density tasks, make sure to activate the send/recv tasks needed along the tree, e.g. activate whatever we see on our way down the active branches. We already do something like this for sorts, so this should not add any extra traversals.
- [done] Update the size computation for the foreign hydro particles to use the new structure.
Things to look out for, because they will almost definitely go wrong:
- [done] When doing a cross-node sub-cell task, should we blindly activate all the send/recv, or only those for the active sub-bits of the sub-cell task?
- [done] What happens if the sub-cell decomposition changes, can we still find the required send/recv tasks?
Edited by Matthieu Schaller
Merge request reports
Activity
changed milestone to %Paris
added 1 commit
- fee8fa10 - code now compiles, which is nice. it's still wrong, but it's nice.
added 792 commits
-
fee8fa10...8ba8cc33 - 789 commits from branch
master
- a89a0965 - when marking cells, check first for non-subcell tasks, then only sub-cell tasks, and then recurse.
- 6365457f - Merge branch 'master' of https://gitlab.cosma.dur.ac.uk/swift/swiftsim into smarter_sends
- cbba49ea - fix last merge conflict.
Toggle commit list-
fee8fa10...8ba8cc33 - 789 commits from branch
added 8 commits
-
89f5d367...451efee9 - 7 commits from branch
master
- 17aaf79f - Merge branch 'master' of https://gitlab.cosma.dur.ac.uk/swift/swiftsim into smarter_sends
-
89f5d367...451efee9 - 7 commits from branch
added 1 commit
- 9b0c3873 - simplify the marking a bit and actually call it from somewhere.
added 257 commits
-
9b0c3873...6bfdfc08 - 254 commits from branch
master
- 2abb9a99 - Merge branch 'master' of https://gitlab.cosma.dur.ac.uk/swift/swiftsim into smarter_sends
- ef4e3916 - Merge branch 'master' of https://gitlab.cosma.dur.ac.uk/swift/swiftsim into smarter_sends
- b570af5b - Merge branch 'master' of https://gitlab.cosma.dur.ac.uk/swift/swiftsim into smarter_sends
Toggle commit list-
9b0c3873...6bfdfc08 - 254 commits from branch
added 204 commits
-
df65c63a...93464a24 - 203 commits from branch
master
- 2849a36c - Merge branch 'master' into smarter_sends
-
df65c63a...93464a24 - 203 commits from branch
added 1 commit
- e5f055f5 - use engine->proxy_ind instead of looking for proxies manually.
@matthieu, this is where my current efforts on reducing the foreign particle arrays are happening.
added 1 commit
- 93fda071 - only allocate as many foreign hydro particles as actually needed by the new…
added 1 commit
- eca77508 - add cell_hash that computes a position-dependent hash for each cell, useful for…
added 1 commit
- fa5ad8cc - fix a bug in marking progeny and only checking for tags where the recv task is…
Please register or sign in to reply