Logger 0.2
Need to:
-
design meta data file in YAML. This file will contain the information about the scheme, parameters, ... used -
discuss about header (amount of bytes vs data type). In the dump file, we should write some information in the header. Currently we write the number of bytes for each mask but maybe it would be better to use an enum. -
MPI: Should write 1 file per rank in order to keep a nice parallelization. Still need to figure out how to do it. -
Flipping offset on the fly. We currently reverse the offset afterwards, could be faster to do it on the fly. -
header broken? For the offset, we write only 7 bytes and depending on the endian, it may be broken. Same for the reader. need to fix todo in logger.c (bytes -> bits) -
API. We need a good interface to specify the writing of the data. It should be easy on the user side and the SPH/Grav/... developer side. -
restart. When restarting, we need to go back to the correct timestamp and start again. -
stop writing consts every step. This information is useful only at the beginning, therefore no need to write it down later. -
User defined frequency of writing for each field. In order to make our life more easy, we can ask the user to provide only multiples of the highest one. -
move reader to pyswift or swift -
do stars and gparts -
write index files in binary. We need to move away from HDF5. -
figure out the names of the different object -
part_is_starting. We need to deeply think about the timestep at the writing, we may need to use part_is_active -
add logger and snapshot policy. We need a way to let the user decide between snapshot and index files. -
decide if snapshot are allowed + different variables for index. The variables of the index should not be the ones for the snapshots. -
do not drift particles when writing index. As we do everything exactly as in the snapshot, we drift the particle before an index file which is useless. -
Write the full time and not the integer -
Logger should be an independent library -
Add debugging flag at beginning of each data chunk -
Remove logger_parameters -
Need to find a way to deal with cosmology (time_base works differently)
Edited by Loic Hausammann