Improve our understanding of profiling #568
Description
In this image for example, I have 3 questions:
- To what events (functions) do the memory spikes correspond?
- To what variables do the memory spikes correspond (jac wrt activation, jac wrt parameters, saved variables, etc)?
- Why don't we start at zero like in some other models?