feat: escape mounts to host

[olevski]

This is just a POC.

It needs more testing / work.

I think we can probably cut down on the number of things we mount from the host.

See the mount implementation for mount utils from k8s:
https://github.com/kubernetes/mount-utils/blob/v0.35.1/mount_linux.go#L221

They also use systemd-run. I wonder if they expect that systemd-run will be mounted from the host.

Either way there is a test deployment in the tasko namespace on the dev cluster. You can see the only test-pod there. It has the giab s3 bucket mounted at /giab. You can restart the daemon set on the right node and the mount will keep working.

[olevski]

Note: After I left this running overnight and then I came back the next day the mount is broken. But right after I created the mount restarting the daemon set had no effect on the mount and it kept working. But I suspect this is because the implementation I deployed is not complete. And potentially a remount or unmount/mount cycle was attempted and it failed.