Int8 + microscaling support for kv cache formats.#841

copybara-service[bot] wants to merge 1 commit intodevgoogle/gemma.cpp:devfrom

test_874047973google/gemma.cpp:test_874047973Copy head branch name to clipboard