[ET Device Support] Define AOT device copy ops registry

[Gasoonjia]

Stack from ghstack (oldest at bottom):

• [ET Device Support] CUDA-native Qwen 3.5 MoE inference with device tensor pipeline #18788
• [ET Device Support] Extract shared device test utilities to reduce redundancy #18762
• [ET Device Support] Add device tensor helper functions to TensorPtr API #18761
• [ET Device Support] Add ExecutorchBackendConfig flags for skipping H2D/D2H copies #18760
• [ET Device Support] PropagateDevicePass inserts H2D/D2H copy ops at delegate boundaries #18730
• [ET Device Support] Define et_copy runtime h2d and d2h copy ops #18729
• -> [ET Device Support] Define AOT device copy ops registry #18728
• [ET Device Support] CudaAllocator: device memory allocator for CUDA backend #18477
• [ET Device Support] Module: allocate device memory for planned buffers #18476
• [ET Device Support] MemoryManager: add per-buffer device metadata #18475
• [ET Device Support] MethodMeta: expose per-buffer device placement API #18474
• [ET Device Support] DeviceMemoryBuffer RAII class for device memory lifetime management #18473
• [ET Device Support] Emitter reads non_const_buffer_device from graph meta #18472
• [ET Device Support] Device-aware memory planning: separate buffers per device type #18375
• [ET Device Support] Add NonConstBufferDevice schema for per-buffer device mapping #18330
• [ET Device Support] DeviceAllocator interface and DeviceAllocatorRegistry #17535
• [ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device #18080
• [ET Device Support] Parse device info from serialized tensor in tensor_parser #18328
• [ET Device Support] Propagate device info from TensorSpec into serialized Tensor #18079
• [executorch] Propagate device metadata from partitioner result onto TensorSpecs #18078

Define et_copy._h2d_copy and et_copy._d2h_copy custom ops for explicit
host-to-device and device-to-host data transfer at delegate boundaries.

Follows dim_order_ops_registry.py pattern:

• Defines functional and out variants for both ops
• Tracing implementations: clone/copy (CPU-only during tracing)
• Registered via torch.library

Differential Revision: D99636779

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18728

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 64 New Failures

As of commit 769c1e2 with merge base b5ae0b9 ():

NEW FAILURES - The following jobs have failed:

• Build Presets / apple (pybind) / build (gh)
  RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 2
• Build Presets / linux (pybind, linux.2xlarge, executorch-ubuntu-22.04-clang12) / build (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• Build Presets / linux (pybind, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11-aarch64) / build (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• Build Presets / windows (pybind) / build (gh)
  Process completed with exit code 1.
• periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t e28e6252b9074ca4294e9712041d57cc42a2f2d16ab773d342ac90cd88451a4e /exec failed with exit code 1
• periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t a02a5e517044616d2ac0f7314de3984b343425c1f727393bde515414e0a6d083 /exec failed with exit code 1
• periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
  RuntimeError: Command docker exec -t 4b47324255c50a1aa5b84ec18b4c428a0da1bd07a1ddaa093958d00ec753fa9a /exec failed with exit code 1
• pull / android / build-android (gh)
• pull / test-coreml-bc-macos (macos-m1-stable) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / test-coreml-bc-macos (macos-m2-stable) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1
• pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-llama-runner-linux-android / linux-job (gh)
  RuntimeError: Command docker exec -t 87bf190ac551d98709979e50d3b71fb69b0975e1a8074128b1d899f06384f0c3 /exec failed with exit code 2
• pull / test-llama-runner-qnn-linux (fp32, qnn_16a16w, qnn) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-llama-runner-qnn-linux (fp32, qnn_8a8w, qnn) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-lora-linux / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-lora-multimethod-linux / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-models-linux (add_mul, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 55b7fcec29db74d36b43cc3367e9a8611830b0fc19637ad376445c5cfe220bb7 /exec failed with exit code 1
• pull / test-models-linux (add, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t ed511aa8ba441e5e49f9d49479f776a57d615a42c064636b4dac678173d65a19 /exec failed with exit code 1
• pull / test-models-linux (emformer_join, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 99b6e6f0358c013a341bc2bffd9a8683055a5d57d8dbf4474d5c8921ff731ff7 /exec failed with exit code 1
• pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 37e1b5ed2c98e2a25e8c4788a2288c0ed861ff232a49a917820147cd59c6d846 /exec failed with exit code 1
• pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t bbe59630bee232b0f7893c427428a34d01e9f5b88f1af86d116d5f285ba2ff21 /exec failed with exit code 1
• pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
  RuntimeError: Command docker exec -t 63fa68d6bd01af14384cac643b653032064acbc51a3de0acf15553eb44e6f335 /exec failed with exit code 1
• pull / test-models-linux (linear, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 82f6e7c84adc71c0a09ce25ec0e6222748c809dab028cf71062201c7138b2a8d /exec failed with exit code 1
• pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 43350b24d291c6d81c0d3d8615cbc768a1490062744e66fcb74ebfb4e2886c3e /exec failed with exit code 1
• pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t a318235bb2efea3ba059e07ad35dd3e8f99f500d13b465e71500826ac43ed2d7 /exec failed with exit code 1
• pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 7acaa04f62e9cc6bac45e3411253865ca2bda22b6d3b078a3a800ccbd9e33e32 /exec failed with exit code 1
• pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
  RuntimeError: Command docker exec -t 64f22f1161548bf0e017dc45a433aebdd3d9d908136932155ac049005fd1e8f1 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 04ea7b61c7b7707d7d92133c44ac3b29aa3fa0bd9e51b903c9cca26815b98b25 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 5877802f9986f20216723631b242d3443426147e5d0ad730c6ad7b4238bea765 /exec failed with exit code 1
• pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t a55e40441896048725b9e3ac0f96f77bfe32fd16d56eb1e3f73630d78aea146c /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 38dc41cda9b69ac0d04a7f7c92964fec63535e58b6e271439cf9c04d1da7b994 /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
  RuntimeError: Command docker exec -t 63964b126c864389b68501c6073201a2d458b5d9e4a579623dc8bda0ccb3d7ce /exec failed with exit code 1
• pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
  RuntimeError: Command docker exec -t 1d4a5c6dbfde08c9c3922f03ad8b9080b522e42f2b7957c7267a7fd53c118d7a /exec failed with exit code 1
• pull / test-moshi-linux / linux-job (gh)
  test_mimi
• pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
  RuntimeError: Command docker exec -t b86d01a1abd47745c79c900de401d172dd070b85f9e4b37c2058bfa676e66be9 /exec failed with exit code 1
• pull / test-openvino-linux / linux-job (gh)
  RuntimeError: Command docker exec -t b83ef5f3aa835d0d5ebe3109a1363150df5e3a0f86cf608cd1e2b7e345e2ccf7 /exec failed with exit code 1
• pull / test-parakeet-xnnpack-linux / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-phi-3-mini-runner-linux / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-samsung-models-linux / linux-job (gh)
  test_torchvision_vit_fp16
• pull / test-sqnr-static-llm-qnn-linux (smollm2_135m) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-static-llama-qnn-linux (stories_110m) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-static-llama-qnn-linux (stories_260k_bc) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
  AttributeError: '_OpNamespace' 'llama' object has no attribute 'sdpa_with_kv_cache'
• pull / test-vulkan-models-linux / linux-job (gh)
  RuntimeError: Command docker exec -t a7515151bde663b67c9092e7e37d61c47dfee77256e4b7a29f8f80ce69b3a693 /exec failed with exit code 1
• pull / test-vulkan-operators-linux / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• pull / unittest / linux / linux-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_int8_static_quant_recipe
• pull / unittest / macos / macos-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_int8_static_quant_recipe
• pull / unittest / windows / windows-job (gh)
  Process completed with exit code 1.
• pull / unittest-arm-backend-with-no-deps (test_pytest_models_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t e891566806a1845dbdc44a57bf90e6fd06e25c5491adf5e14ee26502e7693a9d /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_no_target) / linux-job (gh)
  RuntimeError: Command docker exec -t dae30a732fb666bc5d4d0542241dea4c26beae4d380fa528d429824d87bf5943 /exec failed with exit code 1
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t 67472a657655ab7f0ef7a35b55fb273155888e5e5e55ddbbef6ab97ef092e392 /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_int8_static_quant_recipe
• pull / unittest-editable / macos / macos-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_int8_static_quant_recipe
• pull / unittest-editable / windows / windows-job (gh)
  Process completed with exit code 1.
• pull / unittest-nxp-neutron / linux-job (gh)
  RuntimeError: Command docker exec -t d4626901234d028e6390a3b1263bf0877b523cba059201b2af97ec44e1220d1e /exec failed with exit code 2
• pull / unittest-wasm-bindings (--enable-etdump) / linux-job (gh)
  RuntimeError: Command docker exec -t 38f286525649393a0c8619e422c30dbe55dfbbd7fa83a643481554c0c4bd1df9 /exec failed with exit code 2
• Test QNN Backend / test-qnn / test-backend-linux (qnn, models) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`
• Test QNN Backend / test-qnn / test-backend-linux (qnn, operators) / linux-job (gh)
  undefined reference to executorch::runtime::DeviceMemoryBuffer::create(unsigned long, executorch::runtime::etensor::DeviceType, signed char)'`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

[digantdesai]

Review automatically exported from Phabricator review in Meta.