[DRAFT] userspace LL/audio test PR by kv2019i · Pull Request #10558 · thesofproject/sof

kv2019i · 2026-02-19T17:31:12Z

SOF has recently gained ability to run DP (=preemptable audio tasks) in Zephyr user-space.

This PR is an early stage pull-request for changes to extend this capability to all of the audio pipeline code, and specifically the LL (low-latency) tasks.

This early stage as the design is not set in stone and the PR uses a number of short cuts in order to move (and tests) incrementally larger sets of audio functionality.

kv2019i · 2026-02-19T17:32:45Z

Running the pipeline_two_components_user test added in this PR, on a Intel PTL, looks like this:

START - pipeline_two_components_user
[    0.000163] <inf> sof_boot_test: pipeline_two_components: copier module_id = 3
[    0.000163] <inf> sof_boot_test: pipeline_two_components: running test with user memory domain
[    0.000163] <inf> pipe: pipeline_new: pipeline new pipe_id 2 priority 0
[    0.000163] <dbg> ipc: ipc4_get_drv: found type 22, uuid 0xa00bc350U
[    0.000163] <dbg> module_adapter: module_adapter_new_ext: start
[    0.000163] <dbg> module_adapter: module_adapter_mem_alloc: using ll user heap for module
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x3 entry
[    0.000165] <dbg> dma: z_impl_sof_dma_get: dma_get(), dma-probe id = 0
[    0.000165] <inf> dma: z_impl_sof_dma_get: dma_get() ID 0 sref = 1 busy channels 0
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x3 done
[    0.000165] <dbg> module_adapter: module_adapter_new_ext: comp:2 0x3 done
[    0.000165] <dbg> ipc: ipc4_add_comp_dev: add comp 0x3
[    0.000165] <dbg> ll_schedule: zephyr_domain_thread_tid: entry
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf798 for thread 0x400bf6c0
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf798 for thread 0x401894e0
[    0.000165] <inf> sof_boot_test: pipeline_two_components: host copier created, comp_id = 0x3
[    0.000165] <dbg> ipc: ipc4_get_drv: found type 22, uuid 0xa00bc350U
[    0.000165] <dbg> module_adapter: module_adapter_new_ext: start
[    0.000165] <dbg> module_adapter: module_adapter_mem_alloc: using ll user heap for module
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x10003 entry
[    0.000165] <inf> copier: copier_dai_init: comp:2 0x10003 dd 0x4019d280 initialized, index -1
[    0.000165] <dbg> dma: z_impl_sof_dma_get: dma_get(), dma-probe id = 0
[    0.000165] <inf> dma: z_impl_sof_dma_get: dma_get() ID 0 sref = 1 busy channels 0
[    0.000165] <inf> ipc: dai_config: comp:2 0x10003 dai type = 3 index = 0 dd 0x4019d280
[    0.000165] <dbg> ipc: dai_config: comp:2 0x10003 Alloc dai_spec_config 0xa019d480 size size 84
[    0.000165] <dbg> module_adapter: module_init: comp:2 0x10003 done
[    0.000165] <dbg> module_adapter: module_adapter_new_ext: comp:2 0x10003 done
[    0.000165] <dbg> ipc: ipc4_add_comp_dev: add comp 0x10003
[    0.000165] <dbg> ll_schedule: zephyr_domain_thread_tid: entry
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf7e0 for thread 0x400bf6c0
[    0.000165] <dbg> component: comp_grant_access_to_thread: grant access to mutex 0x400bf7e0 for thread 0x401894e0
[    0.000165] <inf> sof_boot_test: pipeline_two_components: DAI copier created, comp_id = 0x10003
[    0.000166] <dbg> buffer: buffer_alloc: buffer_alloc()
[    0.000166] <dbg> buffer: buffer_alloc_struct: buffer_alloc_struct()
[    0.000166] <dbg> userspace_helper: user_grant_dai_access_all: Granted DAI access to thread 0x401894e0 for 45 devices
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@72c00 to thread 0x401894e0
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@72800 to thread 0x401894e0
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@79800 to thread 0x401894e0
[    0.000166] <dbg> userspace_helper: user_grant_dma_access_all: Granted DMA device access: dma@79400 to thread 0x401894e0
[    0.000166] <inf> sof_boot_test: pipeline_two_components: user thread started, waiting for completion
[    0.000170] <dbg> pipe: pipeline_reset: pipe:2 0x3 pipe reset
[    0.000170] <dbg> pipe: pipeline_comp_reset: pipe:2 0x3 current->comp.id = 0x3, dir = 0
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x3 resetting
[    0.000170] <dbg> copier: copier_reset: comp:2 0x3 entry
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x3 done
[    0.000170] <dbg> pipe: pipeline_comp_reset: pipe:2 0x3 current->comp.id = 0x10003, dir = 0
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x10003 resetting
[    0.000170] <dbg> copier: copier_reset: comp:2 0x10003 entry
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x10003 done
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x3 disconnect buffer 0 as sink
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x10003 disconnect buffer 0 as source
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_reset: comp:2 0x10003 done
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x3 disconnect buffer 0 as sink
[    0.000170] <dbg> pipe: pipeline_disconnect: comp:2 0x10003 disconnect buffer 0 as source
[    0.000170] <dbg> buffer: comp_buffer_free: buf:0 0x0 buffer_free()
[    0.000170] <dbg> module_adapter: module_adapter_free: comp:2 0x3 start
[    0.000170] <inf> dma: z_impl_sof_dma_put: dma_put(), dma = 0x400c8488, sref = 0
[    0.000170] <dbg> module_adapter: module_adapter_free: comp:2 0x10003 start
[    0.000170] <inf> dma: z_impl_sof_dma_put: dma_put(), dma = 0x400c8518, sref = 0
[    0.000170] <dbg> pipe: pipeline_free: pipe:2 0x3 entry
[    0.000170] <inf> sof_boot_test: pipeline_two_components: two component pipeline test complete
 PASS - pipeline_two_components_user in 0.023 seconds

kv2019i · 2026-03-09T17:13:40Z

V2 snapshot pushed:

pipeline_two_components() tests now passes on Intel PTL hardware. a pipeline with two components is created, resources set up, pipeline is run with LL scheduler and then torn down freeing up all resources
introduces change to schedule.h interface to support LL scheduler
multiple limitations still in code (marked with WIP/HACK prefixes): limited to single core, some impact to non-user builds

kv2019i · 2026-03-17T18:30:33Z

V3 snapshot pushed:

added skeleton implementation for user-space IPC handling (only one IPC message type supported for now)
added a test case (ipc4_create_pipeline_check) to test the above

kv2019i · 2026-03-17T18:31:20Z

Test output for the new test added in V3:

[    0.000063] <inf> ipc: ipc_cmd: rx   : 0x110a1800|0x0
[    0.000063] <dbg> ipc: ipc_user_forward_cmd: IPC: forward cmd 110a1800
[    0.000063] <dbg> ipc: ipc_user_thread_fn: IPC user wake, mask 1
[    0.000063] <dbg> ipc: ipc_pipeline_new: ipc: pipeline id = 10
[    0.000063] <inf> ipc: ipc4_create_pipeline: pipe_desc a00f9f74, instance 10
[    0.000063] <inf> pipe: pipeline_new: pipeline new pipe_id 10 priority 3
[    0.000063] <wrn> pipe: pipeline_new: pipeline trace settings cannot be copied
[    0.000063] <wrn> pipe: pipeline_new: pipeline position reporting not available
[    0.000063] <inf> ipc: ipc4_create_pipeline: pipeline_new() -> 0xa01ba580
[    0.000063] <inf> ipc: ipc4_create_pipeline: success
[    0.000063] <err> ipc_service: ipc_service_release_rx_buffer: Endpoint not registered

[    0.000063] <wrn> ipc: ipc_platform_complete_cmd: ipc_service_release_rx_buffer() failed: -2
[    0.000063] <dbg> ipc: ipc_cmd: tx-reply     : 0x31000000|0x0
[    0.000063] <wrn> ipc: ipc_msg_send: Skipping IPC worker schedule. TODO to fix

[    0.000063] <inf> sof_boot_test: ipc4_create_pipeline_check: ipc_cmd() returned for pipeline id=10
[    0.000063] <inf> sof_boot_test: ipc4_create_pipeline_check: pipeline verified in IPC comp list
[    0.000063] <dbg> pipe: pipeline_free: pipe:10 0x0 entry
[    0.000063] <inf> sof_boot_test: ipc4_create_pipeline_check: ipc4 create pipeline test complete
[    0.000063] <inf> main: sof_app_main: SOF on intel_adsp
[    0.000063] <err> ipc_service: ipc_service_get_tx_buffer_size: Endpoint not registered

[    0.000063] <err> ipc_service: ipc_service_send: Endpoint not registered

[    0.000063] <err> main: sof_app_main: SOF initialization failed
[    0.000063] <inf> main: sof_app_main: SOF initialized
===================================================================
PROJECT EXECUTION SUCCESSFUL

kv2019i · 2026-03-17T18:33:59Z

+	/* works? yes */
+	//return 0;
+
+	printk("ipc %p\n", ipc);


Oops, these shouldn't be here. :)

kv2019i · 2026-03-17T18:35:53Z


 	/* create the pipeline */
-	pipe = pipeline_new(NULL, pipe_desc->primary.r.instance_id,
+	pipe = pipeline_new(heap, pipe_desc->primary.r.instance_id,


@lyakh @jsarha @lgirdwood This is where you'd plug in the vregions stuff to pass a separate heap to each pipe (based on topology description of its needs). In this series, as a placeholder, I use the zephyr_ll_user_heap() instead.

right, maybe put a comment there for now to make re-discovery easier

lyakh

last reviewed commit so far "schedule: zephyr_ll: implement thread_init/free domain ops"

lyakh · 2026-03-17T16:37:46Z

+#ifdef CONFIG_SOF_USERSPACE_LL
+void comp_grant_access_to_thread(const struct comp_dev *dev, struct k_thread *th)
+{
+	assert(dev->list_mutex);


description a bit confusing - this is only granting access to a mutex. Also list_mutex is only added to comp_dev in the next commit.

lyakh · 2026-03-18T08:59:18Z

 	}

-	stream_addr = rballoc_align(flags, size, align);
+	stream_addr = sof_heap_alloc(heap, flags, size, align);


the commit, that is mentioned in the commit message, only moved buffer context objects to particular heaps. This commit moves actual data buffers to them too, which is different and (arguably) more risky

lyakh · 2026-03-18T10:44:29Z

 #define HDA_DMA_BUFFER_PERIOD_COUNT	4

-SHARED_DATA struct sof_dma dma[] = {
+APP_TASK_DATA SHARED_DATA struct sof_dma dma[] = {


do I understand correctly, that this kind of userspace access makes that data writable to userspace?

lyakh · 2026-03-18T10:49:20Z

 		comp_err(dev, "requested channel %d is busy", hda_chan);
 		return -ENODEV;
 	}
-	hd->chan = &hd->dma->chan[channel];


is this also not needed for the legacy mode? Also below

lyakh · 2026-03-18T11:00:24Z

 	uint64_t next_sync;
 	uint64_t period_in_cycles;
 #endif
+	struct k_heap *heap;


wasn't this already referenced in the previous commit?

lyakh · 2026-03-18T11:21:44Z


-	k_spinlock_init(&dd->dai->lock);
+#ifdef CONFIG_SOF_USERSPACE_LL
+	dd->dai->lock = k_object_alloc(K_OBJ_MUTEX);


check for NULL? Possibly in other locations too

lyakh · 2026-03-18T11:24:25Z

 	k_mutex_lock(dai->lock, K_FOREVER);
-	props = dai_get_properties(dai->dev, direction, stream_id);
-	hs_id = props->dma_hs_id;
+	ret = dai_get_properties_copy(dai->dev, direction, stream_id, &props);


I'm guessing this is made a syscall in one of the commits

lyakh · 2026-03-18T11:27:53Z

 		mod_heap = &mod_heap_user->heap;
 	} else {
+#ifdef CONFIG_SOF_USERSPACE_LL
+		mod_heap = zephyr_ll_user_heap();


looks good, but this else is entered under multiple conditions, might need to double-check

lyakh · 2026-03-18T11:34:11Z

 	.schedule_task_before	= zephyr_ll_task_schedule_before,
 	.schedule_task_after	= zephyr_ll_task_schedule_after,
-	.schedule_task_free	= zephyr_ll_task_free,
+	.schedule_task_free	= zephyr_ll_task_sched_free,


let's "spend" 3 more characters and make it ..._schedule_free()

lyakh · 2026-03-18T12:01:00Z

-			return -ENOMEM;
-		}
+		tr_err(&ll_tr, "Failed to allocate thread object for core %d", core);
+		dt->handler = NULL;


duplicate of line 318

lyakh · 2026-03-18T13:07:30Z

+{
+	const struct sof_man_fw_desc *desc = basefw_vendor_get_manifest();
+	const struct sof_man_module *mod;
+	uint32_t i;


int / unsigned int

lyakh · 2026-03-18T13:07:55Z

+	uint32_t i;
+
+	if (!desc)
+		return -1;


lyakh · 2026-03-18T13:08:04Z

+			return (int)i;
+	}
+
+	return -1;


lyakh · 2026-03-18T13:09:01Z

+	union ipc4_connector_node_id node_id;
+	uint32_t dma_buffer_size;
+	uint32_t config_length;
+} __packed __aligned(4);


does __aligned actually make sense in a type definition?

lyakh · 2026-03-18T13:35:48Z

+			pipe_msg.extension.dat = ipc_user->ipc_msg_ext;
+
+			/* Execute pipeline creation in user context */
+			ipc_user->result = ipc_pipeline_new(ipc_user->ipc, (ipc_pipe_new *)&pipe_msg);


that's brave! ;-) I'd put a huge "TODO" here to make sure not to ship this by chance :-)

lyakh · 2026-03-18T13:53:37Z


 	/* create the pipeline */
-	pipe = pipeline_new(NULL, pipe_desc->primary.r.instance_id,
+	pipe = pipeline_new(heap, pipe_desc->primary.r.instance_id,


right, maybe put a comment there for now to make re-discovery easier

kv2019i · 2026-03-27T13:43:41Z

V4 snapshot pushed:

this is a significant milestone as this version allows to set up a full pipeline in user-space and this can be tested at aplay level (tested on Intel PTL with playback PCM0 of upstream sof-ptl-nocodec.tplg topology)
no changes needed to Zephyr or topology
limitations: multiple WIP changes that break other functionality and e.g. IPC implementation is very much in progress

kv2019i · 2026-03-27T13:46:07Z

Example output with V4 patchset:

--cut--
$ aplay -l
**** List of PLAYBACK Hardware Devices ****
card 0: sofnocodec [sof-nocodec], device 0: Port0 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: sofnocodec [sof-nocodec], device 1: Port1 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: sofnocodec [sof-nocodec], device 2: Port2 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
card 0: sofnocodec [sof-nocodec], device 31: Deepbuffer Port0 (*) []
  Subdevices: 1/1
  Subdevice #0: subdevice #0
$ aplay -Dplughw:0,0 -d120 -fdat -traw /dev/zero && echo success
Playing raw data '/dev/zero' : Signed 16 bit Little Endian, Rate 48000 Hz, Stereo
success
$
--cut--

kv2019i · 2026-03-30T17:11:36Z

V5 pushed:

start IPC integration with user/kernel split from Ipc user kernel split #10660 partially merged (from @jsarha and @lgirdwood ) -- I tried to merge the full thing but routing all IPC messages to user thread does not work yet, so left the topmost patches out for now
no other changes (and no rebase)

kv2019i · 2026-04-01T13:08:35Z

V6 pushed:

rebase only, no functionality changes
a couple of PRs from "already submitted group" merged to main so removed from this PR
added Add CONFIG_SOF_OS_LINUX_COMPAT_PRIORITY and use it to fix UAOL regression #10672 to the series to make the test pass again with SOF main

kv2019i · 2026-04-01T14:40:19Z

V7 submitted:

added more changes from Ipc user kernel split #10660 , but not yet the change to route all user IPC to user thread. it turns out there are still multiple issues to tackle, so we are better off to incrementally move more IPC types to be processed in user thread (versus moving all in a single commit)
added fix to granting permissions to IPC thread
add new CONFIG_HOST_DMA_IPC_POSITION_UPDATES to drop unused functionality from IPC4 builds

kv2019i · 2026-04-10T11:53:38Z

V8 submitted:

one more IPC routed to user IPC thread (DELETE_PIPELINE)
introduced sys_mutex as a way to replace spinlocks in code that has to work both in kernel and user threads based on build configuration (core changes submitted separately as ipc4: replace fw_reg spinlock with mutex #10693 )
no rebase yet to make the diff to V7 useful

kv2019i · 2026-04-10T12:05:12Z

V9 submitted:

rebase only, no functional change

kv2019i · 2026-04-14T11:24:17Z

V10:

fast-forward update with two commits on top, one a WIP code change to fix a build issue and another to add a overlay file for Intel PTL
code can be now compiled with:

./scripts/xtensa-build-zephyr.py ptl  -o app/os_linux_overlay.conf -o app/overlays/ptl/ll_userspace_overlay.conf ptl

at least following test works with upstream sof-ptl-nocodec.tplg (no special Linux/sof-dev dependencies)

aplay -Dplughw:0,0 -d3 -fdat -traw /dev/zero

kv2019i · 2026-04-15T12:00:50Z

V11 pushed:

MOD_CONFIG_GET/SET, MOD_BIND/UNBIND, MOD_INIT/DELETE_INSTANCE moved to user-space (a bit rough code, but functionality at least works)
no rebase (will do that in V12)
UPDATE: with upstream sof-ptl-nocodec.tplg , one needs drivers: dai: make max dai_config blob size configurable zephyrproject-rtos/zephyr#107341 for Zephyr or otherwise copier set_config will fail

kv2019i · 2026-04-15T13:04:50Z

V12 pushed:

rebase-only, no change to functionality
NOTE: like with V11, one needs drivers: dai: make max dai_config blob size configurable zephyrproject-rtos/zephyr#107341 to test with upstream sof-ptl-nocodec.tplg

- add arch_schedulers_get_for_core() for task-carried core routing - route 8 task-aware scheduler callers via task->core under CONFIG_SOF_USERSPACE_LL - fix zephyr_domain_thread_tid() to accept core parameter instead of hardcoding core 0 - create domain threads for secondary cores in secondary_core_init() - remove FIXME workaround from arch_schedulers_get() Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

No need to copy the trace context object to buffer object, when audio pipelines are running in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

To make ipc4_create_buffer() usable from user-space, do not call cpu_get_id() but instead rely on "src->ipc_config.core". If code is run in kernel space, check the core matching current active core, but skip the check if run in user-space (as check is privileged). Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Make ipc_comp_connect() safe to run in user-space with limited functionality. The core id queries are privileged, so limit connections to cases where pipeline is running on 0. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_MOD_CONFIG_GET/GET to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Handling these IPC messages require calls to module interface get/set_attribute() methods, which must be run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_MOD_BIND/UNBIND to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Handling these IPC messages require calls to module interface bind/unbind() methods, which must be run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_IPC4_MOD_INIT_INSTANCE partially to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Module init involves multiple privileged actions, so part of module init handling is still done in kernel space, but the module specific initialization is run in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_GLB_SET_PIPELINE_STATE to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. The IPC compound message helpers in IPC common.h are turned into system calls, allowing the user-space IPC thread to synchronize with kernel IPC thread that still does the low-level IPC messaging. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Move handling of SOF_IPC4_MOD_LARGE_CONFIG_GET/SET to user-space IPC thread when SOF is built with CONFIG_SOF_USERSPACE_LL. Handling of these IPCs requires calling to module specific code via the module get/set_large_config() method, so this code needs to run in user-space context if audio pipelines are running in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

The LL user-space heap was sized using CONFIG_SOF_ZEPHYR_USERSPACE_MODULE_HEAP_SIZE (16 KB), which is the per-module heap size. This heap is shared across ALL simultaneously active pipelines for module allocations, buffer allocations, IPC structures, and host DMA data. With 8 concurrent pipelines the 16 KB budget was exhausted, causing ENOMEM failures in the multiple-pipeline test. Add CONFIG_SOF_ZEPHYR_LL_USER_HEAP_SIZE (default 128 KB) so the LL scheduler heap can be sized independently. Parameterize sys_user_heap_init() to accept the heap size from its caller. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Set CONFIG_SOF_ZEPHYR_LL_USER_HEAP_SIZE to 128kB in the LL user-space overlay. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Make ipc_msg_send() a Zephyr system call so audio processing modules running in user-space LL threads can queue IPC messages (e.g. position updates, notifications) back to the host. The change takes effect only if CONFIG_SOF_USERSPACE_LL=y. Follows the same pattern used for ipc_msg_reply(): a dedicated header with __syscall declaration, z_impl/z_vrfy split, and syscall header registration in CMakeLists.txt. The verifier validates that the msg struct is writable (the implementation touches the list linkage) and that the data buffer, when provided, is readable up to msg->tx_size bytes. Signed-off-by: Jyri Sarha <jyri.sarha@linux.intel.com> (cherry picked from commit b25c15c)

Add an optional heap parameter to ipc_msg_w_ext_init() and ipc_msg_init() so callers can direct allocations to a specific heap. When the heap argument is NULL the existing rzalloc() path is used; when non-NULL, sof_heap_alloc()/sof_heap_free() are used instead. This allows IPC messages to be allocated from userspace-accessible heaps. For audio module contexts, introduce mod_ipc_msg_w_ext_init() and mod_ipc_msg_init() in generic.h. These use mod_zalloc()/ mod_free() for allocations that are automatically tracked and freed with the module lifecycle. ipc_msg_w_ext_init() is moved from a static inline in msg.h to a non-inline function in ipc-common.c due to the additional sof_heap_alloc dependency. Update all existing callers: - Module context callers (cadence, tdfb, sound_dose) use the new mod_ipc_msg_*() variants. - host-zephyr.c uses hd->heap, pipeline-graph.c uses the heap parameter from pipeline_new(). - Remaining kernel-context callers pass NULL for the default heap. Signed-off-by: Jyri Sarha <jyri.sarha@linux.intel.com> (cherry picked from commit 11a17d5)

Add a new test to userspace_ll set that tests more of the functionality needed to run full audio pipelines in user-space. The test creates a pipeline with two components (IPC4 host and DAI copiers), does pipeline prepare, one copy cycle in prepared state and tears down the pipeline. One user-space thread is created to manage the pipelines. This would be equivalent to user IPC handler thread. Another user-space thread is created for the LL scheduler. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Place the pipeline position lookup table in the sysuser memory partition and replace k_spinlock with a dynamically allocated k_mutex when CONFIG_SOF_USERSPACE_LL is enabled. Spinlocks disable interrupts which is a privileged operation unavailable from user-mode threads. The mutex pointer is stored in a separate APP_SYSUSER_BSS variable outside the SHARED_DATA struct so Zephyr's kernel object tracking can recognize it for syscall verification. Move pipeline_posn_init() from task_main_start() to primary_core_init() before platform_init(), so the mutex is allocated before ipc_user_init() grants thread access to it. In pipeline_posn_get(), bypass the sof_get() kernel singleton and access the shared structure directly when running in user-space. Grant the ipc_user_init thread access to the pipeline position mutex via new pipeline_posn_grant_access() helper. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

If SOF is built with CONFIG_SOF_USERSPACE_LL, the IPC user handled will require access to coldrodata sections to initialize audio modules. This logic is not required for LLEXT modules, which have existing code to add access to coldrodata (and other sections). This commit is needed for builds where LLEXT is not used. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

This is a set of temporary changes to audio code to remove calls to privileged interfaces that are not mandatory to run simple audio tests. These need proper solutions to be able to run all use-cases in user LL version. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

Pull in Zephyr PR. Link: zephyrproject-rtos/zephyr#107341 Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

kv2019i · 2026-04-30T11:34:59Z

V17 pushed:

integrate two commits out of LL userspace ipc_msg_send() and send_resource_notif() syscalls and related changes #10725 -- third commit not yet pulled in as that causes test cases to fail and no root cause yet (some collateral damage when adding a new syscall)
refactored the user-space two-component test case to work better with the latest LL code in this branch, lot of temporary code in test case side can be dropped now
increase the heap allocation for userspace LL pipelines to enable running more complex test cases
delta to V16 https://github.com/thesofproject/sof/compare/25e27c9d5bea642cbaee296f86c4e4c085449f16..a22a9764c23b0676d0aefd051e385d4abbe6b90c
no rebase yet. there are a lot of conflicts as userspace: DP: application: switch to vregion #10702 was merged today. move to vregions will need more work, so a separate rebase V18 will be done next week

kv2019i force-pushed the feat/userspace-ll-wip branch from 9cdb1be to 37b0412 Compare March 9, 2026 17:07

kv2019i force-pushed the feat/userspace-ll-wip branch from 37b0412 to 7317b18 Compare March 17, 2026 18:29

kv2019i commented Mar 17, 2026

View reviewed changes

lyakh reviewed Mar 18, 2026

View reviewed changes

kv2019i force-pushed the feat/userspace-ll-wip branch from 7317b18 to c029d49 Compare March 27, 2026 13:37

kv2019i force-pushed the feat/userspace-ll-wip branch from c029d49 to 9c778e4 Compare March 30, 2026 17:09

kv2019i mentioned this pull request Mar 31, 2026

userspace: split ipc files into user and kernel features #10666

Merged

kv2019i force-pushed the feat/userspace-ll-wip branch from 9c778e4 to c4b127f Compare April 1, 2026 13:06

kv2019i force-pushed the feat/userspace-ll-wip branch from c4b127f to ad359d6 Compare April 1, 2026 14:36

kv2019i mentioned this pull request Apr 9, 2026

ipc4: replace fw_reg spinlock with mutex #10693

Merged

kv2019i force-pushed the feat/userspace-ll-wip branch from ad359d6 to c7e9a37 Compare April 10, 2026 11:48

kv2019i force-pushed the feat/userspace-ll-wip branch from c7e9a37 to 8af1be4 Compare April 10, 2026 12:04

kv2019i force-pushed the feat/userspace-ll-wip branch from aa5efe0 to 35a61b6 Compare April 15, 2026 11:58

kv2019i force-pushed the feat/userspace-ll-wip branch from 35a61b6 to 214c051 Compare April 15, 2026 13:03

kv2019i added 10 commits April 27, 2026 18:03

ipc: ipc-helper: trace context not used in user-space

ef92c30

No need to copy the trace context object to buffer object, when audio pipelines are running in user-space. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

(---section: IPC user support STOP)

ebd7ad8

This was referenced Apr 28, 2026

dma: dma_sg: allocate on specific heap #10729

Open

pipeline: protect component connections with a mutex #10730

Open

Add sof_sys_user_heap_get() and APP_SYSUSER_DATA/BSS macros #10732

Open

kv2019i and others added 15 commits April 30, 2026 13:38

(---section: START fixes for multipipeline tetss)

13f3d81

app: overlays: ptl: set CONFIG_SOF_ZEPHYR_LL_USER_HEAP_SIZE

982613b

Set CONFIG_SOF_ZEPHYR_LL_USER_HEAP_SIZE to 128kB in the LL user-space overlay. Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

(---section: STOP fixes for multipipeline tetss)

953f285

(---section: START IPC user notifications)

4cf9b47

(---section: STOP IPC user notifications)

0bd5c20

(---section test-case START)

15aac6c

(---section WIP mandatory changes START)

a722b7a

[DO NOT MERGE] zephyr.yml: use Zephyr PR107341

a22a976

Pull in Zephyr PR. Link: zephyrproject-rtos/zephyr#107341 Signed-off-by: Kai Vehmanen <kai.vehmanen@linux.intel.com>

kv2019i force-pushed the feat/userspace-ll-wip branch from 25e27c9 to a22a976 Compare April 30, 2026 11:28

Conversation

kv2019i commented Feb 19, 2026

Uh oh!

kv2019i commented Feb 19, 2026

Uh oh!

kv2019i commented Mar 9, 2026

Uh oh!

kv2019i commented Mar 17, 2026

Uh oh!

kv2019i commented Mar 17, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

lyakh left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

kv2019i commented Mar 27, 2026

Uh oh!

kv2019i commented Mar 27, 2026

Uh oh!

kv2019i commented Mar 30, 2026

Uh oh!

kv2019i commented Apr 1, 2026

Uh oh!

kv2019i commented Apr 1, 2026

Uh oh!

kv2019i commented Apr 10, 2026

Uh oh!

kv2019i commented Apr 10, 2026

Uh oh!

kv2019i commented Apr 14, 2026

Uh oh!

kv2019i commented Apr 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

kv2019i commented Apr 15, 2026

Uh oh!

kv2019i commented Apr 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

kv2019i commented Apr 15, 2026 •

edited

Loading