Interconnecting with the UBShmTransport Based on the LD/ST Shared Memory Semantics. by zchuango · Pull Request #3290 · apache/brpc

zchuango · 2026-05-09T12:00:03Z

What problem does this PR solve?

Problem Summary:
After recent efforts, the UB-Ring framework has been successfully integrated with the BRPC transport framework. Currently, high-performance and low-latency communication based on the load/store (LD/ST) semantics is supported. I feel happy be able to contribute this to the community and look forward to receiving feedback and reviews. @wwbmmm @chenBright

What is changed and the side effects?

Changed:

The ubring framework is added. This framework implements low-latency data communication based on the shared memory LD/ST semantics.
Currently, the ubring framework supports two modes: POSIX IPC shared memory and ubs-mem remote shared memory.
The ub_shm_type parameter is used to control whether to use the IPC or ubs-mem capability. Currently, ubs-mem can run on the Kunpeng 950 supernode that supports the ub protocol.
Side effects:

Performance effects: NAN
Breaking backward compatibility:

Check List:

Please make sure your changes are compilable.
When providing us with a new feature, it is best to add related tests.
Please follow Contributor Covenant Code of Conduct.

wwbmmm · 2026-05-10T02:30:31Z

+#include "brpc/transport.h"
+
+namespace brpc {
+    class UBShmTransport : public Transport {


class no need to indent

Okay, I'll fix it. By the way, does the current brpc project have a standard formatting file like .clang-format? @wwbmmm

There's no standard formatting file like .clang-format, just following the existing code style.

Copilot

Pull request overview

Adds a new UBRing-based shared-memory transport mode to brpc (IPC + optional ubs-mem backend) and wires it into the Socket/Transport framework, along with docs and a performance example.

Changes:

Introduce UBRing transport (SOCKET_MODE_UBRING) with endpoint handshake, polling, and ring manager infrastructure.
Add shared-memory backend abstraction (POSIX IPC + ubs-mem via dlopen’d SDK stubs/headers) plus timer utilities.
Update build/docs/examples to expose the feature and provide a basic performance harness.

Reviewed changes

Copilot reviewed 43 out of 43 changed files in this pull request and generated 15 comments.

Show a summary per file

File	Description
src/brpc/ubshm/ubs_mem/ubshmem_stub.cpp	Adds stub implementations of ubs-mem APIs for non-ubs environments/UT.
src/brpc/ubshm/ubs_mem/ubs_mem.h	Introduces ubs-mem C API header used by the UBS backend integration.
src/brpc/ubshm/ubs_mem/ubs_mem_def.h	Defines ubs-mem types/constants used by the UBS backend integration.
src/brpc/ubshm/ubs_mem/declare_shm_ubs.h	Declares the dynamically loaded ubs-mem function pointer table.
src/brpc/ubshm/ubr_trx.h	Defines core UBR transaction structures and states.
src/brpc/ubshm/ubr_msg.h	Defines UBR message chunk format used by the ring transport.
src/brpc/ubshm/ub_ring.h	Declares UBRing read/write and lifecycle APIs used by the endpoint.
src/brpc/ubshm/ub_ring_manager.h	Declares global manager for UBR transactions and link bookkeeping.
src/brpc/ubshm/ub_ring_manager.cpp	Implements UBR transaction manager and UB event callback plumbing.
src/brpc/ubshm/ub_helper.h	Declares UBRing global init/availability helpers.
src/brpc/ubshm/ub_helper.cpp	Implements global init/fini, availability flags, and polling init.
src/brpc/ubshm/ub_endpoint.h	Declares UB shared-memory endpoint and polling infrastructure.
src/brpc/ubshm/ub_endpoint.cpp	Implements handshake, polling loop, and I/O integration with Socket/InputMessenger.
src/brpc/ubshm/timer/timer_mgr.h	Declares timer module used by UBS cleanup/recovery flows.
src/brpc/ubshm/timer/timer_mgr.cpp	Implements epoll/kqueue-based timer dispatch for UBRing subsystems.
src/brpc/ubshm/shm/shm_ubs.h	Declares UBS backend shared-memory operations.
src/brpc/ubshm/shm/shm_ubs.cpp	Implements UBS backend via dynamically loaded ubs-mem SDK.
src/brpc/ubshm/shm/shm_mgr.h	Declares backend-agnostic SHM manager interface.
src/brpc/ubshm/shm/shm_mgr.cpp	Implements SHM manager selecting IPC vs UBS backend via flag.
src/brpc/ubshm/shm/shm_ipc.h	Declares POSIX IPC SHM backend operations.
src/brpc/ubshm/shm/shm_ipc.cpp	Implements POSIX IPC SHM backend operations.
src/brpc/ubshm/shm/shm_def.h	Adds SHM structs/constants used across SHM backends and UBRing.
src/brpc/ubshm/common/thread_lock.h	Adds RAII-style mutex/spin/rwlock/semaphore guard macros.
src/brpc/ubshm/common/common.h	Adds common macros/types/constants used throughout UBRing code.
src/brpc/ubshm_transport.h	Declares `UBShmTransport` implementing the Transport interface.
src/brpc/ubshm_transport.cpp	Implements transport selection between UBRing and TCP fallback paths.
src/brpc/transport_factory.cpp	Wires `SOCKET_MODE_UBRING` into transport creation/context init.
src/brpc/socket.h	Adds UB endpoint/connect friend declarations for Socket integration.
src/brpc/socket_mode.h	Adds `SOCKET_MODE_UBRING` enum value.
src/brpc/rdma_transport.cpp	Adjusts RDMA transport’s TCP fallback member initialization (currently broken).
src/brpc/input_messenger.h	Adds UB endpoint friend declaration to support message processing hooks.
src/brpc/input_messenger.cpp	Extends RDMA-special message queuing behavior to UBRing sockets.
src/brpc/controller.h	Guards `latency_us()` against unset begin time.
README.md	Adds docs link for UBRing.
README_cn.md	Adds docs link for UBRing (CN).
example/ubring_performance/test.proto	Adds proto for UBRing performance test example.
example/ubring_performance/server.cpp	Adds UBRing-capable perf test server example.
example/ubring_performance/client.cpp	Adds UBRing-capable perf test client example.
example/ubring_performance/CMakeLists.txt	Adds standalone CMake build for the performance example.
docs/en/ubring.md	Documents build/run/configuration and backend selection for UBRing.
docs/cn/ubring.md	Chinese documentation for UBRing build/run/configuration.
CMakeLists.txt	Adds `WITH_UBRING` option and compile definition wiring.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

chenBright · 2026-05-11T02:27:49Z

+
+UBRing 支持两种共享内存后端，通过 `ub_shm_type` 参数控制：
+
+### 1. POSIX IPC 共享内存 (ub\_shm\_type = 1)


Does POSIX IPC shared memory depend on UB?

POSIX IPC does not depend on the UB protocol. It only relies on the OS's shared memory (shm) mechanism. The IPC shm is primarily used to verify whether the ubring process running normally. Remote shared memory is only activated when ub_shm_type = 2, it requires the UB protocol's ubs-mem (obmm) framework.

Can IPC shm be used in an environment without UB?

it's right, u can build the example/ubring_performance demo, just running it for test

yanglimingcn · 2026-05-11T08:46:05Z

+    g_last_time.store(0, butil::memory_order_relaxed);
+
+    brpc::ServerOptions options;
+    options.socket_mode = FLAGS_use_ubring? brpc::SOCKET_MODE_UBRING : brpc::SOCKET_MODE_TCP;


brpc::ServerOptions socket_mode default use tcp mode is better。

it reference example/rdma_performance code style，switching to the default TCP mode also works fine.

yanglimingcn · 2026-05-11T09:09:17Z

+            return -1;
+        }
+        ubring::GlobalUBInitializeOrDie();
+        if (!ubring::InitPollingModeWithTag(bthread_self_tag())) {


Does ubring only support polling mode?

Yes. The LD/ST shared memory has this limitation. Currently, only the polling mode is supported. The time waiting mode requires the support of the OS kernel or hardware.

yanglimingcn · 2026-05-11T09:55:14Z

+
+### 2. UBS-Mem 远端共享内存 (ub\_shm\_type = 2)
+
+此模式使用 ubs-mem（Unified Block Storage Memory），这是来自 openEuler 的开源远端共享内存框架。它支持机架内节点之间的共享内存通信，类似于 RDMA 但部署要求更简单。


Can you list the libraries that need to be used?

Okay, I'll list the depends libraries later

zchuango · 2026-05-13T09:59:44Z

The related comments code has been modified. Please check and review it again. @wwbmmm @chenBright @yanglimingcn

zchuango added 21 commits May 9, 2026 19:48

add ubring transport

3cd5904

fix the bug for ub ring transport

0934567

fix the bug for ub ring transport and other

c52fe36

add the license for ub transport

37f8747

Modifying the variable naming style

350c305

optimize the log message and some field name

aa2a2f9

fix some bug for ubring

fd91351

add some log ubring endpoint

5998401

add todo

e64f65c

fix the bug for handshake for ub endpoint

d8c5e72

fix the bug for client ub endpoint

312dafd

optimize the iobuf file code

9002081

modify the log level

e86b9ae

fix the declare_shm_ubs define not found bug

6c9ba54

add the timer_mgr support for macos and format code style

102058c

fix the bug for macos epoll

7050c53

fix the timespece bug

8dacabe

adaptor the itimerspec for macos platform

e1459d1

optimize the cmakelist config

620b6e5

add the ubring docs for ubring transport

e85ed8b

modify some file name and directory structure

b1cdb99

wwbmmm requested a review from Copilot May 10, 2026 02:27

Copilot started reviewing on behalf of wwbmmm May 10, 2026 02:27 View session

wwbmmm reviewed May 10, 2026

View reviewed changes

Copilot AI reviewed May 10, 2026

View reviewed changes

chenBright reviewed May 11, 2026

View reviewed changes

yanglimingcn reviewed May 11, 2026

View reviewed changes

modify some code style and optimize code logical

6df15ac


		UBRing 支持两种共享内存后端，通过 `ub_shm_type` 参数控制：

		### 1. POSIX IPC 共享内存 (ub\_shm\_type = 1)


		### 2. UBS-Mem 远端共享内存 (ub\_shm\_type = 2)

		此模式使用 ubs-mem（Unified Block Storage Memory），这是来自 openEuler 的开源远端共享内存框架。它支持机架内节点之间的共享内存通信，类似于 RDMA 但部署要求更简单。

Conversation

zchuango commented May 9, 2026

What problem does this PR solve?

What is changed and the side effects?

Check List:

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

zchuango May 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

zchuango commented May 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

zchuango May 11, 2026 •

edited

Loading