diff options
| author | Jason A. Donenfeld <Jason@zx2c4.com> | 2024-09-22 03:45:29 +0200 |
|---|---|---|
| committer | Gopher Robot <gobot@golang.org> | 2024-09-28 01:07:09 +0000 |
| commit | eb6f2c24cd17c0ca1df7e343f8d9187eef7d6e13 (patch) | |
| tree | d76c58100622eb5d33e3ffc451dd726a3dd898bd /src/runtime/sys_linux_ppc64x.s | |
| parent | 677b6cc17544e5e667d4bb67d063f5d775c69e32 (diff) | |
| download | go-eb6f2c24cd17c0ca1df7e343f8d9187eef7d6e13.tar.xz | |
runtime: use vDSO for getrandom() on linux
Linux 6.11 supports calling getrandom() from the vDSO. It operates on a
thread-local opaque state allocated with mmap using flags specified by
the vDSO.
Opaque states are allocated in chunks, ideally ncpu at a time as a hint,
rounding up to as many fit in a complete page. On first use, a state is
assigned to an m, which owns that state, until the m exits, at which
point it is given back to the pool.
Performance appears to be quite good:
│ sec/op │ sec/op vs base │
Read/4-16 222.45n ± 3% 27.13n ± 6% -87.80% (p=0.000 n=10)
│ B/s │ B/s vs base │
Read/4-16 17.15Mi ± 3% 140.61Mi ± 6% +719.82% (p=0.000 n=10)
Fixes #69577.
Change-Id: Ib6f44e8f2f3940c94d970eaada0eb566ec297dc7
Reviewed-on: https://go-review.googlesource.com/c/go/+/614835
Reviewed-by: Filippo Valsorda <filippo@golang.org>
Reviewed-by: Cuong Manh Le <cuong.manhle.vn@gmail.com>
Auto-Submit: Jason Donenfeld <Jason@zx2c4.com>
Reviewed-by: Paul Murphy <murp@ibm.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: David Chase <drchase@google.com>
Reviewed-by: Michael Pratt <mpratt@google.com>
Diffstat (limited to 'src/runtime/sys_linux_ppc64x.s')
| -rw-r--r-- | src/runtime/sys_linux_ppc64x.s | 50 |
1 files changed, 50 insertions, 0 deletions
diff --git a/src/runtime/sys_linux_ppc64x.s b/src/runtime/sys_linux_ppc64x.s index ba4988b723..8735b932ed 100644 --- a/src/runtime/sys_linux_ppc64x.s +++ b/src/runtime/sys_linux_ppc64x.s @@ -757,3 +757,53 @@ TEXT runtime·socket(SB),$0-20 MOVD R0, 0(R0) // unimplemented, only needed for android; declared in stubs_linux.go MOVW R0, ret+16(FP) // for vet RET + +// func vgetrandom1(buf *byte, length uintptr, flags uint32, state uintptr, stateSize uintptr) int +TEXT runtime·vgetrandom1<ABIInternal>(SB),NOSPLIT,$16-48 + MOVD R1, R15 + + MOVD runtime·vdsoGetrandomSym(SB), R12 + MOVD R12, CTR + MOVD g_m(g), R21 + + MOVD m_vdsoPC(R21), R22 + MOVD R22, 32(R1) + MOVD m_vdsoSP(R21), R22 + MOVD R22, 40(R1) + MOVD LR, m_vdsoPC(R21) + MOVD $buf-FIXED_FRAME(FP), R22 + MOVD R22, m_vdsoSP(R21) + + RLDICR $0, R1, $59, R1 + + MOVBZ runtime·iscgo(SB), R22 + CMP R22, $0 + BNE nosaveg + MOVD m_gsignal(R21), R22 + CMP R22, $0 + BEQ nosaveg + CMP R22, g + BEQ nosaveg + MOVD (g_stack+stack_lo)(R22), R22 + MOVD g, (R22) + + BL (CTR) + + MOVD $0, (R22) + JMP restore + +nosaveg: + BL (CTR) + +restore: + MOVD $0, R0 + MOVD R15, R1 + MOVD 40(R1), R22 + MOVD R22, m_vdsoSP(R21) + MOVD 32(R1), R22 + MOVD R22, m_vdsoPC(R21) + + BVC out + NEG R3, R3 +out: + RET |