Belkacem, Oussama Ben HajDinis, Rui2026-03-042026-03-042025-11-282169-3536PURE: 155776234PURE UUID: 43e9d898-aa9d-45a2-83f9-7dbfd2a77b47Scopus: 105023196397ORCID: /0000-0002-8520-7267/work/207431601http://hdl.handle.net/10362/200947Funding information: This work was supported by Fundação para a Ciência e a Tecnologia (FCT), I.P., and when eligible, co-funded by EU funds under Project UID/50008/2025 and through the Instituto de Telecomunicações as well as the HORIZON-MSCA-2022-PF-01 under Grant YAHYA-6G 101109435. Publisher Copyright: © 2013 IEEE.In this work, we present a novel precoder design for multiuser massive multiple input multiple output (MU-mMIMO) systems impaired by nonlinear effects at the transmitter. By exploiting the rate splitting multiple access (RSMA) technique for user messages, we develop an analytical precoding framework based on the multilinear generalized singular value (ML-GSVD) decompositions for two or more matrices. This framework provides a robust statistical characterization of transmitted signals and enables accurate performance evaluation of precoding techniques in the presence of nonlinearities. Moreover, we introduce an iterative GSVD distortion cancellation (GSVD-DC) receiver for scenarios with strong nonlinear effects. Numerical results demonstrate that the proposed approach achieves substantial improvements in bit error rate (BER) compared to conventional precoders, for both linear and nonlinear cases, with moderate complexity increase, and without relying on successive interference cancellation (SIC). This makes the GSVD-DC receiver a promising solution for efficient and robust communications in nonlinear environments.171364409enghigh power amplifiers (HPA)multilinear generalized singular value decomposition (ML-GSVD)non orthogonal multiple access (NOMA)nonlinear distortion (NL)orthogonal frequency division multiplexing (OFDM)Rate-splitting multiple access (RSMA)General Computer ScienceGeneral Materials ScienceGeneral Engineeringjournal article10.1109/ACCESS.2025.3638959https://www.scopus.com/pages/publications/105023196397