Abstract: Artificial intelligence (AI) provides an alternative way to design channel coding with affordable complexity. However, most existing studies can only learn codes for a given size and rate, ...

Implementation of "Breaking the Low-Rank Dilemma of Linear Attention" The Softmax attention mechanism in Transformer models is notoriously computationally expensive, particularly due to its quadratic ...

Abstract: We present in this paper on how we can replace the multipliers with basic operations like shifting and addition in the linear convolution method considering ease of implementation, making it ...

Don't be Dense, SLiCE the Cost! Structured Linear Controlled Differential Equations (SLiCEs) are a new class of sequence models that combine the maximal expressivity (i.e., universality) of dense, ...