Atsushi Shimizu

Genome-wide association study of social isolation in 63,497 Japanese individuals from the general population

Hisashi Ohseto, Kosuke Inoue, Ippei Takahashi, Taku Obara et autres

Social isolation, characterized by a lack of social connections with family, friends, and others, is associated with adverse health outcomes. However, the genetic contribution to the susceptibility to social isolation remains unclear. This study aimed to identify genetic loci associated with social …

jp (code pays fourni par la source)

Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers

Atsushi Shimizu, Shohei Taniguchi, Yutaka Matsuo

Length generalization is the ability of language models to maintain performance on inputs longer than those seen during pretraining. In this work, we introduce a simple yet powerful position encoding (PE) strategy, Random Float Sampling (RFS), that generalizes well to lengths unseen …

Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers

Atsushi Shimizu, Shohei Taniguchi, Yutaka Matsuo

Length generalization is the ability of language models to maintain performance on inputs longer than those seen during pretraining. In this work, we introduce a simple yet powerful position encoding (PE) strategy, Random Float Sampling (RFS), that generalizes well to lengths unseen …