Contact and support
Need help, have a question, or want to contact the ResearchHub team?
© 2026 ResearchHub. Built for responsible scholarly connection.
Privacy-aware community infrastructureResearch graph
References from SeqPE: Transformer With Sequential Position Encoding. Local targets link to admitted publications; unresolved targets remain external evidence.
The Falcon series of open language models
2023 · External reference
10.18653/v1/2022.findings-emnlp.323
10.18653/v1/2022.findings-emnlp.323 · External reference
Language models are few-shot learners
2020 · External reference
CLEX: Continuous length extrapolation for large language models
2024 · External reference
Neural ordinary differential equations
2018 · External reference
Extending context window of large language models via positional interpolation
2023 · External reference
10.5555/3524938.3525087
10.5555/3524938.3525087 · External reference
Emu3.5: Native multimodal models are world learners
2025 · External reference
10.48550/arxiv.1810.04805
10.48550/arxiv.1810.04805 · External reference
An image is worth 16 x16 words: Transformers for image recognition at scale
2021 · External reference
ViTAR: Vision transformer with any resolution
2024 · External reference
10.18653/v1/2021.emnlp-main.552
10.18653/v1/2021.emnlp-main.552 · External reference
Convolutional sequence to sequence learning
2017 · External reference
10.1109/cvpr52729.2023.01457
10.1109/cvpr52729.2023.01457 · External reference
10.5555/3495724.3497510
10.5555/3495724.3497510 · External reference
10.1038/s41586-025-09422-z
10.1038/s41586-025-09422-z · External reference
10.18653/v1/2022.findings-emnlp.99
10.18653/v1/2022.findings-emnlp.99 · External reference
10.1109/cvpr42600.2020.00975
10.1109/cvpr42600.2020.00975 · External reference
DeBERTa: Decoding-enhanced BERT with disentangled attention
2020 · External reference
10.1007/978-3-031-72684-2_17
10.1007/978-3-031-72684-2_17 · External reference
RULER: What’s the real context size of your long-context language models
2024 · External reference
Fourier position embedding: Enhancing attention’s periodic extension for length generalization
2024 · External reference
10.18653/v1/2020.findings-emnlp.298
10.18653/v1/2020.findings-emnlp.298 · External reference
10.18653/v1/d17-1215
10.18653/v1/d17-1215 · External reference
10.52202/075280-1082
10.52202/075280-1082 · External reference
Rethinking positional encoding in language pre-training
2020 · External reference
10.1145/3600006.3613165
10.1145/3600006.3613165 · External reference
10.2307/j.ctt4cgmcn.5
10.2307/j.ctt4cgmcn.5 · External reference
10.1007/978-3-031-20077-9_17
10.1007/978-3-031-20077-9_17 · External reference
10.1007/978-3-319-10602-1_48
10.1007/978-3-319-10602-1_48 · External reference
Learning to encode position for transformer with continuous dynamical model
2020 · External reference
10.1109/iccv48922.2021.00986
10.1109/iccv48922.2021.00986 · External reference
Base of rope bounds context length
2024 · External reference
LieRE: Generalizing rotary position encodings
2024 · External reference
10.52202/079017-0970
10.52202/079017-0970 · External reference
YaRN: Efficient context window extension of large language models
2024 · External reference
Train short, test long: Attention with linear biases enables input length extrapolation
2021 · External reference
Learning transferable visual models from natural language supervision
2021 · External reference
Language models are unsupervised multitask learners
2019 · External reference
Exploring the limits of transfer learning with a unified text-to-text transformer
2020 · External reference
10.18653/v1/d16-1264
10.18653/v1/d16-1264 · External reference
10.1109/cvpr52729.2023.01952
10.1109/cvpr52729.2023.01952 · External reference
10.18653/v1/2023.acl-short.161
10.18653/v1/2023.acl-short.161 · External reference
10.1007/s11263-015-0816-y
10.1007/s11263-015-0816-y · External reference
10.18653/v1/n18-2074
10.18653/v1/n18-2074 · External reference
10.1109/iccv51701.2025.00009
10.1109/iccv51701.2025.00009 · External reference
10.1016/j.neucom.2023.127063
10.1016/j.neucom.2023.127063 · External reference
Training data-efficient image transformers & distillation through attention
2021 · External reference
Llama 2: Open foundation and fine-tuned chat models
2023 · External reference
Neural discrete representation learning
2017 · External reference
10.48550/arxiv.1706.03762
10.48550/arxiv.1706.03762 · External reference
Encoding word order in complex embeddings
2019 · External reference
10.18653/v1/2025.acl-industry.6
10.18653/v1/2025.acl-industry.6 · External reference
Qwen3 technical report
2025 · External reference
10.52202/085713-2150
10.52202/085713-2150 · External reference
10.18653/v1/2024.findings-emnlp.582
10.18653/v1/2024.findings-emnlp.582 · External reference
10.52202/079017-2000
10.52202/079017-2000 · External reference
Transfusion: Predict the next token and diffuse images with one multi-modal model
2025 · External reference
PoSE: Efficient context window extension of LLMS via positional skip-wise training
2024 · External reference
