swinv2-base-patch4-window8-.../README.md

3 lines
424 B
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# swinv2-base-patch4-window8-256_a13571599987503104680343
Swin Transformer v2 引入了三项主要改进1结合余弦注意力的残差后规范化方法以提高训练的稳定性2对数间隔连续位置偏置方法有效地将使用低分辨率图像预训练的模型迁移到高分辨率输入的下游任务中3一种自监督预训练方法SimMIM以减少对大量标记图像的需求。