English (United Kingdom)

https://curated-unify.zendy.io/wp-json/zendy-region/v1/featured_content/oa?rat=en

https://curated-unify.zendy.io/wp-json/zendy-region/v1/highlighted_journal/

Global: Zendy Plus annual

Presents the access of premium content as premium feature

Premium Content

Presents the keyphrase highlighting as premium feature

Keyphrase Highlighting

Presents the summarisation as premium feature

Summarisation

Insights

Presents the pdf analysis as premium feature

PDF Analysis

Presents the zaia usage as premium feature

ZAIA

Global: Zendy Plus monthly

Global: Zendy Tools annual

Global: Zendy Tools monthly

Global: Zendy Free Plan

In recent times, there has been a growing interest in developing effectiveperception techniques for combining information from multiple modalities. Thisinvolves aligning features obtained from diverse sources to enable moreefficient training with larger datasets and constraints, as well as leveragingthe wealth of information contained in each modality. 2D and 3D Human PoseEstimation (HPE) are two critical perceptual tasks in computer vision, whichhave numerous downstream applications, such as Action Recognition,Human-Computer Interaction, Object tracking, etc. Yet, there are limitedinstances where the correlation between Image and 2D/3D human pose has beenclearly researched using a contrastive paradigm. In this paper, we proposeUniHPE, a unified Human Pose Estimation pipeline, which aligns features fromall three modalities, i.e., 2D human pose estimation, lifting-based andimage-based 3D human pose estimation, in the same pipeline. To align more thantwo modalities at the same time, we propose a novel singular value basedcontrastive learning loss, which better aligns different modalities and furtherboosts the performance. In our evaluation, UniHPE achieves remarkableperformance metrics: MPJPE $50.5$mm on the Human3.6M dataset and PAMPJPE$51.6$mm on the 3DPW dataset. Our proposed method holds immense potential toadvance the field of computer vision and contribute to various applications.

UniHPE: Towards Unified Human Pose Estimation via Contrastive Learning