2nd WEAR Dataset Challenge
@HASCA 2025

Quick Links:

Overview

Goal of the Challenge

The 2nd WEAR Dataset Challenge is a Human Activity Recognition prediction challenge based on the inertial data of the WEAR dataset. The challenge will be again part of the HASCA Workshop at UbiComp/ ISWC 2025.

This year's challenge will be all about robustness and generalization! We curated a new test dataset with four new participants. But there is a twist! This year we only provide you with random, sensor-specific 1-second sliding windows of each of the four test participants. Oh yeah, and we applied some random augmentations to the data that can occur due to different wearing conditions. This means that you will have to rely on your model's ability to generalize to new participants and deal with the noise and uncertainty that comes with real-world data.

More details can be found on the Kaggle Challenge website.

WEAR Challenge now on Kaggle!

We are happy to announce that the WEAR Challenge is now also available on Kaggle! You can find the challenge here. Unlike the first iteration of the challenge, submission of prediction results will only be done via Kaggle. By switching to Kaggle we hope to make the challenge more accessible to a wider audience and provide a more streamlined submission process. By using Kaggle's public and private leaderboard we hope to provide a more transparent and fair ranking process. Challenge participants will further be able to discuss the challenge and share their solutions on the Kaggle platform.

IMPORTANT DISCLAIMER

To be part of the final ranking and eligible for prices, participants will be required to submit a technical report to the HASCA workshop. The paper should contain technical description of the processing pipeline, the algorithms and the results achieved using the original WEAR dataset. An example of a technical report can be found here winners of last year's challenge. Submissions must follow the HASCA format (see below for more details).

Important Dates

  • Registration open: April 8, 2025
  • Challenge duration: April 8, 2025 - July 04, 2025
  • HASCA-WEAR paper submission: July 04, 2025 AoE
  • HASCA-WEAR review notification: July 14, 2025
  • HASCA-WEAR camera ready submission: July 30, 2025
  • HASCA Workshop: October 12-13, 2025 in Espoo, Finland

Final Ranking at Conference & Prizes

We will announce winners of the challenge at the HASCA workshop. In order to be eligible for prizes and be part of the final ranking announced at the conference, participants need to tell us when submitting their technical report, which submission on Kaggle is their final submission. Prizes will be awarded to the three teams with the highest private leaderboard score at the time of the paper submission deadline.

About the WEAR Dataset

The WEAR dataset is an outdoor sports dataset for inertial- and video-based human activity recognition (HAR). The dataset comprises data from 22 participants performing a total of 18 different workout activities with untrimmed inertial (acceleration) and egocentric video data recorded at 11 different outside locations. WEAR provides a challenging prediction scenario marked by purposely introduced activity variations as well as an overall small information overlap across modalities. This challenge focuses on the inertial data only.


Challenge Data Download

Please visit the Kaggle challenge page to download the training and test data. The training data is provided as a directory containing the CSV files of the 22 participants. The test data is provided as a single CSV file with each row representing one of the sliding windows of the 4 new participants, which are to be predicted. For more details please refer to the Data section on Kaggle.


Evaluation

Evaluation of submissions will be based on the macro F1-score. The macro F1-score is the average of the F1-scores of each activity class.


Submission Guidelines

Submission of Final Predictions:

Submission of the predictions will happen solely via Kaggle. All details on the submission format and final submissions can be found on Kaggle.

The final ranking of the WEAR Dataset challenge will be announced at the HASCA workhop. Ranking of the teams, which will be eligible for prizes, will be determined based on the private leaderboard score as of the technical report submission deadline.
When submitting their technical report, participants will need to:

  • tell us their team name as specified on Kaggle, and
  • tell us which submission on Kaggle is going to be their submission used for ranking.
NOTE: If authors do not tell us specifically which solution is to be used, we will use their latest submission as of the paper submission deadline.

Prizes will be awarded to the three teams with the highest private leaderboard score at the time of the paper submission deadline.

Submission of Technical Report:

Submission of the technical report will happen via PCS (select SIGCHI / UbiComp 2025 / UbiComp 2025 Workshop - HASCA-WEAR). Your technical report should detail your solution as well as provide preliminary results you achieved on the train dataset. ACM requires UbiComp/ISWC 2025 workshop submissions to use the double-column template. Your technical report must be between 3 to 6 pages including references. Submissions do not need to be anonymous. For details on the template please refer to the UbiComp/ISWC website. For an example of a technical report please refer to the winners of last year's challenge.

Challenge Rules

  • You do not work in or collaborate with the WEAR dataset project (http://mariusbock.github.io/wear/)
  • If you submit an entry, but are not qualified to enter the contest, this entry is voluntary. The organizers reserve the right to evaluate it for scientific purposes. If you are not qualified to submit a contest entry and still choose to submit one, under no circumstances will such entries qualify for sponsored prizes.
  • To be part of the final ranking, participants will be required to publish a technical report in the proceedings of the HASCA workshop (see above for details). Publishing of the paper also requires that at least one team member is registered for the HASCA workshop.
  • Submission of each team's final predictions will happen via Kaggle. Only one single submission is allowed per team. The same person cannot be in multiple teams, except if that person is a supervisor.
  • The final ranking of teams eligible for prizes, will be determined based on the private leaderboard score as of the technical report submission deadline. When submitting their technical report, participants need to tell organizers their team name as specified on Kaggle, and which submission on Kaggle is going to be their submission used for ranking. If authors do not tell us specifically which solution is to be used, we will use their latest submission as of the paper submission deadline.
  • Prizes will be awarded to the three teams with the highest private leaderboard score at the time of the paper submission deadline.


Contact

If you have any questions feel free to contact me via e-mail or use the discussion forum on Kaggle.

Organizing Comittee

Marius Bock, University of Siegen
Christina Runkel, University of Cambridge
Dr. Alexander Hoelzemann, University of Colorado Boulder
Dr. Mathias Ciliberto, University of Cambridge
Prof. Dr. Kristof Van Laerhoven, University of Siegen
Prof. Dr. Michael Moeller, University of Siegen

License

WEAR is offered under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. You are free to use, copy, and redistribute the material for non-commercial purposes provided you give appropriate credit, provide a link to the license, and indicate if changes were made. If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. You may not use the material for commercial purposes.