2
$\begingroup$

I am starting to work on a supervised Machine Learning project. The way it has been approached by someone else previously seems unusual to me and I am trying to be sure of whether their methodology is incorrect/correct

Project Background

We have data on 50 subjects with movement disorders. Along with the subjects' demographic/physiological info as features, we also have access to kinematic data from when they used an exoskeleton. Each subject performed 20 targeted movements using an exoskeleton arm, and for each movement, they received a score stating how "smooth" the motion was. Here, "smoothness" can be used as measure of the level of movement impairment. These 20 movements did not follow the same order/pattern for everyone, and the targets on the screen were randomly assigned to a different location after each movement.

We are trying to use this data to try to predict the subjects' scores in a motor functional test 1 month after these exoskeleton trials (so it's a regression problem).

I would have approached this as a Supervised ML problem with 50 data points and along with the demographic/physiological info as features, I would have also used summary statistics on the 20 movements as additional features. And then I would have run linear/non-linear algorithms to see what model performs best.

However, the person who worked before me on this project did something very different. They used each movement itself as a data-point. So instead of 50, they had 1000 data-points and were able to use slightly more data-hungry algorithms like neural networks. So for this method, there were 20 almost identical data-points produced from each subject, where the only difference between the 20 points was the feature that indicated the "smoothness" score of that particular movement. This feels like an unusual approach to me. But I am not sure if it is indeed violating any of the principles of machine learning. If anyone could offer more insight into this method and why it is correct/incorrect, that would be very helpful

$\endgroup$

1 Answer 1

1
$\begingroup$

Without fully understanding the design, I think you can get meaningful results from analysis of 1000 observations. But you must recognize that the confidence you place in the analysis is more proportional to the number of subjects (50). If you want to compute uncertainty intervals for any quantity you'll need to inform an analysis of the specifics of data clustering, which is easy to do with regression models (GEE, random effects, spatial correlation correlation models).

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.