I'm doing a task where I need to work with healthcare data from a few different sources. For example, one is an audio signal recording while another is biometric signal reading such as ECG.
Both of these will be available for each patient, and we are trying to do some machine learning classification to do some predictive diagnosis. In fact, we have created a multiclass classifier model of the audio signal, as well as the ECG data.
Now, we are trying to combine the two signals modalities into one single, better model. What would be the best approach for this kind of problem? We are researching multimodal ML algorithms but would like to get a feel of what is the best way to go about creating this model.