Physics-informed Embedding Network with Multi-Task Transformer for Auditory Signal Decoding

The proposed model was evaluated on the fMRI dataset we collected from healthy subjects. In the fMRI experiment, subjects were asked to imagine and listen to four categories auditory information (Human, Animal, Machine, Nature), and we obtained eight categories of auditory neural activity which would be classified to test the performance of our model.