A transformer-based network model for pitch detection
A transformer-based network model, pitch tracking for musical instruments.
The timbre of musical notes is the result of various combinations and transformations of harmonic relationships, harmonic strengths and weaknesses, instrument resonant peaks, and structural resonant peaks over time.
The online experience based on web audio and tensorflow.js, See the site here
1D value and 2D time transformer processed with sliding adjacent windows.
Specific feature extraction can be referred to in featureExtract.py
, and the model structure can be referred to in tuneNN.py
.
It utilizes the transformer-based tuneNN network model for abstract timbre modeling, supporting tuning for 12+ instrument types.