这很大程度上取决于您要处理的音乐内容-提取单声道录音的音高(即单个乐器或声音)与提取音调并不相同从复音混合中单个乐器的音高(例如，从复音录音中提取旋律的音高).

对于单音基音提取，您可以尝试在时域和频域中实现各种算法.几个示例包括Yin(时域)和HPS(频域)，有关这两者的更多详细信息的链接，请参见Wikipedia:

• http://en.wikipedia.org/wiki/Pitch_detection_algorithm

但是，如果您想从和弦材料中提取旋律，那么这两种方法都不会奏效.从和弦音乐中提取旋律仍然是一个研究问题，没有简单的步骤可循.研究社区提供了一些可供您试用的工具(尽管仅用于非商业用途)，即:

• MELODIA: http://mtg.upf.edu/technologies/melodia

最后一点，在合成输出时，我建议合成您提取的连续音高曲线(最简单的方法是每隔X ms(例如10)估算音高并合成变化的正弦波频率每10毫秒一次，以确保连续相位).这将使您的结果听起来更加自然，并且避免了将连续音高曲线量化为离散音符时所涉及的额外错误(这本身就是另一个问题).

I am creating a pitch detection program that extracts the fundamental frequency from the power spectrum obtained from the FFT of a frame. This is what I have so far:

• divide input audio signal into frames.
• multiply frame with a Hamming window
• compute the FFT and magnitude of the frame sqrt(real^2 + img^2)
• find the fundamental frequency (peak) by harmonic product spectrum
• convert the frequency of the peak (bin frequency) to note (e. g. ~440 Hz is A4)

Now the program produces an integer with value from 0 to 87 for each frame. Each integer corresponds to a piano note according to a formula I found here. I am now trying to imitate the melodies in the input signal by synthesizing sounds based on the calculated notes. I tried to simply generate a sine wave with magnitude and frequency corresponding to the fundamental frequency but the result sounded nothing like the original sound (almost sounded like random beeps).

I don't really understand music so based on what I have, can I generate a sound with melodies similar to the input (instrument, voice, instrument + voice) based on the information I get from the fundamental frequency? If not, what other ideas can I try using the code I currently have.

Thanks!

It depends greatly on the musical content you want to work with - extracting the pitch of a monophonic recording (i.e. single instrument or voice) is not the same as extracting the pitch of a single instrument from a polyphonic mixture (e.g. extracting the pitch of the melody from a polyphonic recording).

For monophonic pitch extraction there are various algorithm you could try to implement both in the time domain and frequency domain. A couple of examples include Yin (time domain) and HPS (frequency domain), link to further details on both are provided in wikipedia:

• http://en.wikipedia.org/wiki/Pitch_detection_algorithm

However, neither will work well if you want to extract the melody from polyphonic material. Melody extraction from polyphonic music is still a research problem, and there isn't a simple set of steps you can follow. There are some tools out there provided by the research community that you can try out (for non-commercial use only though), namely:

• MELODIA: http://mtg.upf.edu/technologies/melodia

As a final note, when synthesizing your output I'd recommend synthesizing the continuous pitch curve that you extract (the easiest way to do this is to estimate the pitch every X ms (e.g. 10) and synthesize a sine wave that changes frequency every 10 ms, ensuring continuous phase). This will make your result sound a lot more natural, and you avoid the extra error involved in quantizing a continuous pitch curve into discrete notes (which is another problem in its own).