尝试一下，

在关闭按钮(或)关闭表单事件中使用它

Try it,

use this in your Close Button (or) Form Closing Event

foreach(Form f in this.MdiChildren)
{
f.Close();
}