The 30-year fixed rate mortgage declined to 6.61%, the most since 1981, after nearly 10 weeks of increases.