Mustily.
Having a moldy odor; stale.
She shall bring the fresh air of the forest into these musty halls! – Lucky Pehr by August Strindberg
The book was there, its pages still musty from the moist air at sea. – The Moghul by Thomas Hoover