Rusty chimney caps are a sign of a deteriorating chimney system. If left alone, they will erode a pre-fabricated firebox to the point where I can no longer be used.
Look up at church Chimney if you see rust or anything that doesn’t look right, have us come out for a free inspection...