El Paso County Sheriff's deputies have charged two men with arson, burglary and conspiracy in connection with a fire that destroyed a town hall in a small town just west of Manitou Springs.