The house was built by George Warner in 1798. The house is shown on the Warner & Hanna's Plan of the City and Environs of Baltimore, 1801. The house is also linked to the underground railroad movement and George Washington. Washington sought assistance at the house after injuring his arm while riding in route from Baltimore to Alexandria. A statue of George Washington with his arm in a sling stood in the front yard for many years.

Originally built as a Villa in the Federal style, the house was later renovated in the 19th century, introducing several elements of the Victorian era. Much of the original architectural elements and design remain intact. The house and neighborhood of Ridgely's Delight are listed with the National Register and Maryland Historical Trust and Baltimore's historical districts.