It's tricky when you live in a significantly old house. The pressure is strong to live in a museum, and while that may appeal to some, it may not suit others. I think any decorative scheme that respects the aged fabric of a structure, while acknowledging more current ideals, is acceptable. Your trim wasn't changed. Nor was your original wall fabric. Beyond that--hell, decorate as the current era's taste requires. As long as what you do can be reversed to the original ideal that pertains to the history of the structure, it is acceptable. Houses are a sort of living, evolving thing. They reflect the changes in humanity and society.