The ability of a chemical or physical agent to have an adverse effect on the health of an ecosystem, by damaging individual species and/ or changing the structure and function of the ecosystem.