The term used for the maximum rate of growth of a population in an ecological system is called biological capacity or biotic potential. This concept describes how quickly a species can reproduce under ideal conditions, with no limiting factors such as resource scarcity or disease. Understanding this potential is crucial in studying population dynamics and ecosystem management.