Fertility Rates vs Infant Mortality Rates

The activity in the Geography Course had me go to this website, arcgis.com. One of the prompts of the geography course activity instructs to look at the infant mortality rates of different countries and then to look at the fertility rates. Then one of the prompts asks me to consider the relation between fertility rates and infant mortality rates. The answer the activity sheet gives is that “higher infant mortality rates correspond to high fertility rates.” This makes sense when you look at Africa which seems to have both a high fertility rate and a high infant mortality rate.
The textbook of the course makes the claim that a fertility rate above 2.1 means the population is increasing. My question, is this a “ceteris paribus” assumption? If a country in Africa has a high fertility rate but also a similar or equally high infant mortality rate is the population static?