What are the drawbacks of upgrading RAM?

generally there are no drawbacks to upgrading your ram (by upgrading I mean increasing the amount of ram in a computer) because it will increase the speed and performance of a computer the only drawback would be after fitting a certain amount of ram the computer speed/performance won't increase so it could be said it's a waste of money fitting more ram than is necessary