As soon as your existing garments start to feel too tight, probably from about 12 weeks.
Normally it is advised that you buy your maternity wear in the size you are pre pregnancy if your bump is the only area where you have changed shape. However, if you are eating more than normal and have changed size on your hips and around your bust be realistic and buy the next size up.