No! The government is encouraging the construction of granny flats in most areas via Complying Development Applications.
Under Complying Development, approvals can be obtained as quickly as ten working days (if your property meets the criteria for Complying Development).
If your property is unsuitable for Complying Development then a Development Application can be lodged with your local council.
