Yes, you will need to complete the registration transfer and pay the applicable fee to Service NSW within 14 days of the delivery of your car. This fee is $34 at the time of writing.
Please note that stamp duty will also be payable as a separate charge.
For more information about registration transfer, visit the Service NSW website: http://service.nsw.gov.au/transaction/transfer-vehicle-registration