The downsides will be no accessories like leather seats, fog lamps, navigation, alloy wheels, chroming etc
MT or CVT is just a choice. If you like manual then why not go for it. If you like the accessories then you can get them aftermarket
Just remember that MT will have worst resale