I am not so sure about that. You instantly join the small group of users that do not use NTP.
Know about the leap second already?
Why did they about implementing NTP in the first place?
Why did all operating systems bother installing it by default?
What are the consequences of the clock drift that will inevitably result from this?
How much does a usual hardware clock drift per day, month, etc?
How much does defect hardware clock drift per day, month, etc?
Yeah, maybe a giant nag screen to ask the user once to check its system clock and relying from then on hardware clock only may work. But as I know users, they don’t care about defect hardware clocks that are far off. We need to be really careful with decisions as this one. Can’t act on assumptions.