Why base two
A machine only has two states, so base two needs no translation. Decimal would have to be built out of bits, which is what binary already is.
Carrying works the same
Adding in binary carries when a column gets two, exactly as decimal carries at ten. The mechanics you know already apply.