The smallest unit of data in a computer is a bit. A bit, short for "binary digit," represents a single binary value, either 0 or 1. Bytes and larger units like kilobytes and megabytes are composed of multiple bits, with one byte consisting of 8 bits.