The main pain point is in the "Distributed" aspect of any DVCS: you are cloning everything (the all history of all files)
Since binaries aren't stored in delta for most of them, and aren't compressed as well as text file, if you are storing rapidly evolving binaries, you end up quickly with a large repository which becomes much cumbersome to move around (push/pull).
For Git for instance, see What are the git limits?.
Binaries aren't a good fit for the feature a VCS can bring (diff, branch, merge), and are better managed in an artifact repository (like a Nexus for example).
This is not necessary the case for a CVCS (Centralized VCS) where the repository could play that role and be a storage for binaries (even if its not its primary role)
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…