Glycoconjugates are ubiquitous biomolecules found in all kingdoms of life. These diverse structures are metabolically responsive and occur in a cell line- and protein-specific manner, conferring tissue type–specific properties. Glycans have essential roles in diverse processes, including, for example, intercellular signaling, inflammation, protein quality control, glucohomeostasis and cellular adhesion as well as cell differentiation and proliferation. Many mysteries remain in the field, however, and uncovering the physiological roles of various glycans remains a key pursuit. Realizing this aim necessitates the ability to subtly and selectively manipulate the series of different glycoconjugates both in cells and in vivo. Selective small-molecule inhibitors of glycan processing enzymes hold great potential for such manipulation as well as for determining the function of 'orphan' carbohydrate-processing enzymes. In this review, we discuss recent advances and existing inhibitors, the prospects for small-molecule inhibitors and the challenges associated with generating high-quality chemical probes for these families of enzymes. The coordinated efforts of chemists, biochemists and biologists will be crucial for creating and characterizing inhibitors that are useful tools both for advancing a basic understanding of glycobiology in mammals as well as for validating new potential therapeutic targets within this burgeoning field.