The mathematical foundation of the gauge theory is built up systematically. The H-valued differential form bundle is constructed on the Hilbert manifold and the exterior covariant differentiation is defined on the H-valued differential form bundle. The connection form and the curvature form are introduced by means of the exterior covariant differentiation. The structure equation and the Bianchi identity are derived.