We introduce VH-Diff, an antibody heavy chain variable domain diffusion model.This model is based on FrameDiff, a general protein backbone diffusion framework, which was fine-tuned on antibody structures. The backbone dihedral angles of sampled structures show good agreement with a reference antibody distribution.We use an antibody-specific inverse folding model to recover sequences corresponding to the predicted structures, and study their validity with an antibody numbering tool.Assessing the designability and novelty of the structures generated with our heavy chain model we find that VH-Diff produces highly designable structures that can contain novel binding regions.Finally, we compare our model with a state-of-the-art sequence-based generative model and show more consistent preservation of the conserved framework region with our structure-based method.