Arteries and veins form in a stepwise process that combines vasculogenesis and sprouting angiogenesis. Despite extensive data on the mechanisms governing blood vessel assembly at the single-cell level, little is known about how collective cell migration contributes to the organization of the balanced distribution between arteries and veins. Here, we use an endothelial-specific zebrafish reporter, arteriobow, to label small cohorts of arterial cells and trace their progeny from early vasculogenesis throughout arteriovenous remodeling. We reveal that the genesis of arteries and veins relies on the coordination of 10 types of collective cell dynamics. Within these behavioral categories, we identify a heterogeneity of collective cell motion specific to either arterial or venous remodeling. Using pharmacological blockade, we further show that cell-intrinsic Notch signaling and cell-extrinsic blood flow act as regulators in maintaining the heterogeneity of collective endothelial cell behavior, which, in turn, instructs the future territory of arteriovenous remodeling.