The Handball Action Dataset includes 751 videos capturing seven distinct handball actions: passing, shooting, jump-shot, dribbling, running, crossing, and defense. These videos were manually extract from handball practice sessions recorded with stationary GoPro cameras. The recordings, provide in full HD resolution (1920 × 1080) at over 30 frames per second, offer a detail view of each action.