Fabdepth HMI is designed for hand gesture detection for Human Machine Interaction. It contains total of 8 gestures performed by 150 different individuals. These individuals range from toddlers to senior citizens which adds diversity in this dataset. These gestures are available in 3 different formats namely resized, foreground=-background separated and depth estimated images. Additional aspect is added in terms of video format of 150 samples. Researchers may choose their combination of data modalities based on their application.