Research overview

Design of deep learning models

Techniques to denoise the Hyperspectral Images.

Hyperspectral Images (HSI) capture data across multiple spectral bands and are widely used in real-world applications such as remote sensing, agriculture, and marine monitoring. However, practical use is often hindered by challenges such as sensor noise, high storage requirements, and limited availability of labeled data. My research focuses on developing deep learning-based solutions to address these challenges. To enhance HSI denoising, I proposed UNFOLD, a novel method combining a 3D Transformer-based encoder, a 3D U-Net, and a 3D CNN-based decoder. This architecture captures long-range dependencies, preserves structural integrity, and enhances local details, leading to significant improvements in denoising performance. Additionally, I introduced VISIONARY, a spatial-spectral attention mechanism that jointly analyzes spatial and spectral domains. This approach adapts to the unique characteristics of HSI, delivering more effective noise reduction. To overcome the challenge of limited training data, I developed REATTAIN, which integrates supervised contrastive learning, data augmentation, and HSI inpainting to enhance feature learning and improve model generalization. Furthermore, I am currently exploring non-linear dimensionality reduction techniques to reduce data redundancy by leveraging the inherent sparsity in HSI, optimizing storage without compromising data integrity. Through these innovations, my work aims to advance the capabilities of hyperspectral imaging, making it more practical and effective for real-world applications.

Academic Research

Spatio-Spectral Analysis of Hyperspectral Images

    Hyperspectral Image (HSI) Compression using Deep Learning Techniques

    Supervisor: Dr. Puneet Gupta

    Duration: Jul. 2024 - Ongoing

    • Currently exploring non-linear dimensionality reduction techniques (e.g., LLE, ISOMAP) to mitigate data redundancy in HSI by leveraging data sparsity.
    • Actively working on preserving spectral and spatial relationships in compressed HSI through advanced dimensionality reduction methods.

    Spatial-Spectral Attention based Hyperspectral Image Denoising

    Supervisor: Dr. Puneet Gupta

    Duration: Dec. 2023 - Jun. 2024

    • Developed a novel plug-and-play Transformer block for HSI denoising, blending a sequence of Global Feature Aggregations (GFAs) to enhance feature representation through a data-driven approach.
    • Designed the SSCformer model to sequentially combine attention from spatial, spectral, and spatial-spectral domains, incorporating weightage parameters for enhanced flexibility in HSI denoising.

    Supervised Contrastive Learning based Hyperspectral Image Denoising

    Supervisor: Dr. Puneet Gupta

    Duration: Jun. 2023 - Nov. 2023

    • Mitigated the problem of data scarcity by utilizing Contrastive Learning techniques.
    • Explored the feasibility of Inpainting because it enhances dataset diversity and feature learning for better denoising results.

    Hyperspectral Image (HSI) Denoising using Deep Learning

    Supervisor: Dr. Puneet Gupta

    Duration: Nov. 2022 - May. 2023

    • Proposed a novel HSI denoising method combining 3-D U-Net, 3-D CNN, and 3-D Transformer to leverage the strengths of each technique.
    • Utilized a 3-D Transformer-based encoder for capturing long-range dependencies, a 3-D U-Net for preserving structural integrity, and a 3-D CNN-based decoder for local detail preservation.

Academic Projects

Other areas of interest in computer vision and machine learning.

    Real-time Face Mask Detection using Computer Vision

    Supervisor: Prof. Surya Prakash

    Duration: Aug. 2022 - Nov. 2022

    • Implemented a CNN model for mask detection.
    • Developed a user interface (UI) to interact with the mask detection model.

    Image-to-Image Transformation using VAE and GAN

    Supervisor: Prof. Sukhendu Das

    Duration: Sep. 2021 - Nov. 2021

    • Trained an image-to-image translation model to convert high-quality images into low-quality images while preserving the same spatial dimensions, and vice versa.

    Invisibility Cloak Using opencv-based technique

    Supervisor: Yogesh Sharma

    Duration: Mar. 2019 - May 2020

    • Captured and stored background frames, and detected red-colored cloth using color detection and segmentation algorithms.
    • Segmented out the red-colored cloth by generating a mask to create the invisibility effect.
    • Demo Video