Robotics @ I3D Back

Projects / Industrial Collaborations

  • eXtended Reality CoBot controller for Manufacturing Processes, DST, Govt of India (2023-2025, Rs 50L)
  • Hackathon for rehabilitation of severely disabled young adults, India-EU ICT Standardisation Collaboration Project (€20,000, 2022)
  • Heterogenous Multi-Agent Coordination, TCS Innovation Lab (2023-2025, Rs 50L)
  • Multimodal CoBot, Department of Heavy Industries, Common Engineering Facility Centre (CEFC) (2019-2020, Rs 10L)
  • ERP MTech Student on Extended Reality based Digital Twin of Arc Welding from Forvia (Faurecia, 2021-23)
  • PhD Fellowship from TCS Research
  • PhD Fellowship from Siemens
  • PhD Fellowship from Bosch
  • ERP PhD student on Investigating Human Robot Interaction in MicroGravity from ISRO Satellite Development Centre (2023-26)
  • PhD Student Fellowships at Robert Bosch Centre of Cyber Physical Systems and ARTPARK (2019, 2020, 2024)
  • Internships at Intel Network Robotics Lab (2024)


Our robotics research started with developing  human robot interface for users with disabilities but recently investigated 3D reconstruction, river design and motion planning. Our gaze controlled robotic manipulator is continuously used at Vidyasagar (Spastic Society of India, Tamil Nadu) during past four years. We developed novel 3D reconstruction algorithm using Gaussian Splatting and also designed a novel rover platform as part of our BTIRC project. We compared multiple prediction models for target prediction during human robot handover. In summary, we published one ACM THRI paper, 4 ICRA papers, 3 RoMAN papers and one paper at ICSR and ICAR during past 4 years.

Key Achievements


  • Development and Deployment of eye gaze controlled robot at the Vidyasagar (Spastic Society of India, Tamil Nadu), Media Coverage
  • Developed and published on multimodal tele-robotics systems for welding and component assembly processes for Industry 4.0
  • Developed and patented a Collaborative Robot for Healthcare
  • Developed and published on imitation learning based hand trajectory prediction for human robot interaction
  • Winner of Toycathon 2022, Physical Edition, Inclusive Play for Divyang (Disabled Kids), out of more than 600 teams, an inter-ministerial initiative organized by Ministry of Education Innovation Cell with support from All India Council for Technical Education, Ministry of Women and Child Development, Ministry of Commerce and Industry, Ministry of MSME, Ministry of Textiles and Ministry of Information and Broadcasting
  • Part of IISc demonstration team for Indian Mobile Congress 2023, 2024 and 2025
  • Finalist (Top 10) in TigerLaunch 2022, Singapore region, out of the 45 teams
  • Finalist (Top 15) in Robot Design Competition, International Conference on Social Robotics 2021, Singapore, out of 59 teams


    • Sample Codes

    This section links to source codes to control a simple 2 DoF robotic arm using a Unity Program.


    Video Demonstrations


    Publications

    • M Mitra, G Kumar, PP Chakrabarti, P Biswas, Investigating Inverse Reinforcement Learning during Rapid Aiming Movement in Extended Reality and Human-Robot Interaction, ACM Transactions on Human-Robot Interaction (2025)
    • N Talwar, H Prasad, A Pena-Rios, P Biswas, Walking Trajectory Prediction using Signal Processing & Machine Learning Based Models, 10th IEEE International Conference on Advanced Robotics and Mechatronics (ARM 25)
    • M Mitra, S Soni, G Maskale, PP Chakrabarti, P Biswas, Fast and Accurate: Rapid Human-Robot Handover for Collaborative Assembly and Disassembly, 10th IEEE International Conference on Advanced Robotics and Mechatronics (ARM 25)
    • M Mitra, G Kumar, PP Chakraborty, P Biswas, Enhanced Human-Robot Collaboration with Intent Prediction using Deep Inverse Reinforcement Learning, IEEE International Conference on Robotics and Automation (ICRA 24)
    • Himanshu Vishwakarma, Ananyan Sampath, Pradipta Biswas, Immersive Teleoperation of Collaborative Robot for Remote Vital Monitoring In Healthcare, IEEE International Conference on Robot and Human Interactive Communication (Ro-MAN) 2024
    • Ajay Kumar Sandula, Rajatsurya M, Debasish Ghose, Pradipta Biswas, Human on The Loop Demand Aware Robot Scheduling: A Mixed Reality Based User Study, IEEE International Conference on Robot and Human Interactive Communication (Ro-MAN) 2024
    • AK Sandula, S Damodaran, S Nagaraj, D Ghose, P Biswas, 3D Reconstruction via Camera-Lidar (2D) Fusion for Mobile Robots: A Gaussian Splatting Approach, IEEE International Conference on Robotics and Automation (ICRA 25)
    • Y Sinha, S Bhattacharya, YK Sahu, P Biswas, Blind Tactile Exploration for Surface Reconstruction, IEEE International Conference on Robotics and Automation (ICRA 25)
    • Himanshu , M Mitra, VK Sharma, J Sulthan, A Atulkar, D Bhathad, P Biswas, Unlocking Potential: Gaze-Based Interfaces in Assistive Robotics for SSMI Users, IEEE International Conference on Robotics and Automation (ICRA 25)
    • Y Sinha, S Shanmugam. YK Sahu, A Mukhopadhyay, P Biswas, Diffuse Your Data Blues: Augmenting Low-Resource Datasets via User-Assisted Diffusion, ACM International Conference on Intelligent User Interfaces (IUI 25)
    • M Mitra, Y Sinha, A Khokhar, S Jinkala, P Biswas, LMD-FISH: Language Model Driven - Framework for Intelligent Scheduling of Heterogenous Systems, ACM International Conference on Intelligent User Interfaces (IUI 25)
    • S Saren, R Mariyappan, P Dey, D Ghose, P Biswas, Studying Human Modality Preferences in a Human-Drone Framework, Journal of Multimodal User Interface(JMUI 25), Springer
    • V Natarajan, M Mitra, A Baxi, R Chattopadhyay, M Haghighipanah, V Mageshkumar, G Murthy, P Biswas, Y Sinha, Zone-MAPF: An efficient and scalable zone-based path planner for edge-centric robot fleets, International Conference on Robotics and Artificial Intelligence (ICRAI 2025)
    • AK Sandula, A Khokhar, D Ghose, P Biswas, Demand-Aware Multi-Robot Task Scheduling with Mixed Reality Simulation. IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) 2023
    • VK Sharma, LRD Murthy, and P Biswas, Comparing two safe distance maintenance algorithms for a gaze controlled HRI involving users with SSMI, ACM Transactions on Accessible Computing 2022
    • VK Sharma, LRD Murthy and P Biswas, Enabling Learning through Play for Persons with speech and motor impairment: Inclusive and Eye-Gaze Controlled Human-Robot Interface for interaction with Joystick operated generic Toys, International Conference on Social Robotics (ICSR) 2022
    • Himanshu, Shubham Farate, VK Sharma, Pradipta Biswas, A System for Determining At Least One Medical Parameter of a Subject, Patent No.: 481398
    • AMC Rao, S. Raj, AK Shah, Harshitha BR, NR Talwar, VK Sharma, Sanjana M, H Vishvakarma, Development and comparison studies of XR interfaces for path definition in remote welding scenarios, Multimedia Tools and Applications 2023, Springer
    • S. Saren, A. Mukhopadhyay, D. Ghose, P. Biswas, Comparing alternative modalities in the context of multimodal human-robot interaction, Journal on Multimodal User Interfaces 2023, Springer
    • VK Sharma, KPS Saluja, V Mollyn and P Biswas, Eye Gaze Controlled Robotic Arm for Persons with Severe Speech and Motor Impairment, ACM International Conference on Eye Tracking Research and Applications (ETRA) 2020
    • VK Sharma and P. Biswas, Gaze Controlled Safe HRI for Users with SSMI, IEEE RAS International Conference on Advanced Robotics Systems (ICAR) 2021
    • PT Gaikwad, A Mukhopadhyay, A Muraleedharan, M Mitra and P Biswas, Developing A Computer Vision based System for Autonomous Taxiing of Aircraft, Aviation, Taylor & Francis 2023
    • A Mukhopadhyay, VK Sharma, PG Tatyarao, AK Shah, AMC Rao, PR Subin, P Biswas, A comparison study between XR interfaces for driver assistance in take over request, Transportation Engineering (11), 2023, 100159, Elsevier
    • VK Sharma, KPS Saluja, LRD Murthy, G Sharma and P Biswas, Webcam Controlled Robotic Arm for Persons with SSMI, Technology and Disability 32 (3), IOS Press 2020
    • M Mitra, AA Patil, GVS Mothish, G Kumar, A Mukhopadhyay, Murthy LRD, PP Chakraborty, P Biswas, Multimodal Target Prediction for Rapid Human-Robot Interaction, ACM International Conference on Intelligent User Interfaces (IUI 24)
    • A Muraleedharan, Anamika JH, H Vishwakarma, K Kashyap, P Biswas, Eye-Gaze-Enabled Assistive Robotic Stamp Printing System for Individuals with Severe Speech and Motor Impairment, ACM International Conference on Intelligent User Interfaces (IUI 24)
    • A. Mukhopadhyay, V. K. Sharma, P. T. Gaikwad, A. K. Sandula, and P. Biswas, Exploring the Use of XR Interfaces for Driver Assistance in Take Over Request, ACM Automotive UI (AutoUI) 2022
    • A.K. Sandula, P. Biswas, A. Khokhar & D. Ghose, Multi-armed bandit approach for task scheduling of a fixed-base robot in the warehouse, Artificial Intelligence for Robotics and Autonomous Systems, Springer 2023
    • AK Sandula, P Biswas, A Khokhar, D Ghose, Virtual obstacle avoidance & heterogeneous multi-robot coordination in mixed reality with a human in the loop. In 2023 IEEE International Conference on Robotics and Automation (ICRA Video Submission) 2023
    • H Vishwakarma, VK Sharma, P Biswas, A Collaborative Robot for Safe and Remote Monitoring of Vitals in a Healthcare Setup, In 2023 IEEE International Conference on Robotics and Automation (ICRA Video Submission) 2023
    • S Saren, D Ghose, P Biswas, Exploring Multimodal Input Modalities for Robot Control, In 2023 IEEE International Conference on Robotics and Automation (ICRA Video Submission) 2023
    • S Raj, T Adhithiyan, A Chakrabarti, P Biswas, Augmented Reality and Deep Learning-Based System for Assisting Assembly Process, In 2023 IEEE International Conference on Robotics and Automation (ICRA Video Submission) 2023
    • VK Sharma, LRD Murthy, P Biswas, Gaze Controlled Robotic Systems for Users with Severe Speech and Motor Impairment (SSMI), In 2023 IEEE International Conference on Robotics and Automation (ICRA Video Submission) 2023
    • A Rao M C, S Raj, P Biswas, Immersive Welding Assistant, In 2023 IEEE International Conference on Robotics and Automation (ICRA Video Submission) 2023