Manufacturing Back

We are developing an interactive sensor dashboard and multimodal CoBot for supporting Industry 4.0 initiative. We are investigating different visualization techniques of sensor reading in 2D and 3D environment. Presently we are implementing and deploying a 3D sensor dashboard for BT offices in India. The multimodal CoBot allows to control a robotic manipulator through multiple modalities like eye gaze, gesture and speech.

Earlier we also developed image processing algorithms for automated inspection of rubber sheet for a shoe making MSME and Printed Circuit Boards (PCB) for detecting correct orientation and type of IC chips using webcam and shape detection algorithms. We have developed a prototype system using a Kinect that can detect bad leaning posture by measuring the difference between the neck-spine and hip-spine joints in the skeleton figure of Kinect. Following RULA guidelines, it raises an alert when the neck or torso is inclined more than 60 ͦ.

Main Results

  • We have evaluated shape detection algorithms in different lighting conditions (indoor, outdoor, and controlled light source) and best shape detection result is obtained in YCbCr color space using bounding box shape descriptors for 2500 Lux using LED.


  • A. Mukhopadhay, I. Mukherjee and P. Biswas, Comparing Shape Descriptor Methods for Different Colour Space and Lighting Conditions, Artificial Intelligence in Engineering Design and Manufacturing, Cambridge University Press 33 (4) 2019
  • V. K. Sharma and P. Biswas, System for Operating Joystick Indian Patent Application no. 201941044740
  • P. Biswas, S. Roy, G. Prabhakar, J. Rajesh, S. Arjun, M. Arora, B. Gurumoorthy and A. Chakrabarti, Interactive Sensor Visualization for Smart Manufacturing System, Proceedings of the 31st British Human Computer Interaction Conference 2017 (British HCI 17)
  • A. Mukhopadhyay, LRD Murthy, M. Arora, A. Chakrabarti, I. Mukherjee and P. Biswas, PCB Inspection in the context of Smart Manufacturing, International Conference on Research into Design (ICoRD 2019)
  • LRD Murthy, Somnath Arjun, Kamalpreet Singh Saluja, Pradipta Biswas, Smart Sensor Dashboard, 7th International Conference on PLMSS (Product Life Cycle Modelling, Simulation and Synthesis) 2019,
  • K. Puneeth, A. Sahay, G, Shreya, P. Biswas, M. Arora, A. Chakrabarti, Designing an Affordable System for Early Defect Detection Using Image Processing, Advances in Manufacturing Technology XXXIII: Proceedings of the 17th International Conference on Manufacturing Research, incorporating the 34th National Conference on Manufacturing Research, 2019