6d pose estimation of a object in realtime using aruco tags and if the finger points towards the plane it should change its colour.
Libraries:
- tensorflow 2.8.0
- tensorflow hub 0.12.0
- pyrealsense2
- opencv-contrib - python ( Aruco comes inbuilt)
- aruco
- numpy
Files
- model.tflite
- test.yaml ( to access the calibration params)
- red_img.jpg
- white_img.png
How to run: Run the pointing_finger.py after installing all the libraries in a virtual atmosphere. The file is a well documented and commented script having functions.
Here is the working video of the implementation.
project_vid.1.1.mp4
Important links: Pretrained model https://tfhub.dev/google/lite-model/movenet/singlepose/lightning/3 ARuco documentation https://docs.opencv.org/4.x/d5/dae/tutorial_aruco_detection.html
"# pointing_finger_project"