Vol. 23 No. 3 (2020) Cover Image
Vol. 23 No. 3 (2020)

Published: November 30, 2020

Pages: 277-288

Articles

3D Reconstruction Based on Fusing Active Structured Laser and Passive Stereo Techniques

Shahad A. Al-Saqal 1 Ali A. Al-Temeemy 2
1 Laser and Optoelectronics Eng. Dept., Al-Nahrain University, Baghdad-Iraq
2 Laser and Optoelectronics Eng. Dept., Al-Nahrain University, Baghdad-Iraq.
History
  • Received: February 13, 2020
  • Revised: April 24, 2020
  • Accepted: August 14, 2020
  • Available Online: November 24, 2020
DOI

https://doi.org/10.29194/NJES.23030277

Abstract

Three-dimensional reconstruction of real objects comprises capturing the appearance and the shape for these objects and determining the three-dimensional coordinates for their profiles. This reconstruction process can be accomplished either by using active or passive techniques. In this paper, a new fusion method is proposed for 3D reconstruction. This method exploits the advantages of both stereo-based passive and laser-based active techniques and overcomes their limitations to improve the performance of 3D reconstruction. With this method, a hybrid laser-based structured light scanning system is designed and implemented. This system captures the required information using passive and active techniques and uses the proposed fusion method for 3D reconstruction. The performance of the proposed method and its scanning system were experimentally evaluated. The evaluation results show high reconstruction performance for the proposed fusion method over the traditional 3D reconstruction techniques. The results also show the effectiveness of the hybrid laser scanning system and its ability to scan and reconstruct the shape and the appearance for real objects using the proposed fusion method.

Keywords

References

  1. A. A. Al-Temeemy, J. W. Spencer, "Chromatic methodology for laser detection and ranging (LADAR) image description," Optik - International Journal for Light and Electron Optics, Elsevier, Volume 126, Issue 23, Elsevier (2015), Pages 3894-3900, ISSN 0030-4026.
  2. A. A. Al-Temeemy and J. W. Spencer, "Laser radar invariant spatial chromatic image descriptor," SPIE- Opt. Eng., 53(12), 123109 (2014). doi:10.1117/1.OE.53.12.123109.
  3. S. Bai, J. Shi, Q. Ge, and Z. Tian, “Scanning-based 3D reconstruction of large-scale objects,” International Conference on Robotics, Intelligent Control and Artificial Intelligence (RICAI 2019). Association for Computing Machinery, New York, NY, USA, 2019.
  4. Y. Wei, Z. Ding, H. Huang, C. Yan, J. Huang, J. Leng, “A non-contact measurement method of ship block using image-based 3D reconstruction technology,” Ocean Engineering, Volume 178, Elsevier, 2019.
  5. S. Zhu, Z. Luo, Z. Zhende, Y. Gao, & N. Wu, “Construction of Three-Dimensional Crack Calculation Method for Transparent Rock-Like Materials Based on Stereo Vision Principle,” Advances in Civil Engineering, Hindawi Publishing Corporation, 2019.
  6. Y. Liu, H. Wang, C. Dong and Q. Chen, "A Car-Following Data Collecting Method Based on Binocular Stereo Vision," in IEEE Access, vol. 8, 2020.
  7. S. Chae and N. Kano, “Application of location information by stereo camera images to project progress monitoring,” Automation and Robotics in Construction - Proceedings of the 24th International Symposium on Automation and Robotics in Construction, 2007.
  8. M. H. Chiang, H. T. Lin, and C. L. Hou, “Development of a Stereo Vision Measurement System for a 3D Three-Axial Pneumatic Parallel Mechanism Robot Arm,” Sensors, 2011; 11(2):2257-2281.
  9. S. M. Grigorescu, T. T. Cocia, G. Maceanu, and F. Moldoveanu, “Stereo vision-based 3D camera pose and object structure estimation - An Application to Service Robotics,” In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, 2012.
  10. S. Barone, and A. Bruno, “Stereo Vision and Laser Stripers for Three-Dimensional Surface Measurements”, XVI Congreso Internacional De Ingeniería Gráfica, 2015.
  11. M.G. Guerra, C. Volpone, L.M. Galantucci, G. Percoco, “Photogrammetric measurements of 3D printed microfluidic devices,” Additive Manufacturing, Volume 21, Elsevier, 2018.
  12. D. Li, H. Zhang, Z. Song, D. Man, and M. W. Jones, “An Automatic Laser Scanning System for Accurate 3D Reconstruction of Indoor Scenes,” Proceedings of the 2017 IEEE, International Conference on Information and Automation (ICIA), Macau SAR, China, July 2017.
  13. L. He, S. Wu, and C. Wu, “Robust laser stripe extraction for three-dimensional reconstruction based on a cross-structured light sensor,” Applied Optics, Vol. 56, No. 4, February, 2017.
  14. T. Jia, Z. X. Zhou, and H. H. Gao, “Depth Measurement Based on Infrared Coded Structured Light,” Journal of Sensors, Hindawi Publishing Corporation, vol. 2014, Article ID 852621, 2014.
  15. J. Li, G. Liu, and Y. Liu, “A Dynamic Volume Measurement System with Structured Light Vision”, 31st Youth Academic Annual Conference of Chinese Association of Automation, IEEE, Wuhan, China, 2016.
  16. J. Davis and X. Chen, “A laser range scanner designed for minimum calibration complexity,” Proceedings of Third International Conference on 3-D Digital Imaging and Modeling, 2001.
  17. D. Li, B. Hui, S. Qiu, and G. Wen, “3D reconstruction with two webcams and a laser line projector,” Proc. SPIE 9282, 7th International Symposium on Advanced Optical Manufacturing and Testing Technologies: Optical Test and Measurement Technology and Equipment, 92821T (18 September 2014) doi: 10.1117/12.2068094.
  18. C. Liu, S. Ma, Q. Ma, and X. Zeng, “Stereo vision system based on the laser dot matrix projection,” Proc. SPIE 8197, 2011 International Conference on Optical Instruments and Technology: Optical Systems and Modern Optoelectronic Instruments, 819704 (17 November 2011); doi: 10.1117/12.906542.
  19. X. M. Xiong, C. J. Hua, C. J. Fang, Y. Chen, “Research on the 3D reconstruction method of the free-form surface based on the grid projection,” Proc. SPIE 10033, Eighth International Conference on Digital Image Processing (ICDIP 2016), 100333B (29 August 2016); doi: 10.1117/12.2248319.
  20. S. Á. Guðmundsson, H. Aanæs, and R. Larsen, “Fusion Of Stereo Vision And Time-Of-Flight Imaging For Improved 3d Estimation,” International Journal on Intelligent Systems Technologies and Applications (IJISTA), 2008.
  21. Y. M. Kim, C. Theobalt, J. Diebel, J. Kosecka, B. Miscusik, and S. Thrun, “Multi-View Image And Tof Sensor Fusion For Dense 3d Reconstruction,” IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Kyoto, 2009.
  22. G. M. Um, K. Y. Kim, C. H. Ahn, and K. H. Lee, "Three-Dimensional Scene Reconstruction Using Multiview Images And Depth Camera," Proc. SPIE 5664, Stereoscopic Displays and Virtual Reality Systems XII, 2005.
  23. J. Peng, W. Xu, B. Liang and A. Wu, “Pose Measurement and Motion Estimation of Space Non-Cooperative Targets Based on Laser Radar and Stereo-Vision Fusion,” IEEE Sensors Journal, vol. 19, no. 8, 2019.
  24. K. Park, S. Kim and K. Sohn, "High-Precision Depth Estimation Using Uncalibrated LiDAR and Stereo Fusion," IEEE Transactions on Intelligent Transportation Systems, 2019.
  25. O. Yilmaz and F. Karakus, "Stereo And Kinect Fusion For Continuous 3D Reconstruction And Visual Odometry," International Conference on Electronics, Computer and Computation (ICECCO), Ankara, 2013.
  26. Y. Yemez, C. J. Wetherilt, “A Volumetric Fusion Technique For Surface Reconstruction From Silhouettes And Range Data,” Computer Vision and Image Understanding, Elesvier, 2007.
  27. A. Pacheco, H. Bolívar, J. P. Espada, and R. G. Crespo, “Reconstruction Of High Resolution 3d Objects From Incomplete Images And 3d Information,” International Journal of Interactive Multimedia and Artificial Intelligence, 2014.
  28. D. Maurer, Y. C. Ju, M. Breuß, A. Bruhn, “Combining Shape from Shading and Stereo: A Variational Approach for the Joint Estimation of Depth, Illumination and Albedo”, In Proc. 27th British Machine Vision Conference, BMVC 2016, York, UK, September 2016 – R. Wilson, E. Hancock, W. Smith (Eds.), BMVA Press, Art. 76, 2016.
  29. E.Bylow, R. Maier, F. Kahl, and C. Olsson "Combining Depth Fusion and Photometric Stereo for Fine-Detailed 3D Models," (eds) Image Analysis. SCIA 2019. Lecture Notes in Computer Science, vol 11482. Springer, Cham, 2019.
  30. Aljoˇsa Oˇsep, “Multi-View 3D Reconstruction of Highly-Specular Objects”, Submitted to the Institute of Computer Science, Computer Graphics department, University of Bonn, Friedrich-Ebert-Allee 144, 53113 Bonn, march, 2013.
  31. Brian Curless, “3D Scanning, Acknowledgement: some content and figures”, Slide Player, 2015.
  32. P. Corke, “Robotics, Vision and Control,” Springer Tracts in Advanced Robotics Volume 118. 1st ed., Springer-Verlag Berlin Heidelberg, 2011.
  33. T. Moons, L. V. Gool, and M. Vergauwen, “3D Reconstruction from Multiple Images Part 1: Principles,” Foundations and Trends in Computer Graphics and Vision, Vol. 4, No. 4 (2008) 287–398, 2009.
  34. R. Pisapia, “Disparity map extraction for a low cost 3D sensor”, Master Thesis in Computer Engineering, Faculty of Engineering, 2015-16.
  35. S. Barone, P. Neri, A. Paoli, A. V. Razionale, “Flexible calibration of a stereo vision system by active display,” Procedia Manufacturing, Volume 38, Elsevier, 2019.
  36. T. Li, C. Liu, Y. Liu, T. Wang, D. Yang, “Binocular stereo vision calibration based on alternate adjustment algorithm,” Optik, Volume 173, Elsevier, 2018.
  37. J. Forest and Collado, “New Methods For Triangulation-Based Shape Acquisition Using Laser Scanners,” PhD thesis, University of Girona, Department of Electronics, Information and Automation, Girona, 2004.
  38. B. Cyganek and J. P. Siebert, “An Introduction To 3D Computer Vision Techniques And Algorithms,” Wiley, 1st edition, 2009.
  39. T. Ewbank, “Efficient and precise stereoscopic vision for humanoid robots”, thesis submitted for the Master’s degree in Computer Science Engineering, UNIVERSITY OF LIÈGE, Faculty of Applied Sciences, 2017.
  40. Morris and J. Anne, "Design of an Active Stereo Vision 3D Scene Reconstruction System Based on the Linear Position Sensor Module", Master's Thesis, University of Tennessee, Knoxville, 2006.
  41. X. Sun, Y. Jiang, Y. Ji, W. Fu, S. Yan, Q. Chen, B. Yu, and X. Gan, “Distance Measurement System Based on Binocular Stereo Vision,” IOP Conference Series: Earth and Environmental Science, Volume 252, Issue 5, 2019.
  42. A. Zaarane, I. Slimani, W. Al Okaishi, I. Atouf, A. Hamdoun, “Distance measurement system for autonomous vehicles using stereo camera,” Array, Volume 5, Elsevier, 2020.
  43. Y. Xue, T. Jia, W. Li, X. Yuan and D. Chen, "An improved method of depth measurement based on line laser," 2018 Chinese Control and Decision Conference (CCDC), Shenyang, IEEE, 2018.
  44. Y. Liu, H. Wang, and Q. Chen, “A Real-Time Car-Following Data Collecting Method Based on Binocular Stereo Vision,” CICTP 2019: 19th COTA International Conference of Transportation Professionals in China-Connecting the World, 2019.
  45. M. A. Isa, D. Sims-Waterhouse, S. Piano, and R. Leach, “Volumetric error modelling of a stereo vision system for error correction in photogrammetric three-dimensional coordinate metrology”, Precision Engineering, Elsevier, 2020.