A Neural Processing Unit-Accelerated Monocular Perception Pipeline for Remotely Operated Underwater Vehicle Station Keeping
Main Article Content
Abstract
Holding a stable viewpoint is a prerequisite for observation tasks performed by remotely operated underwater vehicles, yet it is difficult to achieve when the only sensor is a monocular camera and all computation must run on board. This work reports the deployment of a complete visual stationkeeping perception pipeline on a Qualcomm QCS8550 platform using its Hexagon HTP/NPU accelerator, in which two networks---an INT8 object detector and a dense monocular depth model---share a single accelerator. A per-stage latency breakdown shows that the throughput difference between an accelerated and a CPU-executed configuration is attributable to one stage: moving depth inference alone to the accelerator makes it 27 times faster and carries the pipeline from 0.46 to 8.47 frames per second, with depth inference still occupying two thirds of the frame budget afterwards and the accelerator occupied at least 69\% of wall-clock time. We document two deployment failure modes that are silent rather than loud: an output polarity that must be established empirically, and a normalisation choice that destroys the range signal. The two available range cues are combined by an analytic fusion rule---the square root of the tracked bounding box area and the depth output both vary inversely with distance, so the two are directly combinable once anchored on a reference captured at target selection, without training data or knowledge of the target dimensions. On the rigid targets evaluated here the zero-cost geometric term carries more of the distance signal than the depth network that consumes two thirds of the frame budget, and the two cues degrade unequally on immersion, which makes their relative weighting an operating parameter rather than a constant. Evaluation is open-loop; closed-loop validation was prevented by a degenerate thruster configuration.
Keywords
Embedded AI, ROV, NPU, Computer Vision
Article Details

This work is licensed under a Creative Commons Attribution 4.0 International License.
References
[2] J.-F. Lots, D. M. Lane, E. Trucco, and F. Chaumette, A 2-D visual servoing for underwater vehicle station keeping, in Proceedings 2001 IEEE International Conference on Robotics and Automation, Seoul, Korea, May 2001, vol. 3, pp. 2767–2772.
[3] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge, UK: Cambridge University Press, 2003.
[4] R. Ranftl, K. Lasinger, D. Hafner, K. Schindler, and V. Koltun, Towards robust monocular depth estimation: mixing datasets for zero-shot cross-dataset transfer, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, iss. 3, pp. 1623–1637, Mar. 2022. https://doi.org/10.1109/TPAMI.2020.3019967
[5] L. Yang, B. Kang, Z. Huang, Z. Zhao, X. Xu, J. Feng, and H. Zhao, Depth anything V2, Advances in Neural Information Processing
Systems, vol. 37, pp. 21875–21911, Dec. 2024. https://doi.org/10.52202/079017-0688
[6] H. Lin, S. Chen, J. Liew, D. Y. Chen, Z. Li, Y. Zhao, S. Peng, H. Guo, X. Zhou, G. Shi, J. Feng, and B. Kang, Depth Anything 3: Recovering the Visual Space from Any Views, in Processing International Conference on Learning Representations (ICLR),
Jan. 2026.
[7] R. Schettini and S. Corchs, Underwater image processing: state of the art of restoration and image enhancement methods, EURASIP J. Adv. Signal Process., vol. 2010, art. 746052, 2010.
[8] B. Yu, J. Wu, and M. J. Islam, UDepth: Fast monocular depth estimation for visually-guided underwater robots, in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), 2023.
[9] X. Wu, J. Wang, J. Wang, S. Rong, and B. He, “UMono: Physical-model-informed hybrid CNN–Transformer framework for underwater monocular depth estimation,” IEEE Journal of Oceanic Engineering, vol. 51, no. 1, pp. 780–793. 2026, doi: 10.1109/JOE.2025.3606045.
[10] D. Wofk, F. Ma, T.-J. Yang, S. Karaman, and V. Sze, FastDepth: Fast monocular depth estimation on embedded systems, in Proc. IEEE International Conference on Robotics and Automation (ICRA), 2019.
[11] N. Zhang, F. Nex, G. Vosselman, and N. Kerle, “Lite-Mono: A lightweight CNN and transformer architecture for self-supervised
monocular depth estimation,” in Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 18537–18546, doi: 10.1109/CVPR52729.2023.01778.
[12] B. Jacob, S. Kligys, B. Chen, M. Zhu, M. Tang, A. Howard, H. Adam, and D. Kalenichenko, Quantization and training of neural networks for efficient integer-arithmetic-only inference, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, 2018, pp. 2704-2713.
[13] G. Jocher, A. Chaurasia, and J. Qiu, YOLO by Ultralytics, Ultralytics, 2023. [Online]. Available: https://github.com/ultralytics/ultralytics
[14] C. -Y. Wang, A. Bochkovskiy and H. -Y. M. Liao, "YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors," 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 2023, pp. 7464-7475, doi: 10.1109/CVPR52729.2023.00721.
[15] A. Bewley, Z. Ge, L. Ott, F. Ramos, and B.Upcroft, Simple online and realtime tracking, in Proc. IEEE Int. Conf. Image Processing (ICIP), 2016, pp. 3464-3468.
[16] Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit
Steiner, Paul Tucker, Vijay Vasudevan, PeteWarden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng.
2016. TensorFlow: a system for large-scale machine learning. In Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation (OSDI’16). USENIX Association, USA, 265–283.
[17] TensorFlow Lite, Google. [Online]. Available: https://www.tensorflow.org/lite
[18] J. Yang, M.-Q. Le, M. Gong, and Y. Pu, “DUViN: Diffusion-based underwater visual navigation via knowledge-transferred depth features,” arXiv:2509.02983, 2025.
[19] S. Krupi´nski, G. Allibert, M.-D. Hua, and T. Hamel, “An inertial-aided homography-based visual servo control approach for (almost) fully actuated autonomous underwater vehicles,” IEEE Trans. Robotics, vol. 33, no. 5, pp. 1041–1060, 2017.
[20] K. J. A˚ stro¨m and B. Wittenmark, Computer- Controlled Systems: Theory and Design, 3rd ed. Upper Saddle River, NJ, USA: Prentice Hall, 1997.
[21] Lin, TY. et al. (2014). Microsoft COCO: Common Objects in Context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8693. Springer, Cham. https://doi.org/10.1007/978-3-319-10602-1_48.