Proceedings of the 6th China High Resolution Earth Observation Conference (CHREOC 2019) [1st ed.] 9789811539466, 9789811539473

Citation preview

Lecture Notes in Electrical Engineering 657

Liheng Wang Yirong Wu Jianya Gong   Editors

Proceedings of the 6th China High Resolution Earth Observation Conference (CHREOC 2019)

Lecture Notes in Electrical Engineering Volume 657

Series Editors Leopoldo Angrisani, Department of Electrical and Information Technologies Engineering, University of Napoli Federico II, Naples, Italy Marco Arteaga, Departament de Control y Robótica, Universidad Nacional Autónoma de México, Coyoacán, Mexico Bijaya Ketan Panigrahi, Electrical Engineering, Indian Institute of Technology Delhi, New Delhi, Delhi, India Samarjit Chakraborty, Fakultät für Elektrotechnik und Informationstechnik, TU München, Munich, Germany Jiming Chen, Zhejiang University, Hangzhou, Zhejiang, China Shanben Chen, Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai, China Tan Kay Chen, Department of Electrical and Computer Engineering, National University of Singapore, Singapore, Singapore Rüdiger Dillmann, Humanoids and Intelligent Systems Laboratory, Karlsruhe Institute for Technology, Karlsruhe, Germany Haibin Duan, Beijing University of Aeronautics and Astronautics, Beijing, China Gianluigi Ferrari, Università di Parma, Parma, Italy Manuel Ferre, Centre for Automation and Robotics CAR (UPM-CSIC), Universidad Politécnica de Madrid, Madrid, Spain Sandra Hirche, Department of Electrical Engineering and Information Science, Technische Universität München, Munich, Germany Faryar Jabbari, Department of Mechanical and Aerospace Engineering, University of California, Irvine, CA, USA Limin Jia, State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University, Beijing, China Janusz Kacprzyk, Systems Research Institute, Polish Academy of Sciences, Warsaw, Poland Alaa Khamis, German University in Egypt El Tagamoa El Khames, New Cairo City, Egypt Torsten Kroeger, Stanford University, Stanford, CA, USA Qilian Liang, Department of Electrical Engineering, University of Texas at Arlington, Arlington, TX, USA Ferran Martín, Departament d’Enginyeria Electrònica, Universitat Autònoma de Barcelona, Bellaterra, Barcelona, Spain Tan Cher Ming, College of Engineering, Nanyang Technological University, Singapore, Singapore Wolfgang Minker, Institute of Information Technology, University of Ulm, Ulm, Germany Pradeep Misra, Department of Electrical Engineering, Wright State University, Dayton, OH, USA Sebastian Möller, Quality and Usability Laboratory, TU Berlin, Berlin, Germany Subhas Mukhopadhyay, School of Engineering & Advanced Technology, Massey University, Palmerston North, Manawatu-Wanganui, New Zealand Cun-Zheng Ning, Electrical Engineering, Arizona State University, Tempe, AZ, USA Toyoaki Nishida, Graduate School of Informatics, Kyoto University, Kyoto, Japan Federica Pascucci, Dipartimento di Ingegneria, Università degli Studi “Roma Tre”, Rome, Italy Yong Qin, State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University, Beijing, China Gan Woon Seng, School of Electrical & Electronic Engineering, Nanyang Technological University, Singapore, Singapore Joachim Speidel, Institute of Telecommunications, Universität Stuttgart, Stuttgart, Germany Germano Veiga, Campus da FEUP, INESC Porto, Porto, Portugal Haitao Wu, Academy of Opto-electronics, Chinese Academy of Sciences, Beijing, China Junjie James Zhang, Charlotte, NC, USA

The book series Lecture Notes in Electrical Engineering (LNEE) publishes the latest developments in Electrical Engineering—quickly, informally and in high quality. While original research reported in proceedings and monographs has traditionally formed the core of LNEE, we also encourage authors to submit books devoted to supporting student education and professional training in the various fields and applications areas of electrical engineering. The series cover classical and emerging topics concerning: • • • • • • • • • • • •

Communication Engineering, Information Theory and Networks Electronics Engineering and Microelectronics Signal, Image and Speech Processing Wireless and Mobile Communication Circuits and Systems Energy Systems, Power Electronics and Electrical Machines Electro-optical Engineering Instrumentation Engineering Avionics Engineering Control Systems Internet-of-Things and Cybersecurity Biomedical Devices, MEMS and NEMS

For general information about this book series, comments or suggestions, please contact [email protected]. To submit a proposal or request further information, please contact the Publishing Editor in your country: China Jasmine Dou, Associate Editor ([email protected]) India, Japan, Rest of Asia Swati Meherishi, Executive Editor ([email protected]) Southeast Asia, Australia, New Zealand Ramesh Nath Premnath, Editor ([email protected]) USA, Canada: Michael Luby, Senior Editor ([email protected]) All other Countries: Leontina Di Cecco, Senior Editor ([email protected]) ** Indexing: The books of this series are submitted to ISI Proceedings, EI-Compendex, SCOPUS, MetaPress, Web of Science and Springerlink **

More information about this series at http://www.springer.com/series/7818

Liheng Wang Yirong Wu Jianya Gong •

•

Editors

Proceedings of the 6th China High Resolution Earth Observation Conference (CHREOC 2019)

123

Editors Liheng Wang China Aerospace Science and Technology Corporation Beijing, China

Yirong Wu Aerospace Information Research Institute Chinese Academy of Sciences Beijing, China

Jianya Gong Wuhan University Wuhan, China

ISSN 1876-1100 ISSN 1876-1119 (electronic) Lecture Notes in Electrical Engineering ISBN 978-981-15-3946-6 ISBN 978-981-15-3947-3 (eBook) https://doi.org/10.1007/978-981-15-3947-3 © Springer Nature Singapore Pte Ltd. 2020 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, expressed or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. This Springer imprint is published by the registered company Springer Nature Singapore Pte Ltd. The registered company address is: 152 Beach Road, #21-01/04 Gateway East, Singapore 189721, Singapore

Contents

A New Multidimensional Spectral and Polarization Information Detection Technology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yechao Wang, Xiaoli Chen, Xiaoming Zhong, and Haibo Zhao Optimizing Pose of UAV Image Based on PPK Technology . . . . . . . . . . Guangrui Yu, Yuncai Su, Lili Yu, Lianbing Gong, and Danyang Zhao Extraction of Helicopter Rotor Physical Parameters Based on Time-Frequency Image Processing . . . . . . . . . . . . . . . . . . . . . . . . . . Chenxiao Lai and Daiying Zhou Design of an Airborne DIAL Measurement System for Measuring Concentrations of Atmospheric Pollutants . . . . . . . . . . . . . . . . . . . . . . . Yong Chen, Ding-fu Zhou, Ze-hou Yang, Chun-li Chen, Yong-ke Zhang, Xiang-hua Niu, Jing Li, Xiao-feng Li, Guo-juan Zhang, and Guo-hua Jin A Multiple Moving Ships Detection Method for GF-4 Satellite Image in Thin-Cloud Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Peng Lv, Yuxin Hu, Qianqian Li, Yangshuan Hou, Xiaohui Wang, and Bin Lei Identification and Extraction of Nutrient Content in Hyperspectral Black Soil in Frequency Domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Dong-hui Zhang, Ying-jun Zhao, Kai Qin, Dong-hua Lu, Cheng-kai Pei, Ning-bo Zhao, Yue-chao Yang, and Ming Li Evaluation of Geometric Performances of the Gaofen-6 PMS Camera . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Liping Zhao and Hongzhou Li

1 11

37

51

61

73

85

Analysis of Geometric Performances of the Gaofen-6 WFV Camera . . . 105 Liping Zhao, Xingke Fu, and Xianhui Dou

v

vi

Contents

Evaluation and Analysis of Geometric Performances of the Gaofen-1 B/C/D Satellite . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125 Liping Zhao and Xingke Fu Preliminary Analysis of Gaofen-1 B/C/D Satellite Stereo Mapping Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 Liping Zhao and Xianhui Dou Ecological Vulnerability Assessment and Cause Analysis of the Farming–Pastoral Zone in Northern China—Taking Yulin City as an Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157 Yanmei Zhong, Jianguo Cheng, Lingkui Meng, and Wen Zhang Airport and Ship Target Detection on Satellite Images Based on YOLO V3 Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167 Ren Ying River Segmentation Based on Visual Salience Calculation of Spectral Residual and Region Growing in SAR Images . . . . . . . . . . . . . . . . . . . . 175 Guiming Zhang, Gong Zhang, Liyan Luo, Jiantao Wang, and Qing Ding Remote Sensing Road Extraction by Refining Road Topology . . . . . . . . 187 Huiqin Gao, Yuan Yuan, and Xiangtao Zheng Cloud Detection Method in GaoFen-2 Multi-spectral Imagery . . . . . . . . 199 Zhaocong Wu, Lin He, Yi Zhang, and Jun Li High-Resolution Land-Use Mapping in Beijing-Tianjin-Hebei Region Based on Convolutional Neural Network . . . . . . . . . . . . . . . . . . . . . . . . 213 Pan Chen, Zhengchao Chen, Xuan Yang, Baipeng Li, and Bing Zhang Dichotomy: Trajectory Planning Algorithm Based on Point Group Distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223 Naiting Xu, Fan Yang, HaiMing Lian, and Yi Wang System Design for an Improved SPIDER Imager . . . . . . . . . . . . . . . . . . 241 Guomian Lv, Yueting Chen, Huajun Feng, Zhihai Xu, and Qi Li Performance of Support Vector Machines, Artificial Neural Network, and Random Forest for Identifying Banana Fusarium Wilt Using UAV-Based Multi-spectral Imagery . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261 Huichun Ye, Bei Cui, Shanyu Huang, Yingying Dong, Wenjiang Huang, Anting Guo, Yu Ren, and Yu Jin Remote Sensing Image On-Board Restoration Based on Adaptive Wiener Filter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271 Yunsen Wang, Wenxiu Mu, Xiaohui Du, Chengzhi Ma, and Xuejin Shen

Contents

vii

Design of Space-Based Information Service Architecture Based on Mobile Cloud . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 283 Ying-chun Hou, Chao Yang, and Yan Hou Monitoring of a Subgrade Subsidence by Means of Ground-Based SAR Interferometry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 295 Pingping Huang, Fang Liu, Weixian Tan, Wei Xu, Qi Lin, and Huifang Ren A Polarization Calibration Solution Method of Airborne SAR Based on Point Target . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303 Zhida Xu, Shucheng Yang, Chunquan Cheng, and Jianwei Tan Recognition Hydropower Stations from Remote Sensing Images by Multi-stage CNN Detection and Segmentation . . . . . . . . . . . . . . . . . . 313 Xiaowei Tan, Zhifeng Xiao, and Weiping Shao The Intelligent Planning for Spacecraft Autonomy in On-Orbit Servicing Mission . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331 Jing Yu, Dong Hao, Hongyang Liu, and Xiaoqian Chen Numerical Aerodynamic and Design Analysis of Combined SaucerShaped Buoyancy-Lifting Airships . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343 Yanxiang Cui, Yanchu Yang, Jinggang Miao, and Xiangqiang Zhang Monitoring the Surface Subsidence of Liupanshui City Using ALOS-2 Images and NSBAS-InSAR Technology . . . . . . . . . . . . . . . . . . . . . . . . . 363 Huan Chen, Guoman Huang, Guoqi Cheng, and Yuting Sheng L1-Norm Method for Dual-Wavelength Phase Unwrapping . . . . . . . . . . 373 Guoqi Cheng, Jixian Zhang, Huan Chen, Jiaqi Chen, and Lijun Lu High-Efficiency Flexible GaAs Solar Modules Used for Unmanned Aerial Vehicles and Stratospheric Airships . . . . . . . . . . . . . . . . . . . . . . 385 J. K. Yang, X. Y. Jiao, Y. Yang, X. S. Wang, L. L. Song, J. Xue, and Z. C. Chen Landslide Risk Zoning Method Based on Improved Water Seepage Capacity Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393 Zhaohua Wang, Jixian Zhang, Zheng Zhao, and Haiying Gao Semi-supervised Classification of PolSAR Image Based on Self-training Convolutional Neural Network . . . . . . . . . . . . . . . . . . . 405 Xianxiang Qin, Wangsheng Yu, Peng Wang, Tianping Chen, and Huanxin Zou A SAR Image Data Augmentation Method Based on Generative Adversarial Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 419 Qinglin Lu, Guojing Li, and Wei Ye

viii

Contents

Research on High-Resolution Synthetic Aperture Radar Image for Varied Antenna Beam Pointing . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431 Yinghui Zhao and Xijuan Yue Data-Driven Fault Detection Methods for Jilin-1 Satellite Attitude Control System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 441 Zhi Qu, Kai Xu, Yanhao Xie, Feng Li, Mengmeng Liu, Shuangxue Han, Jiebing Liu, and Zhigang Chen A Novel Framework of Artificial Intelligent Geologic Hazards Detection Over Comprehensive Remote Sensing . . . . . . . . . . . . . . . . . . 457 Yueying Zhang, Haonan Ran, Yuexing Peng, and Yu Zheng Automatic Prediction of Landslides Over InSAR Techniques and Differential Detection Using High-Resolution Remote Sensing Images: Application to Jinsha River . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 471 Yueying Zhang, Haonan Ran, Yuexing Peng, and Yu Zheng Internal Calibration and Range Replica Extraction Scheme for Ultrahigh-Resolution Spaceborne SAR . . . . . . . . . . . . . . . . . . . . . . . . . . 487 Fan Feng, Axin Jin, Jia Sun, Ruohan Hou, and Hongxing Dang Monitoring and Analysis of Surface Deformation and Glacier Motion Along the Sichuan–Tibet Railway: A Case Study of the Lhasa–Nyingchi Railway Section . . . . . . . . . . . . . . . . . . . . . . . . . 499 Jinghui Luo, Qing Ding, Gong Zhang, Wei Zhang, Xiaoxia Wang, and Changli Zheng Automatic Detection of Ship Based on Rotation Invariant RetinaNet . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 515 Luyang Zan, Kaixuan Lu, and Zhengchao Chen A High-Resolution Remote Sensing Images Segmentation Algorithm Based on PCA and Fuzzy C-Means . . . . . . . . . . . . . . . . . . . . . . . . . . . . 527 Chenchen Jiang, Hongtao Huo, and Qi Feng Structural Design and Analysis of a Belly Radome . . . . . . . . . . . . . . . . 541 Liuqing Xu Cross-comparison and Analysis of SJ-9A, SPOT5, and THEOS Based on a Satellite Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 551 Fangyan Yuan, Guoqing Li, Zhengli Zuo, Quan Ran, LiDong Guo, and Guangbin Ma Water Extraction of Airborne Polarimetric SAR by Introducing Eigenvalue Relative Difference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 571 Zheng Changli, Zhang Wei, Ding Qing, Wang Xiaoxia, and Luo Jinghui

Contents

ix

Research on Dimension Reduction Detection Technology of Space-Borne GPS Receiver Fault . . . . . . . . . . . . . . . . . . . . . . . . . . . . 581 Zhang Xiaopeng, Wang Xiaochen, Zhuang Haixiao, Guo Yongfu, Chen Xi, Zuo Miao, Zhang Xiangyan, Wang Weiwei, and Yang Ping Establishing the Downscaling Model of NDVI Based on the Iterated Function System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 589 Haijun Luan, Meng Zhang, Yunya Wan, Yuanrong He, Qin Nie, and Xinxin Zhang An Autonomous Navigation Method with InSAR-Aided INS . . . . . . . . . 605 Shuai Jiang, Yalong Pang, Luyuan Wang, Jiyang Yu, Bowen Cheng, Zongling Li, Liang Hao, and Cuilian Wang

A New Multidimensional Spectral and Polarization Information Detection Technology Yechao Wang, Xiaoli Chen, Xiaoming Zhong, and Haibo Zhao

Abstract Simultaneous acquisition of spectral information and polarized information can obtain more feature information to distinguish targets. Based on the computational imaging technology and a pixelized polarization detector, we propose a novel imaging mode that simultaneously acquires 2D spatial information, 1D spectral information and 1D spectral–polarized information of the target. In the framework of compressed sensing, the imaging results are obtained by the pixelized polarization detector after the spatial modulation of coded aperture and the dispersion of prism. The corresponding spectral and polarization images are reconstructed by an optimization algorithm. The method can obtain 25 bands of spectral and polarization images of four angles (0°, 45°, 90° and 135°), ranging in 450–650 nm (spectral resolution less than 10 nm), and the degree of linear polarization and the angle of polarization of each band. The experimental prototype has been developed, and the data acquisition and processing have been completed. Finally, the technology has successfully achieved simultaneous acquisition of multidimensional spatial–spectral–polarized information. Keywords Computational imaging · Polarization detector · Multidimensional information · Spectral image reconstruction

1 Introduction Traditional spectropolarimeter can simultaneously acquire three-dimensional spatial–spectral data of each Stokes parameter by scanning specific domains [1], such as the spatial domain in channeled spectropolarimetry [2], the optical path difference domain in Fourier transform imaging spectropolarimetry [3] and polarization domain in other spectropolarimetry [4]. Some new systems obtain polarization spectra by direct measurements such as integrating integral field spectrometry with division-ofaperture imaging polarimetry [5]. However, the above systems have limitations such Y. Wang (B) · X. Chen · X. Zhong · H. Zhao Beijing Institute of Space Mechanics & Electricity, Beijing, China e-mail: [email protected] © Springer Nature Singapore Pte Ltd. 2020 L. Wang et al. (eds.), Proceedings of the 6th China High Resolution Earth Observation Conference (CHREOC 2019), Lecture Notes in Electrical Engineering 657, https://doi.org/10.1007/978-981-15-3947-3_1

1

2

Y. Wang et al.

as noise sensitivity, channel cross talk and spectral resolution [6, 7]. Some literatures have introduced the latest compressed spectral imaging method, using channel switching method to measure polarization spectrum, but at the expense of time resolution [8]. Compressed spectrum imaging is a new technology that has evolved in recent years. Based on the compressed sensing framework, high-dimensional snapshot acquisition of spectral information becomes possible [9]. The coded aperture snapshot spectral imager (CASSI) receives information from the array detector by random code modulation of the scene and spectral modulation of the dispersive elements [10–12]. Inspired by this, we propose a new imaging mode that a pixelized polarization detector combined with compression spectroscopy to simultaneously detect two-dimensional spatial information (x, y), one-dimensional spectral information (λ) and four polarized components (0°, 45°, 90° and 135°). The random coded aperture enables the system to code of the spatial information efficiently, and the integration of the polarization detector with the CASSI achieves efficient acquisition. The feasibility of the scheme was verified by experiments, and the model of the system was established. Under the theory of compressed sensing, the optimization problem is solved by the iterative algorithm. This model breaks through the principle limitation of the traditional polarization spectrum detection method and satisfies the synchronous acquisition requirements of multidimensional information such as time-space spectrum polarization. The scene information h(x, y, λ, p) is limited by bandpass filter (BPF), and then it is modulated by coded aperture (CA). After double Amici prism (DAP) dispersion modulation, it is imaged on the polarization detector.

2 A New Multidimensional Spectral and Polarization Information Detection Technology The principle of the multidimensional polarization spectrum detection system is shown in Fig. 1. The scene information h(x, y, λ, p) first enters the objective lens, and the bandpass filter of 450–650 nm is used to intercept the spectrum segments.

Fig. 1 Schematic of system

A New Multidimensional Spectral and Polarization …

3

Fig. 2 Data modulation flowchart

Then, the light reaches the coded aperture, and the random coding mask spatially modulates the information h(x, y, λ, p). The coded aperture is a random matrix and sets 0 and 1 channels which etched on the glass and made an anti-reflectance process. The light which is modulated by the codes goes through the relay lens and then reaches the dispersive element. Then, a double Amici prism is used to disperse the encoded light from the spectral dimension. It is useful for subsequent reconstruction of the data cube. The coded information passes through the dispersive prism and reaches the polarization detector. A spatially encoded and dispersion-modulated polarization spectrum-compressed image is obtained on the polarization detector (Fig. 2). The data flowchart indicates that the information H first performs coding of 0 or 1 in space when it passes through the coded aperture (CA). After the dispersion of the double Amici prism, the data cube is expressed as HCAV and it is distributed on both sides of the central wavelength of 550 nm. HM is obtained on the polarization detector, including four polarization components (0°, 45°, 90°, and 135°).

3 System Model As shown in Fig. 1, the scene information can be expressed as h(x, y, λ, p), where x and y represent two-dimensional spatial information, λ represents spectral information, and p = 0, 1, 2, 3, representing different polarization information, Sout = M pd Sin

(1)

⎡

⎤ sin 2θ 0 1 cos 2θ 1 ⎢ cos 2θ cos2 2θ cos 2θ sin 2θ 0 ⎥ ⎥ M pd (θ ) = ⎢ 2 ⎣ sin 2θ cos 2θ sin 2θ sin2 2θ 0 ⎦ 0 0 0 0  T T T T T S = S0 , S1 , S2 , S3

(2)

(3)

Mpd represents the Mueller matrix of the polarization detector [13]. Sin and Sout represent polarization information of incident and outgoing light. Due to the small field of the lens, the Mueller matrix of other components can be considered as a unit

4

Y. Wang et al.

matrix. S is Stokes parameter [14]. Similar to the CASSI, the image acquired by the detector can be expressed as [15] f (x, y) =

3 

ψP (x, y, λ)T (x, y, λ)h(x, y, λ, p)dλ + ω(x, y)

(4)

p=0

ψP (x, y, λ) represents the modulation of the polarizer. T (x, y, λ) is the modulation introduced by the CASSI, and ω(x, y) is system noise. Discrete form can be expressed as f (m, n) =

3

25

ψP (m, n, λ)T (m, n, k)h(m, n, k, p) + ω(x, y)

(5)

p=0 k=1

(m, n) is the discrete coordinate, and k is the number of spectral bands. Expressed as matrix forms, F = ΨTH + = KH +

(6)

F, , T, H,  are the matrix forms of ψ P (m, n, λ) , T (m, n, k), h(m, n, k, p) and ω(x, y). K = T is the measurement matrix of the system. Assume that the data cube has L spectral bands, M × N spatial pixels and 4 Stokes parameters. It can be expressed as  F = [K 0 , K 1 , K 2 , K 3 ] H T0 , H T1 , H T2 , H T3 + 

(7)

K p is the measurement matrix of Sp ∈  M N L×1 ,and F ∈  M N+L−1×1 is the vectorized form of f .

4 Reconstruction Algorithm The original polarization spectrum information is obtained by solving an optimization problem. We need to reconstruct all the original information from an incomplete observation. Due to the sparsity of the spectral data itself, the underdetermined system can find a unique solution by solving the following optimization problem [16],

F = arg min F G − HF22 + τ Γ (F)



(8)

where G is the observed value, H is the equivalent observation matrix, F is the scene spectral data, and τ is a parameter used to adjust the balance between the two parts. Formula (8) is the objective function of the optimization and consists of two parts: (a) the system fidelity term, which is used to measure the error between the

A New Multidimensional Spectral and Polarization …

5

optimization result and the system observation, and (b) the regularization term, which is generally used to constrain the objective function according to the intrinsic property of the target [17]. This paper selects the total variational (TV) regularizer [18]. Two-step iterative shrinkage/thresholding (TwIST) is an effective algorithm to solve constrained optimization problems, which can realize reconstruction quickly and efficiently [19]. In this paper, TwIST is used to reconstruct the polarization spectrum data cube.

5 Experiment 5.1 Hardware Implementation The experimental device includes (1) objective lens L1, (2) bandpass filter (BPF), (3) coded aperture (CA), (4) an F/8 relay lens L2 , (5) a double Amici prism (DAP), (6) a monochromatic pixelized polarized CMOS detector (P-detector). The cutoff range of BPF is 450 nm-650 nm. The CA includes 520 × 520 elements of random binary pattern with 13.8 µm× 13.8 µm in size. The central wavelength of the double Amici prism is 550 nm. The resolution of the pixelized polarized CMOS detector is 2448 × 2048, and the pixel size is 3.45 µm× 3.45 µm. Adjacent polarizers of 0°, 45°, 90° and 135° are placed on the array [20, 21] (Fig. 3).

Fig. 3 Experimental prototype developed at laboratory

6

Y. Wang et al.

Fig. 4 Coded aperture image obtained at a wavelength of 614 nm

5.2 Calibration A monochromator is used as the light source. The wavelength ranges in 450–650 nm, and the wavelength interval is 1 nm. The center wavelength is determined, and its position corresponds to the pixels on the detector. Twenty-five wavelengths are selected as the basis of reconstruction, and the coded aperture spectrum image of the corresponding wavelength is obtained. In order to eliminate dark current noise, 10 dark current noise images of each wavelength were acquired. The calibration images at different wavelengths are averaged in energy, and then the exposure time during the calibration process is equivalent to a constant [22–24] (Fig. 4).

5.3 Experiment Results In Fig. 5, the scene consists of a blue book, a red racket, a color card and a checkerboard. The polarization angles are 0°, 45°, 90° and 135°. An image with no polarization angle was acquired. Spectral and polarization information can be reconstructed by TwIST. Figure 6 shows the reconstructed results of four polarization angles (0°, 45°, 90° and 135°) ranging in 450–650 nm, including 25 bands, using a color display at the corresponding wavelength. The Stokes parameters S 0 , S 1 , S 2 , S 3 are calculated and displayed in 3D after correction [13], the x-axis and the y-axis represent the spatial domain, and the z-axis represents the spectral domain. ⎤ ⎧ S0 ⎪ ⎪ S0 = I0 + I90 ⎢ S1 ⎥ ⎨ S1 = I0 − I90 ⎥ S=⎢ ⎣ S2 ⎦ = ⎪ S2 = I45 − I135 ⎪ ⎩ S3 S3 = I R − I L ⎡

(9)

A New Multidimensional Spectral and Polarization …

7

Fig. 5 Experimental scene and measured images. a The experimental scene, b–e different polarization components (0°, 45°, 90° and 135°), f no polarization image

Fig. 6 Reconstructed results. a–d represent 0°, 45°, 90° and 135° polarization components

8

Y. Wang et al.

The circularly polarized Stokes parameter is assumes as [8]    2 2 S3 = 0.1 S0 − S1 + S2

(10)

Figure 7 indicates that S 1 , S 2 and S 3 are significantly weaker than S 0 , which can be explained by the properties of the Stokes parameters [25]. S 0 represents the total intensity of light, including the polarization component and the non-polarization component. S 1 is the difference between the horizontally polarized light and the vertically polarized light. S 2 is the difference between 45° and 135° polarized lights. Both S 1 and S 2 represent linearly polarized components. S 3 is the difference between the left and right circularly polarized lights and represents a circularly polarized light component. The main component of the light reflected by the natural scene is unpolarized light. The target to be measured is a natural scene, so it is mainly an unpolarized component [1]. Degree of linear polarization (DoLP) and angle of polarization (AoP) are defined as [1]

Fig. 7 Reconstructed results. a–d The 3D data cubes of S 0 , S 1 , S 2 and S 3

A New Multidimensional Spectral and Polarization …

9

Fig. 8 a–b 3D image of AoP and DoLP, c reconstructed spectral curve of the red card and the blue curve is obtained by a spectrometer

DoLP =



S12 + S22 /S0

(11)

AoP = arctan(S1 /S2 )/2

(12)

Figure 8a, b indicates that the edges of the checkerboard and the racket can be distinguished easily. The weaker area corresponds to a smaller AoP and a smaller DoLP. The area with much polarized characteristics is a larger AoP and medium DoLP. The results indicate that the spectral image with polarization information is easier to distinguish the edge of the object compared with the simple spectral imagery. (c) shows that the reconstructed spectra have good accuracy.

6 Conclusion This paper proposes a new multidimensional polarization spectrum detection technology based on CASSI and a pixelized polarization detector. The system can simultaneously acquire spatial, spectral and polarization information. The CASSI performs the spatial coding modulation and the spectral dispersion aliasing compression sampling of the scene. The polarization information is acquired by the pixelized polarization detector. The polarization spectrum is reconstructed by TwIST. Compared with the existing polarization spectrum detection technology, the linear compression sampling model does not require Fourier transform and spatial filter. The technology improves the luminous flux and the noise sensitivity, and spectral resolution reduction and channel cross talk caused by traditional polarization spectrum acquisition technology got improved and eliminated. Acquisition of polarization spectrum with 25 bands’ range in 450–650 nm using the technology is demonstrated. The feasibility has been successfully verified by the experiment.

10

Y. Wang et al.

References 1. Tyo JS, Goldstein DL, Chenault DB, Shaw JA (2006) Review of passive imaging polarimetry for remote sensing applications. Appl Opt 45:5453–5469 2. Oka K, Kato T (1999) Spectroscopic polarimetry with a channeled spectrum. Opt Lett 24:1475– 1477 3. Kudenov MW, Hagen NA, Dereniak EL, Gerhart GR (2007) Fourier transform channeled spectropolarimetry in the mwir. Opt Express 15:12792–12805 4. Chan VC, Kudenov M, Liang C, Zhou P, Dereniak E (2014) Design and application of the snapshot hyperspectral imaging fourier transform (shift) spectropolarimeter for fluorescence imaging. Proc SPIE 8949:894–903 5. Mu T, Zhang C, Li Q, Wei Y, Chen Q, Jia C (2014) Snapshot full-stokes imaging spectropolarimetry based on division-of-aperture polarimetry and integral-field spectroscopy. Proc SPIE 9298:92980D 6. Locke AM, Salyer D, Sabatke DS, Dereniak EL (2003) Design of a SWIR computed tomographic imaging channeled spectropolarimeter. Proc. SPIE 5158:507136 7. Dereniak EL, Craven JM, Kudenov MW (2009) False signature reduction in infrared channeled spectropolarimetry. Proc SPIE 7419:7419 8. Yiren W, Fu C, Wu D, Xie Y (2019) Channeled compressive imaging spectropolarimeter. Opt Exp 27(3|4) 9. Candès EJ, Wakin MB (2008) An introduction to compressive sampling. IEEE Signal Process Mag 25:21–30 10. Wagadarikar A, John R, Willett R, Brady D (2008) Single disperser design for coded aperture snapshot spectral imaging. Appl Opt 47:B44–B51 11. Arce GR, Brady DJ, Carin L, Arguello H, Kittle DS (2014) Compressive coded aperture spectral imaging: an introduction. IEEE Signal Process Mag 31(1):105–115 12. Tan J, Ma Y, Rueda H, Baron D, Arce GR (2016) Compressive hyperspectral imaging via approximate message passing. IEEE J Sel Top Signal Process 10:389–401 13. Chipman RA (2009) Handbook of optics. McGraw-Hill 14. Kalibjian R (2004) Stokes polarization vector and Mueller matrix for a corner-cube reflector. Opt Commun 240:39–68 15. Arce GR, Brady DJ, Carin L, Arguello H, Kittle DS (2014) Compressive coded aperture spectral imaging: an introduction. IEEE Signal Process Mag 31:105–115 16. Zibulevsky M, Elad M (2010) L1-l2 optimization in signal and image processing. IEEE Signal Process Mag 27(3):76–88 17. Daubechies I, DeVore R, Fornasier M, Güntürk CS (2010) Iteratively reweighted least squares minimization for sparse recovery. Commun Pure Appl Math 63(1):1–38 18. Tsai T-H, Brady DJ (2013) Coded aperture snapshot spectral polarization imaging. Appl Opt 52:2153–2161 19. Bioucas-Dias JM, Figueiredo MA (2007) A new twist: two-step iterative shrinkage/thresholding algorithms for image restoration. IEEE Trans Image Process 16:2992–3004 20. Zhao X, Boussaid F, Bermak A, Chigrinov VG (2009) Thin photopatterned micropolarizer array for CMOS image sensors. IEEE Photon Technol Lett 21:805–807 21. Tokuda T, Sato S, Yamada H, Sasagawa K, Ohta J (2009) Polarisation-analysing CMOS photosensor with monolithically embedded wire grid polarizer. Electron Lett 45:228–230 22. Wagadarikar Ashwin A, Pitsianis Nikos P, Sun Xiaobai, Brady David J (2008) Spectral image estimation for coded aperture snapshot spectral imagers. SPIE 7076:707602 23. Ma X, Wang Z, Li Y, Arce GR, Dong L, Garcia-Frias J (2018) Fast optical proximity correction method based on nonlinear compressive sensing. Opt Express 26:14479–14498 24. Powell SB, Gruev V (2013) Calibration methods for division-of-focalplane polarimeters. Opt Express 21:21039–21055 25. Stokes GG (1852) On the composition and resolution of streams of polarized light from different sources. Trans Cambridge Philos Soc 9:399–416

Optimizing Pose of UAV Image Based on PPK Technology Guangrui Yu, Yuncai Su, Lili Yu, Lianbing Gong, and Danyang Zhao

Abstract Geographic information products of UAV have been developed from single to multiple directions. How to obtain the pose parameters of images with high quality is the key to ensure the accuracy of products. In terms of both production quality and efficiency, the development of RTK-UAVs has gradually become the focus of public attention. In view of the fact that these UAVs are mostly used for navigation, the real-time correction of camera coordinates is not considered, and the accuracy of attitude parameters obtained by the inertial navigation unit of the micro/mini UAV is low. So a small number of GCPs still need to be laid to meet the accuracy requirements of surveying and mapping results. This paper studied a new PPK method, taking the BD930 GNSS module as an example, the UAV system was modified by using the configuration scheme of three non-collinear antennas. A carrier phase dual-difference model combining GPS, BDS and GLONASS was constructed. Then baseline vector’s determination was carried out by LAMBDA method. The system errors caused by fixed frequency, camera exposure delay and position difference were eliminated by three spline function GNSS interpolation algorithm and eccentricity measurement technology for space rear intersection. Taking the corrected position of the camera and the calculated attitude parameters as the initial values, GNSS-assisted self-bundle block adjustment was introduced to obtain highprecision pose and distortion parameters of the UAV image. The flight test in a hilly area proved that the accuracy of differential GNSS system could reach 0.01 m. Under dynamic flight, the fixed solution ratio was 58.7% higher than that of the traditional method. Without using any GCPs, the error of CPs was less than 0.3 m, and with four corner GCPs, the median error of CPs was less than 0.2 m. This confirmed that the position and distortion parameters obtained in this paper were correct and could meet the accuracy requirements of geographic information results. G. Yu · D. Zhao (B) Key Laboratory for Precision and Non-traditional Machining Technology of Ministry of Education, Dalian University of Technology, Dalian 116024, People’s Republic of China e-mail: [email protected] G. Yu · Y. Su 32023 Troops, Dalian 116023, People’s Republic of China L. Yu · L. Gong China Nuclear Industry Fifth Construction Co., Ltd, Shanghai 201512, People’s Republic of China © Springer Nature Singapore Pte Ltd. 2020 L. Wang et al. (eds.), Proceedings of the 6th China High Resolution Earth Observation Conference (CHREOC 2019), Lecture Notes in Electrical Engineering 657, https://doi.org/10.1007/978-981-15-3947-3_2

11

12

G. Yu et al.

Keywords PPK · GNSS interpolation · Eccentricity calibration · Self-BBA · Pose parameters

1 Introduction Unmanned aerial vehicle (UAV) has been widely used in petroleum geophysical exploration, environmental monitoring, urban planning and border patrol due to its advantages of flexibility, strong current situation, less influence by airspace and weather and high cost performance [1–4]. In particular, UAV plays an irreplaceable role in the emergency support of natural disasters such as earthquake, forest fire, tsunami and debris flow monitoring [5–7]. However, there are several disadvantages in traditional UAV aerial photography, such as poor attitude stability, large image distortion and small image size, and it is difficult to carry the position and orientation system (POS) with high accuracy due to the limitation of load. At present, only the navigation equipment is used to obtain the outline position and attitude of the image. Therefore, in order to ensure the accuracy of bundle block adjustment (BBA) method, the camera needs to be calibrated strictly in advance. At the same time, a large number of ground control points (GCPs) are needed to restore the image pose parameters by aerial triangulation [8, 9]. In this way, it not only increases the workload of field work, but also people entering difficult areas such as mountains, waters and forests, and it is difficult to set up control points, so the accuracy cannot be guaranteed [10, 11]. For this reason, how to obtain high-precision pose data of images at shooting time with little or no help of field GCPs has become the research focus of scholars. Compared with manned aircraft, UAVs are more cost-effective and responsive. However, the observations acquired by the POS are usually less accurate than those acquired in manned aerial photogrammetry [7]. Global positioning system (GPS) for UAV applications includes single point positioning (SPP) and differential positioning. SPP is mainly used in relatively low precision situations, such as navigation. In order to provide higher accuracy, single-frequency or dual-frequency geodetic-grade GPS receivers for carrier phase measurement must be used, but the price is between $5000 and $15000, and the weight and volume are not suitable for UAV carrying requirements [4]. Differential positioning includes real-time kinematic (RTK) and post-processed kinematic (PPK) technology. RTK-GPS is a typical differential positioning method, and through the measurement of GPS signal carrier phase, the user can obtain a high-precision real-time position, which can meet a variety of measurement and the application of geographic information system requirements [5, 12, 13]. Compared with RTK technology, PPK technology is a post-processing differential of carrier phase observations, which can effectively avoid the interruption of signal transmission while guaranteeing the same accuracy as RTK technology. Therefore, differential positioning can be regarded as a powerful economic alternative to geodetic-grade GPS receivers. However, geodetic-grade receiver and antenna

Optimizing Pose of UAV Image Based on PPK Technology

13

have been still expensive compared to consumer-grade ones. In the low-cost differential system test, it is found that for receivers, the performance difference between consumer-grade and geodetic-grade is small, By contrast, as to antennas, low-cost antennas, the performance degradation is large [4, 14, 15]. With the development of miniaturization of global navigation satellite system (GNSS), RTK and PPK have been continuously applied to micro/mini unmanned aerial vehicles (MUAVs) [16, 17]. The more representative ones are eBee Plus UAV from senseFly, Switzerland, UX5 HP UAV from Trimble, American, CW10 UAV from Chengdu Vertical Automation, China, etc. [18]. Differential GNSS UAV only needs to set up base station on the ground and acquire satellite carrier phase information together with rover station on the UAV. Through PPK algorithm, the accurate picture positions at exposure can be known [12, 19]. On this basis, GNSS-assisted BBA can be used for integrated positioning, which can avoid the complex process of laying a large number of GCPs in traditional UAV photography and improve the accuracy and efficiency of data processing [5, 10, 13]. The commercial UAVs using differential system are mostly applied to navigation, and system integration is high, without considering the dynamic case GNSS satellite signal reception, camera exposure and eccentricity effect between delay and receiver antenna and the camera center, etc. [19, 20]. In order to satisfy the accuracy requirements of topographic mapping and three-dimensional modeling, it is necessary to measure the camera distortion parameters in advance and lay a certain number of GCPs in the later data processing [21–23]. This paper takes BD930 positioning board produced by Trimble company as the research object, completes the UAV system modification, studies PPK algorithm under multi-system and improves the static positioning accuracy and dynamic stability of consumer-grade receivers and antennas. Based on spline curve, a flight model is built, and the influence of system error caused by camera exposure delay and eccentricity is discussed. A flight test was carried out in a hilly area of Henan Province, China. By reasonably setting the lens distortion parameter model, taking corrected GNSS camera station coordinates and calculated image attitude angle as initial values. Though the self-BBA method, the UAV image position and attitude parameters were obtained precisely. The advantages of this method were compared and analyzed based on the statistical results of CPs residuals. Finally, discussion of the results is given, as well as recommendations for further investigations.

2 Measurement Method of UAV Pose Parameters 2.1 Double Difference Model Fused with BDS/GPS/GLONASS BD930 positioning board supports GPS, GLONASS, Galileo and BDS satellite signal reception. It has fast RTK initialization speed and built-in Kalman filter PVT engine.

14

G. Yu et al.

It can obtain low multipath, high dynamic and low noise observation data. The lowcost differential GNSS system designed in this paper consists of BD930 board, power supply system, storage system, measurement antenna and post-processing software (see Fig. 1). Figure 2 depicts the working principle of PPK UAV. The base station on known position receives the carrier and pseudo-range information of satellite together with the antenna on UAV. When more than four satellite signals are received synchronously, the errors such as satellite orbit, cloud occlusion, satellite clock and multi-path effect can be eliminated in GNSS positioning process according to the principle of relative positioning. Compared with RTK technology, PPK technology carries out post-differential processing of carrier phase observation value. Through the dynamic relative positioning algorithm, the real-time position data of the receiver can be calculated by linear combination of satellite carrier observation information recorded by base station and rover station in the same time period [24]. BD930 receives BDS, GPS and GLONASS satellites at the same time. Figure 3 shows the visibility and reception of the satellite signal drawn by RTKPLOT. It can be found that three kinds of effective satellites can be received at each time, which makes up for the shortcomings of single system in space distribution and integrity. The pseudo-range and carrier phase observation equations of GPS, BDS and GLONASS can be expressed as follows: ⎧ G ⎨ ρ = ρ G + c(tr − tsG ) + L G + D G + M G + T G + v G .  ρ C = ρ C + c(tr + t CG − tsC ) + L C + D C + M C + T C + v C . ⎩ R ρ = ρ R + c(tr + t RG − tsR ) + L R + D R + M R + T R + v R .

⎧ G G ⎨ λ ϕ = ρ G + λG N G + c(tr − tsG ) + L G − D G + M G + T G + v G . λC ϕ C = ρ C + λC N C + c(tr + t CG − tsC ) + L C − D C + M C + T C + v C . ⎩ R R λ ϕ = ρ R + λ R N R + c(tr + t RG − tsR ) + L R − D R + M R + T R + v R .

Antenna

Software Cable

Storage BD930 Power Fig. 1 Low-cost differential GNSS system

(1)

(2)

Optimizing Pose of UAV Image Based on PPK Technology

15

Satellite

PPK UAV Operator

Remote controller with ground modem

Base station on known position

Fig. 2 Working principle of PPK UAV

Fig. 3 BD930 receiving satellite drawn by RTKPLOT

where C, G, R are, respectively, BDS, GPS and GLONASS, ρ is the geometric distance between the receiver and the satellite, ρ  is the pseudo-range, λ is the carrier wavelength, c is the electromagnetic wave transmission speed, N is the integer ambiguity, tr is the receiver clock error, ts is the satellite clock error, L, D, M, T and V are, respectively, the errors caused by troposphere, ionosphere, multipath, antenna phase center and satellite ephemeris, t CG is the time reference deviation for GPS and BDS, t RG is the time reference deviation for GPS and GLONASS.

16

G. Yu et al.

The three satellite systems using different time reference and space reference, GPST, BDT and GLONASST correspond to different time reference, and the conversion relationship between them is: GPST = BDT + 14s + [UTC(USNO) − UTC(UTSC)]. GPST = GLONASST − 3h + τr + 1s×n −19 s + [UTC(USNO) − UTC(SU)]. (3) UTC(USNO), UTC(UTSC) and UTC(SU) are, respectively, three coordinated universal time (UTC) reference systems, τr is the systematic deviation within 1 ms between GLONASST and UTC(SU). The coordinate datum of the three systems are, respectively, W G S−84, C GC S2000 and P Z −90. According to the definition of coordinate system, only two parameters of reference ellipsoid in W G S−84 and C GC S2000 coordinate systems are slightly different, and for the short flight range of UAV, it can be ignored. The transformation relationship between W G S−84 and P Z −90 is obtained by Bursa model as follows: ⎡ ⎤ ⎡ ⎤ X0 1 βZ X ⎣Y ⎦ = ⎣ Y0 ⎦ + (1 + m)⎣ −β Z 1 Z0 βY −β X Z W G S−84 ⎡ ⎤ −0.47 = ⎣ −0.51 ⎦ + (1 + 22 × 10−9 ) −1.56 ⎡ 1 −1.728 × 10−6 ⎣ 1.728 × 10−6 1 0.017 × 10−6 −0.076 × 10−6 ⎡

⎤⎡  ⎤ −βY X β X ⎦⎣ Y  ⎦ 1 Z  P Z −90

⎤⎡  ⎤ −0.017 × 10−6 X . 0.076 × 10−6 ⎦⎣ Y  ⎦ 1 Z  P Z −90 (4)

The applicability and accuracy of carrier phase difference is better than position and pseudo-range difference [25]. As UAV fly fast, the stability of miniature GNSS receiver is poor. In order to eliminate the common errors of orbit, satellite and atmosphere between base station and rover station, also considering the frequency division multiple access (FDMA) technology adopted by GLONASS, a dual-difference model integrating GPS, BDS and GLONASS is proposed: ⎧ iG i jG ij i jG i jG i jG i jG λ ∇ϕbr = ∇ρbr + λi G ∇Nbr + ∇L br − ∇Dbr + ∇Mbr ⎪ ⎪ ⎪ i jG i jG ⎪ ⎪ + ∇Tbr + ∇vbr . ⎪ ⎪ ⎨ iC i jC ij i jC i jC i jC i jC iC λ ∇ϕbr = ∇ρbr + λ ∇Nbr + ∇L br − ∇Dbr + ∇Mbr (5) i jC i jC ⎪ + ∇Tbr + ∇vbr . ⎪ ⎪ ⎪ ijR ij ijR jR ijR ⎪ λi R ∇ϕbr = ∇ρbr + λi R ∇Nbr + (λi − λ j )∇ Nbr + ∇L br ⎪ ⎪ ⎩ ijR ijR ijR ijR − ∇Dbr + ∇Mbr + ∇Tbr + ∇vbr .

Optimizing Pose of UAV Image Based on PPK Technology

17

Limited by flight control system and endurance time, MUAVs usually fly within 20 km, so the double difference of system errors can be neglected. In a certain epoch, assuming that the differential system receives m GPS, n BDS and q GLONASS satellites at the same time, all of which are referenced by the satellites with the highest altitude angle, and the dual-difference observation model can be combined: ⎤ ⎡ 12G λ1G ∇ϕbr ⎥ ⎢ ⎢ .. ⎥ ⎢ ⎢ . ⎥ ⎢ ⎢ λ1G ∇ϕ 1mG ⎥ ⎢ ⎥ ⎢ ⎢ br ⎢ ⎢ 1C 12C ⎥ λ ∇ϕ ⎥ ⎢ ⎢ br ⎥ ⎢ ⎢ .. ⎥=⎢ ⎢ . ⎥ ⎢ ⎢ ⎢ ⎢ 1C 1nC ⎥ ⎢ λ ∇ϕbr ⎥ ⎢ ⎥ ⎢ ⎢ 1R ⎢ 12R ⎥ ⎢ λ ∇ϕbr ⎥ ⎢ ⎢ .. ⎥ ⎢ ⎢ ⎦ ⎣ ⎣ . ⎡

⎤ a G12 b G12 c G12 .. .. .. ⎥ . . .⎥ ⎥ a G1m b G1m c G1m ⎥ ⎥⎡ ⎤ a C12 bC12 cC12 ⎥ ⎥ Bx .. .. .. ⎥⎣ ⎦ By . . .⎥ ⎥ C1n C1n C1n ⎥ Bz a b c ⎥ a R12 b R12 c R12 ⎥ ⎥ .. .. .. ⎥ . . .⎦

1q R a R1q b R1q c R1q λ1R ∇ϕbr ⎡ 1G λ ⎢ .. ⎢ . ⎢ ⎢ λ1G ⎢ ⎢ λ1C ⎢ ⎢ .. +⎢ . ⎢ ⎢ ⎢ λ1C λ1R ⎢ ⎢ .. ⎢ . ⎣

⎡ ⎢ ⎢ ⎢ ⎢ ⎢ +⎢ ⎢ ⎢ ⎢ ⎣

0

λ1R

⎤⎡ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎦⎢ ⎣

1q R

⎤⎡ ..

⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎦⎣

. 0m+n−2 λ1R − λ2R

..

. λ1R − λq R

⎤ 12G ∇Nbr ⎥ .. ⎥ . ⎥ 1mG ⎥ ∇Nbr ⎥ 12C ⎥ ∇Nbr ⎥ ⎥ .. ⎥ . ⎥ 1nC ⎥ ∇Nbr ⎥ ⎥ 12R ⎥ ∇Nbr ⎥ ⎥ .. ⎦ . ∇Nbr ⎤ 0 ⎥ .. ⎥ . ⎥ ⎥ 0m+n−2 ⎥ . 2R ⎥ ∇ Nbr ⎥ ⎥ .. ⎥ ⎦ . qR ∇ Nbr

(6)

where ∇ is the double difference and B is the baseline vector. The integration of BDS, GPS and GLONASS can ensure the effective acquisition of satellite signals. On the premise of neglecting the correlation of the three systems, variance–covariance matrix can be established combining the error propagation law. Using MLAMBDA method can effectively improve the fixed ratio of ambiguity [26]. Therefore, we use the least square method to deal with the redundant carrier observations and solve the three-dimensional coordinates of the UAV measurement antenna.

18

G. Yu et al.

2.2 Attitude Parameters Calculation of Three-Antenna Configuration The inertial measurement unit (IMU) equipped with MUAV has low measurement accuracy and is currently only used for navigation. In the data processing process, the measurement results generally participate in iterative calculations in the form of initial values. In this paper, the carrier attitude measurement method based on differential technique is studied. In order to measure the three-dimensional attitude of UAV, three non-collinear antennas are deployed on the fuselage, in which the antenna plane is parallel to the main plane of UAV and the main baseline is parallel to the axis of the fuselage. Through the translation transformation, the origin of the global coordinate system and the body coordinate system can be unified to the phase center of the main antenna, and the coordinates of the main antenna and the auxiliary antenna in the two coordinate systems can be obtained by static calibration and PPK technology, respectively. The distribution of antennas in the body coordinate system is shown in Fig. 4. The figure shows that in the body coordinate system, the Y-axis is the baseline of the main antenna 1 and the auxiliary antenna 2, the Z-axis is perpendicular to the plane where the antenna is located, and the X-axis constitutes right-hand coordinate system together. Sampling bi and li are, respectively, coordinates of the i-th antenna in the body coordinate system and the global coordinate system. α, β and γ are the yaw angle, the roll angle and the pitch angle, which represent the rotation parameters of the body coordinate system relative to the global coordinate system. Figure 4 shows the coordinates of the main and auxiliary antennas in the body coordinate system:

Z

Fig. 4 Distribution of antennas in the body coordinate system

Main antenna 1 (0, 0, 0)

Auxiliary antenna 2 (0, b12, 0)

Y

O Auxiliary antenna 3 (x3,b, y3,b, 0)

X

Optimizing Pose of UAV Image Based on PPK Technology

19

T

T

T b1 = 0 0 0 , b2 = 0 b12 0 , b3 = x3,b y3,b 0 . The conversion relationship between two coordinate systems can be expressed as: bi = Rlb (li − l1 ) = RY (β)R X (γ )R Z (α)(li − l1 ) ⎡ ⎤ cos β cos α − sin β sin γ sin α cos βsinα + sin β sin γ cos α − sin β cos γ ⎢ ⎥ =⎣ − cos γ sin α cos γ cos α sin γ ⎦(li − l1 ). sin β cos α + cos β sin γ sin α sin βsinα − cos β sin γ cos α cos β cos γ

(7) According to the orthogonality of the rotation matrix, the conversion relationship of the main baseline between the two coordinate systems is obtained as: ⎡

⎤ ⎡ ⎤ x2,l − x1,l − cos γ sin α l2 − l1 = ⎣ y2,l − y1,l ⎦ = b12 ⎣ cos γ cos α ⎦. z 2,l − z 1,l sin γ

(8)

From Eq. (8), the yaw angle α and the pitch angle γ are calculated through the main baseline b12 :   x2,l − x1,l . (9) α = − arctan y2,l − y1,l ⎛ ⎞   z 2,l − z 1,l z 2,l − z 1,l ⎠ = arctan⎝  γ = arcsin (10) 2  2 . b12 x2,l − x1,l + y2,l − y1,l Next, the roll angle β is calculated according to the relationship of the baseline formed by the auxiliary antenna 3 in the two coordinate systems: ⎡

⎡ ⎤ ⎤ x3,b x3,l − x1,l b3 = ⎣ y3,b ⎦ = RY (β)R X (γ )R Z (α)⎣ y3,l − y1,l ⎦. 0 z 3,l − z 1,l

(11)

The yaw angle α and the pitch angle γ are calculated according to Eqs. (9) and (10). Firstly, the baseline is rotated from the global coordinate system by the α angle around the Z-axis, and then, the γ angle is rotated around the X-axis to obtain a new baseline vector: ⎤ ⎡ ⎤ ⎤⎡ ⎤⎡  x3,l − x1,l 1 0 0 cos α sin α 0 x3,l − x1,l ⎣ y  − y1,l ⎦ = ⎣ 0 cos γ sin γ ⎦⎣ − sin α cos α 0 ⎦⎣ y3,l − y1,l ⎦. 3,l  z 3,l − z 1,l 0 − sin γ cos γ 0 0 1 z 3,l − z 1,l ⎡

(12)

Similarly, the new relationship is obtained by the orthogonality of the rotation matrix RY (β):

20

G. Yu et al.

⎤ ⎡  ⎤ x3,l − x1,l x3,b cos β ⎦ = ⎣ y  − y1,l ⎦. ⎣ y3,b 3,l  −x3,b sin β z 3,l − z 1,l ⎡

(13)

Thus, the roll angle β is:  β = − arctan

 z 3,l − z 1,l



 x3,l − x1,l

.

(14)

3 Correction of Image Position Parameters 3.1 Cubic Spline Interpolation for Solving Exposure Delay The sampling frequency of BD930 GNSS differential system carried by UAV is 20 Hz. During the flight process, it is sampled every 0.05 s. Therefore, in order to get the position data of the shooting time, it is necessary to record the flash pulse of the camera and calculate the exposure time coordinates by interpolation algorithm. At present, the curve fitting methods of space trajectory include Lagrange interpolation, Chebyshev polynomial interpolation, spline interpolation, etc. [27]. Some studies have found that the order of interpolation polynomials should not be too high or too low. Lagrange polynomials are prone to “Runge phenomenon” in interpolation calculation. Chebyshev polynomial interpolation requires an order of 11 to achieve millimeter accuracy. As a result, the amount of calculation increases, and the efficiency of operation are affected. UAV flight is easily affected by wind speed, wind direction, navigation error, air temperature, etc. There are some differences in speed at each instant of taking photos. Considering spline function is an important approximation tool in curve fitting, interpolation, numerical differentiation [28]. We propose a GNSS three-coordinate interpolation algorithm based on cubic spline function (see Fig. 5).

t Exposure delay 1

w

i

s (t )

GNSS sampling 2

w

i

s (t )

Fig. 5 Exposure delay correction model

3

w

i

s (t )

4

w

s (t )

i 5

Optimizing Pose of UAV Image Based on PPK Technology

21

Sampling points of UAV on a single route are set as P = {a = t0