pose-estimation

obtaining 2d-3d point correspondences for pnp or posit

試著忘記壹切 提交于 2019-12-08 09:37:17
问题 I am trying to estimate the pose and position of a satellite given an image of it. I have a 3D model of the satellite. Using either PnP solvers or POSIT works great when I pick out the point correspondences myself, however I need to to find a method to match the points up automatically. Using a corner detector (best one I found so far is based on the contour) I can find all the relevant points in the image in addition a few spurious points. However I need to match a given point in the image

OpenCV::solvePNP() - Assertion failed

狂风中的少年 提交于 2019-12-08 08:12:30
问题 I am trying to get the pose of the camera with the help of solvePNP() from OpenCV. After running my program I get the following errors: OpenCV Error: Assertion failed (npoints >= 0 && npoints == std::max(ipoints.checkVector(2, CV_32F), ipoints.checkVector(2, CV_64F))) in solvePnP, file /opt/local/var/macports/build/_opt_local_var_macports_sources_rsync.macports.org_release_tarballs_ports_graphics_opencv/opencv/work/OpenCV-2.4.2/modules/calib3d/src/solvepnp.cpp, line 55 libc++abi.dylib:

obtaining 2d-3d point correspondences for pnp or posit

扶醉桌前 提交于 2019-12-06 15:56:49
I am trying to estimate the pose and position of a satellite given an image of it. I have a 3D model of the satellite. Using either PnP solvers or POSIT works great when I pick out the point correspondences myself, however I need to to find a method to match the points up automatically. Using a corner detector (best one I found so far is based on the contour) I can find all the relevant points in the image in addition a few spurious points. However I need to match a given point in the image to the correct point in the 3D model. The articles I have read on the subject always seem to assume that

Is the recoverPose() function in OpenCV is left-handed?

旧街凉风 提交于 2019-12-06 02:26:01
问题 I run simple test for OpenCV camera pose estimation. Having a photo and the same photo scaled up (zoomed in) I use them to detect features, calculate essential matrix and recover camera poses. Mat inliers; Mat E = findEssentialMat(queryPoints, trainPoints, cameraMatrix1, cameraMatrix2, FM_RANSAC, 0.9, MAX_PIXEL_OFFSET, inliers); size_t inliersCount = recoverPose(E, queryGoodPoints, trainGoodPoints, cameraMatrix1, cameraMatrix2, R, T, inliers); So when I specify the original image as the first

OpenCV projectPoints(): inconsistent covariance/standard deviation of estimated poses

依然范特西╮ 提交于 2019-12-05 05:56:20
问题 I am using OpenCV in a pose estimation algorithm, where I am also attempting to obtain an estimate of the uncertainty of the estimated pose. My pose estimation is performed through 3D-2D correspondences and the PNP algorithm. To achieve uncertainty estimation, I am trying to use the projectPoints() function to reproject 3D points back on the image plane, and use the internally computed Jacobian matrix to obtain the covariance. My feature 'map' contains a planar set of 3D points. My camera

How to use outputs of posenet model in tflite

*爱你&永不变心* 提交于 2019-12-04 18:41:28
I am using the tflite model for posenet from here . It takes input 1*353*257*3 input image and returns 4 arrays of dimens 1*23*17*17, 1*23*17*34, 1*23*17*64 and 1*23*17*1. The model has an output stride of 16. How can I get the coordinates of all 17 pose points on my input image? I have tried printing the confidence scores from the heatmap of out1 array but I get near to 0.00 values for each pixel. Code is given below: public class MainActivity extends AppCompatActivity { private static final int CAMERA_REQUEST = 1888; private ImageView imageView; private static final int MY_CAMERA_PERMISSION

Pose estimation: solvePnP and epipolar geometry do not agree

拥有回忆 提交于 2019-12-04 16:47:28
I have a relative camera pose estimation problem where I am looking at a scene with differently oriented cameras spaced a certain distance apart. Initially, I am computing the essential matrix using the 5 point algorithm and decomposing it to get the R and t of camera 2 w.r.t camera 1. I thought it would be a good idea to do a check by triangulating the two sets of image points into 3D, and then running solvePnP on the 3D-2D correspondences, but the result I get from solvePnP is way off. I am trying to do this to "refine" my pose as the scale can change from one frame to another. Anyway, In

Is the recoverPose() function in OpenCV is left-handed?

倾然丶 夕夏残阳落幕 提交于 2019-12-04 07:46:11
I run simple test for OpenCV camera pose estimation. Having a photo and the same photo scaled up (zoomed in) I use them to detect features, calculate essential matrix and recover camera poses. Mat inliers; Mat E = findEssentialMat(queryPoints, trainPoints, cameraMatrix1, cameraMatrix2, FM_RANSAC, 0.9, MAX_PIXEL_OFFSET, inliers); size_t inliersCount = recoverPose(E, queryGoodPoints, trainGoodPoints, cameraMatrix1, cameraMatrix2, R, T, inliers); So when I specify the original image as the first one, and the zoomed image as the second one, I get translation T close to [0; 0; -1]. However the

OpenCV projectPoints(): inconsistent covariance/standard deviation of estimated poses

你说的曾经没有我的故事 提交于 2019-12-03 20:31:56
I am using OpenCV in a pose estimation algorithm, where I am also attempting to obtain an estimate of the uncertainty of the estimated pose. My pose estimation is performed through 3D-2D correspondences and the PNP algorithm. To achieve uncertainty estimation, I am trying to use the projectPoints() function to reproject 3D points back on the image plane, and use the internally computed Jacobian matrix to obtain the covariance. My feature 'map' contains a planar set of 3D points. My camera trajectory is a simple one: I start close to the features, move backwards and thereby far away from the

How to determine world coordinates of a camera?

旧城冷巷雨未停 提交于 2019-12-03 04:35:34
问题 I have a rectangular target of known dimensions and location on a wall, and a mobile camera on a robot. As the robot is driving around the room, I need to locate the target and compute the location of the camera and its pose. As a further twist, the camera's elevation and azimuth can be changed using servos. I am able to locate the target using OpenCV, but I am still fuzzy on calculating the camera's position (actually, I've gotten a flat spot on my forehead from banging my head against a