Plate Calibration User Guide

This guide walks you through the camera calibration process using a calibration plate (dot grid) in OpenLPT. The process consists of two main stages: Point Detection and Calibration.

1. Point Detection

First, select the Plate Calibration tab and ensure you are on the Point Detection sub-tab.

Step 1: Configure Camera Settings

Set the camera parameters in the Camera Images panel:

Num Cameras: Enter the number of cameras in your setup (e.g., 3).
Target Camera: Select the camera you want to calibrate (e.g., Camera 1).

Step 2: Load Calibration Images

Click Open Files to select one or more calibration plate images for the target camera.
Images will appear in the Frame List below.
Click on any frame to preview it in the left panel.

Step 3: Configure Detection Settings

In the Detection Settings panel:

Point Color: Choose Bright (Standard) for bright dots on dark background, or Dark for dark dots on bright background.
Select Template: Click this button, then draw a rectangle around ONE dot in the image. This template will be used for template matching.
Select Search ROI (Optional): Define a region of interest to limit the search area.
Match Threshold: Adjust the slider (default 0.70). Lower values detect more points but may include false positives.

Step 4: Detect Points

Click Detect to run template matching on the current image.
Verification: Look at the image view on the left. You should see green crosses marking all detected dots.
If detection is incorrect:
- Click Remove to clear all detected points.
- Adjust the Match Threshold or select a better template.
Click Add to manually add individual points by clicking on the image.

Step 5: Index Points (Assign 3D Coordinates)

In the Indexing panel, assign world coordinates to detected points:

Set Origin: Click this button, then click on a detected point to mark it as the origin (0, 0, 0).
Fixed Axis: Select which axis is fixed for this plane:
- Z fixed (default): For a horizontal plate at a known Z-plane.
- X or Y fixed: For vertical plates.
Plane: Enter the value of the fixed axis (e.g., 0 for Z=0 plane).
Set Axis Directions: Click this button, then click two points to define the positive X and Y directions. A hint will follow your mouse showing which axis to click.
Index Points: Click to automatically assign indices to all detected points based on the origin and axis directions.

Step 6: Configure Physical Spacing

Set the physical spacing between dots:

dx: Spacing in X direction (e.g., 10.00 mm).
dy: Spacing in Y direction (e.g., 10.00 mm).
dz: Spacing in Z direction (usually 0.00 mm for flat plates).

Click Check Position to verify the 3D world coordinates are correct by clicking on a point.

Step 7: Add to Calibration Data

When satisfied with the indexing, click Add to Calibration Data.
Repeat Steps 2-7 for all calibration images and all cameras.

                Important: Each camera can have multiple images at different planes. 
                The more images you add, the more robust the calibration will be.
            

2. Calibration

After adding points for all cameras, switch to the Calibration sub-tab.

Step 8: Configure Camera Settings

In the Camera Settings panel:

Target Camera: Select the camera to calibrate.
Model: Choose Pinhole (standard camera model).
Image Width/Height (px): Verify the image resolution (e.g., 1280 x 800).
Sensor Width (mm/px): Enter the sensor pixel pitch (e.g., 0.0200 mm/px).
Focal Length (mm): Enter the lens focal length (e.g., 180.00 mm).
Distortion Coeffs Num: Number of distortion coefficients to optimize (0 for no distortion, 5 for full model).

Step 9: Run Calibration

Click Run Calibration.
The system will perform a two-stage optimization:
- Stage 1: Estimate camera pose using solvePnP.
- Stage 2: Refine intrinsics and extrinsics using bundle adjustment.
The 3D View on the left will visualize the camera positions and calibration points.
Check the Mean RMS Error in the Calibration Results section (should be < 1.0 px for good calibration).

Step 10: Calibrate All Cameras

Change the Target Camera to the next camera.
Click Run Calibration again.
Repeat for all cameras.
The 3D View will accumulate all calibrated cameras, showing their relative positions.

Step 11: Save Results

When all cameras are calibrated, click Save All Camera Parameters.
Select an output directory.
A camFile folder will be created containing:
- cam0.txt - Camera 0 parameters
- cam1.txt - Camera 1 parameters
- cam2.txt - Camera 2 parameters
- ...

                Parameter File Format: The saved files are compatible with OpenLPT's tracking module 
                and contain camera matrix, distortion coefficients, rotation matrix, and translation vector.
            