Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vehicle stops in front of non-existing obstacle on the path #2213

Closed
3 tasks done
WJaworskiRobotec opened this issue Nov 3, 2022 · 12 comments
Closed
3 tasks done

Vehicle stops in front of non-existing obstacle on the path #2213

WJaworskiRobotec opened this issue Nov 3, 2022 · 12 comments
Assignees
Labels
component:perception Advanced sensor data processing and environment understanding. (auto-assigned) component:planning Route planning, decision-making, and navigation. (auto-assigned)

Comments

@WJaworskiRobotec
Copy link
Contributor

WJaworskiRobotec commented Nov 3, 2022

Checklist

  • I've read the contribution guidelines.
  • I've searched other issues and no duplicate issues were found.
  • I'm convinced that this is not my fault but a bug.

Description

While testing current Autoware in AWSIM for ITRI BusODD scenarios, the following problem was discovered :

The vehicle stops because the obstacle on the path is reported, but when detected objects are visualized, it seems that the objects are not really blocking the path.

  • the only detected object is far from the vehicle, and nnot on the path
    Screenshot from 2022-11-03 11-50-28

  • detected object is on the side of the vehicle, and is not blocking the movement

Screenshot from 2022-11-03 11-32-13
Screenshot from 2022-11-03 11-32-39
Screenshot from 2022-11-03 11-33-36

Location of the observed problems:

Screenshot from 2022-11-07 10-34-49

Expected behavior

The vehicle should not stop if there are no objects detected on the path

Actual behavior

The vehicle stops with no objects on the path

Steps to reproduce

Run AWSIM binary with Autoware - description to be updated once binary is publicly shared

Versions

No response

Possible causes

No response

Additional context

No response

@WJaworskiRobotec WJaworskiRobotec added component:perception Advanced sensor data processing and environment understanding. (auto-assigned) component:planning Route planning, decision-making, and navigation. (auto-assigned) labels Nov 3, 2022
@WJaworskiRobotec WJaworskiRobotec self-assigned this Nov 3, 2022
@WJaworskiRobotec WJaworskiRobotec changed the title Obstacle on the path reported when the detected object is not directly on the path Vehicle stops in front of non-existing obstacle on the path Nov 3, 2022
@maxime-clem
Copy link
Contributor

An "obstacle on the path" can also be caused by an obstacle point.
Have you checked the pointcloud in rviz ? I am afraid the points from the tree leaves are what is causing your issue.
Here is the related open discussion: https://github.com/orgs/autowarefoundation/discussions/2981

@shmpwk
Copy link
Contributor

shmpwk commented Nov 4, 2022

@WJaworskiRobotec
This problem may comes from this PR.
Could you change these parameters https://github.com/autowarefoundation/autoware.universe/blob/main/launch/tier4_perception_launch/config/obstacle_segmentation/ground_segmentation/ground_segmentation.param.yaml#L14-L15 ?

before:

max_z: 10.7 
min_z: -8.7

After

max_z: 4.5 # in case 50m continuous slope at 5deg
min_z: -4.5# in case 50m continuous slope at 5deg

@shmpwk
Copy link
Contributor

shmpwk commented Nov 4, 2022

cc. @badai-nguyen

@WJaworskiRobotec
Copy link
Contributor Author

@maxime-clem so what is the input to the planner from sensing/perception modules ? I thought it's only list of detection objects, but from your comments I understand that it's a pointcloud after some segmentation/cropping as well, right ?

@maxime-clem
Copy link
Contributor

@WJaworskiRobotec You are right that the obstacle_avoidance_planner only uses the list of detected objects but some other planning modules uses the obstacle pointcloud (most notably the obstacle_stop_planner).
This page gives a good overview of which planning nodes uses which inputs.

@yukkysaito
Copy link
Contributor

cc @takayuki5168

@xmfcx
Copy link
Contributor

xmfcx commented Nov 9, 2022

https://www.thinkautonomous.ai/blog/occupancy-networks/

This is Tesla's approach on treating non-classified objects and points in space.

I think our perception stack should generate a similar result for planning stack to act on. @yukkysaito @kaancolak @TakaHoribe are you also familiar with the outputs of occupancy networks?

@shmpwk
Copy link
Contributor

shmpwk commented Nov 10, 2022

@lchojnack
Copy link
Contributor

I've found the root cause of stopping the vehicle presented in the issue, and also in the discussion https://github.com/orgs/autowarefoundation/discussions/2981. I've noticed that in these two situations there are tree branches and tree leaves on the EGO path. The tree branches are higher than the vehicle's height and do not cause danger or reason to stop the vehicle. The node which is responsible for detecting points that are on the path is obstacle_stop_planner. The obstacle_stop_planner is checking if any point from a point cloud is within the polygon trajectory, and decides to stop the vehicle. Checking points only within a polygon (2d information) and not taking into account the vehicle height could cause stopping the vehicle when an obstacle is above and below the vehicle. There is an example of detecting tree branches above the vehicle in the picture below.
Screenshot_20221121_154255

My proposition is to extend checking if the point is within a polyhedron (3d information) instead of if is within a polygon (2d information). The idea is presented in the picture below.
Screenshot_20221121_154647

@xmfcx
Copy link
Contributor

xmfcx commented Jan 10, 2023

This is being worked on #2296

@xmfcx
Copy link
Contributor

xmfcx commented Feb 21, 2023

@WJaworskiRobotec is this issue now resolved with #2296 merged?

@WJaworskiRobotec
Copy link
Contributor Author

@xmfcx , Yes, this problem doesn't happen anymore, at least in the situation that was reported here. Issue can be closed.

@xmfcx xmfcx closed this as completed Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:perception Advanced sensor data processing and environment understanding. (auto-assigned) component:planning Route planning, decision-making, and navigation. (auto-assigned)
Projects
No open projects
Status: Done
Development

No branches or pull requests

8 participants