Can we create a conditional route map? If next hop A is not reachable then it should go to next hop B, is that possible?

it is very simple no need for route mape you can do this jobeby using two stsic routes with deferent admindistance to the same network with deferent nexthop.

if you need to use rout mape you can use policy based routing PBR

or you can use routing protocols if you dont want to do static