If I set off from here (the rafting stage), will I come back to here?

Yes, but hopefully not with the boat – as the river does not go round in a circle. You will have a short journey by road.