The bus driver is misinformed. There is NO law that gives bus drivers the right of way.
The Highway Code says in rule is 223
Buses, coaches and trams. Give priority to these vehicles when you can do so safely, especially when they signal to pull away from stops. Look out for people getting off a bus or tram and crossing the road.