Nothing to worry about, no need to take out the batteries, either, but it's fine to do that if you want. The only issue with batteries is that you can't put spare Li-ion batteries (e.g. a camera battery) in your checked luggage - you must carry them on (they've caused fires in the cargo hold on occasion).