You have a choice of damaging the lining or the clips, depending on the method that you use to remove them. If you lever them, it damages the lining, if you pull them straight, it damages the clips (and yer hands when they suddenly give way).
I'd get some replacement clips in advance - you only need to release along 1 side to get access for the mounting hole and wiring.