As mentioned, you just pry them out. they are only held by friction.
I can also speak to the question re removal to get the valves cover off: No you do not need to remove them. If you have a RT model the left lower will need to come off and the guard runs through the lowers so that is a bit awkward but not insurmountable. Just let the lower hang from the guard.
HTH