The interior trim panel does indeed need to be removed first. After that's done roll the window completely down and with an upholstery lifting tool (Lisle #35400
Lisle Corporation pry straight upwards to remove the piece from the door shell.
The only really complex part---more awkward than anything---is re-installing the interior trim panel so it fits into the groove of that piece and keeping the door lock button in alignment while its slid back into place.
If you're serious about replacing all the door seals the only good quality parts come from the dealer and certainly NOT cheap. Honestly its rare for them to lose effectiveness until 10-15 years old. A bit of 3M's silicone wet-type lubricant #08877 does wonders to keep the seals soft and supple which is important to them doing their job.
HTH---PM me if further info is needed---glad to help if I can!