Do I have to file the the Conservation Commission if I'm working on my lakeside/riverside/swampside garden?

No, we generally do not regulate gardening. The same goes for vista pruning (for definition see Wetlands Protection Regulations or Scenic Mountain Act Regulation. A very specific activity which is exempt from regulation.