If you are using you existing driveway to access your yard to install your accessory, No, you do not need an additional permit.
If you will make a new ingress/egress over the Right-of-Way for construction, Yes, you will need a permit. This would cover, pole barns, pools, sheds, barns, etc.