I guess that you are talking about how to manage (edit/upgrade/install) your WordPress on AWS or any other Cloud Provider, isn't it?
You can do everything that you can do locally on the Cloud. The main difference is that you will need to connect via SSH to your instance in the Cloud in order to deploy them. You can find information about how to do that in the link below:
The second difference is that you'll be connecting to a Linux System (not a Windows one) and you won't have a Graphical Interface. Every action you deploy must be done using a console.
In the WP Documentation for AWS you will find information about how to do everything (upgrade, edit files, install plugins, etc.).
A good alternative for you is to develop your site locally (on your Windows computer) and once you're happy with the result migrate your WP to the Cloud as described in this guide.
I hope this information is useful for you. If you have any other questions, please do not hesitate to let us know.
Was my answer helpful? Click on