If you use the
uninstall program or remove your directory, Joomla! should not appear in your LAMP application section and you can't access to it. If you have to use it, you have to install the application again.
I hope it helps. Please, let me know if you need anything else.