This is definitely possible.
You can use the portable version of Notezilla from here: http://www.conceptworld.com/Notezilla/Portable
This is exactly as the installer version, just that it doesn't come with an installer. So you can run Notezilla from the extracted folder and the data is also saved in the same folder under the folder named Data.
- Go to the link above. Extract the .zip file into a separate folder.
- Exit existing Notezilla
- Run Notezilla .exe from the extracted folder
- Right click on Notezilla icon and choose Sync and sign into your Notezilla.Net account (any one of the two) to download all your notes.
So basically, you can use 1 installed version and 1 portable version on the same system.
Or you could keep 2 portable versions in separate folders and remove the installed version completely.
Also, we have Android and iPhone apps for Notezilla . You can use those to access your notes from your phone and sync your sticky notes automatically every minute from your desktop.