Do we have to publish new version everytime just to update minute things in a plugin?

Do not inline those files that you want to update without publishing a new version of the plugin. Just store them on your server, make network requests to access them, and update them whenever you want.

↑ You can use this as a workaround, but I’d like to add that there is nothing bad about publishing a plugin update, it doesn’t break or change anything for the users, so there is no point in trying to avoid it in my opinion.