Some developers argue that code refactoring is a waste of time and that it is preferable to simply write clean code from the start. Others consider code refactoring to be an important part of the development process.  

I want to ask, is code refactoring always necessary, or are there times when it isn't worth the effort?