1 \documentclass[USenglish]{ifimaster}
3 \usepackage[utf8]{inputenc}
4 \usepackage[T1]{fontenc,url}
5 \usepackage{lmodern} % using Latin Modern to be able to use bold typewriter font
10 \usepackage{tikz-qtree}
11 \usetikzlibrary{shapes,snakes,trees,arrows,shadows,positioning,calc}
12 \usepackage{babel,textcomp,csquotes,ifimasterforside,varioref}
13 \usepackage[hidelinks]{hyperref}
15 \usepackage[style=alphabetic,backend=bibtex]{biblatex}
18 % use 'disable' before printing:
19 \usepackage[]{todonotes}
26 \usepackage{perpage} %the perpage package
27 \MakePerPage{footnote} %the perpage package command
29 \theoremstyle{definition}
30 \newtheorem*{wordDef}{Definition}
32 \graphicspath{ {./figures/} }
34 \newcommand{\citing}[1]{~\cite{#1}}
35 \newcommand{\myref}[1]{\cref{#1} on \cpageref{#1}}
37 \newcommand{\definition}[1]{\begin{wordDef}#1\end{wordDef}}
38 \newcommand{\see}[1]{(see \myref{#1})}
39 \newcommand{\See}[1]{(See \myref{#1}.)}
40 \newcommand{\explanation}[3]{\noindent\textbf{\textit{#1}}\\*\emph{When:}
41 #2\\*\emph{How:} #3\\*[-7px]}
43 %\newcommand{\type}[1]{\lstinline{#1}}
44 \newcommand{\code}[1]{\texttt{\textbf{#1}}}
45 \newcommand{\type}[1]{\code{#1}}
46 \newcommand{\typeref}[1]{\footnote{\type{#1}}}
47 \newcommand{\typewithref}[2]{\type{#2}\typeref{#1.#2}}
48 \newcommand{\method}[1]{\type{#1}}
49 \newcommand{\methodref}[2]{\footnote{\type{#1}\method{\##2()}}}
50 \newcommand{\methodwithref}[2]{\method{#2}\footnote{\type{#1}\method{\##2()}}}
51 \newcommand{\var}[1]{\type{#1}}
53 \newcommand{\refactoring}[1]{\emph{#1}}
54 \newcommand{\ExtractMethod}{\refactoring{Extract Method}\xspace}
55 \newcommand{\MoveMethod}{\refactoring{Move Method}\xspace}
56 \newcommand{\ExtractAndMoveMethod}{\refactoring{Extract and Move Method}\xspace}
58 \newcommand\todoin[2][]{\todo[inline, caption={2do}, #1]{
59 \begin{minipage}{\textwidth-4pt}#2\end{minipage}}}
63 \author{Erlend Kristiansen}
65 \bibliography{bibliography/master-thesis-erlenkr-bibliography}
67 % UML comment in TikZ:
68 % ref: https://tex.stackexchange.com/questions/103688/folded-paper-shape-tikz
70 \pgfdeclareshape{umlcomment}{
71 \inheritsavedanchors[from=rectangle] % this is nearly a rectangle
72 \inheritanchorborder[from=rectangle]
73 \inheritanchor[from=rectangle]{center}
74 \inheritanchor[from=rectangle]{north}
75 \inheritanchor[from=rectangle]{south}
76 \inheritanchor[from=rectangle]{west}
77 \inheritanchor[from=rectangle]{east}
78 % ... and possibly more
79 \backgroundpath{% this is new
80 % store lower right in xa/ya and upper right in xb/yb
81 \southwest \pgf@xa=\pgf@x \pgf@ya=\pgf@y
82 \northeast \pgf@xb=\pgf@x \pgf@yb=\pgf@y
83 % compute corner of ‘‘flipped page’’
84 \pgf@xc=\pgf@xb \advance\pgf@xc by-10pt % this should be a parameter
85 \pgf@yc=\pgf@yb \advance\pgf@yc by-10pt
87 \pgfpathmoveto{\pgfpoint{\pgf@xa}{\pgf@ya}}
88 \pgfpathlineto{\pgfpoint{\pgf@xa}{\pgf@yb}}
89 \pgfpathlineto{\pgfpoint{\pgf@xc}{\pgf@yb}}
90 \pgfpathlineto{\pgfpoint{\pgf@xb}{\pgf@yc}}
91 \pgfpathlineto{\pgfpoint{\pgf@xb}{\pgf@ya}}
94 \pgfpathmoveto{\pgfpoint{\pgf@xc}{\pgf@yb}}
95 \pgfpathlineto{\pgfpoint{\pgf@xc}{\pgf@yc}}
96 \pgfpathlineto{\pgfpoint{\pgf@xb}{\pgf@yc}}
97 \pgfpathlineto{\pgfpoint{\pgf@xc}{\pgf@yc}}
102 \tikzstyle{comment}=[%
121 \todoin{\textbf{Remove all todos (including list) before delivery/printing!!!
122 Can be done by removing ``draft'' from documentclass.}}
123 \todoin{Write abstract}
131 The discussions in this report must be seen in the context of object oriented
132 programming languages, and Java in particular, since that is the language in
133 which most of the examples will be given. All though the techniques discussed
134 may be applicable to languages from other paradigms, they will not be the
135 subject of this report.
139 \chapter{What is Refactoring?}
141 This question is best answered by first defining the concept of a
142 \emph{refactoring}, what it is to \emph{refactor}, and then discuss what aspects
143 of programming make people want to refactor their code.
145 \section{Defining refactoring}
146 Martin Fowler, in his classic book on refactoring\citing{refactoring}, defines a
147 refactoring like this:
150 \emph{Refactoring} (noun): a change made to the internal
151 structure\footnote{The structure observable by the programmer.} of software to
152 make it easier to understand and cheaper to modify without changing its
153 observable behavior.~\cite[p.~53]{refactoring}
156 \noindent This definition assigns additional meaning to the word
157 \emph{refactoring}, beyond the composition of the prefix \emph{re-}, usually
158 meaning something like ``again'' or ``anew'', and the word \emph{factoring},
159 that can mean to isolate the \emph{factors} of something. Here a \emph{factor}
160 would be close to the mathematical definition of something that divides a
161 quantity, without leaving a remainder. Fowler is mixing the \emph{motivation}
162 behind refactoring into his definition. Instead it could be more refined, formed
163 to only consider the \emph{mechanical} and \emph{behavioral} aspects of
164 refactoring. That is to factor the program again, putting it together in a
165 different way than before, while preserving the behavior of the program. An
166 alternative definition could then be:
168 \definition{A \emph{refactoring} is a transformation
169 done to a program without altering its external behavior.}
171 From this we can conclude that a refactoring primarily changes how the
172 \emph{code} of a program is perceived by the \emph{programmer}, and not the
173 \emph{behavior} experienced by any user of the program. Although the logical
174 meaning is preserved, such changes could potentially alter the program's
175 behavior when it comes to performance gain or -penalties. So any logic depending
176 on the performance of a program could make the program behave differently after
179 In the extreme case one could argue that such a thing as \emph{software
180 obfuscation} is refactoring. Software obfuscation is to make source code harder
181 to read and analyze, while preserving its semantics. It could be done composing
182 many, more or less randomly chosen, refactorings. Then the question arise
183 whether it can be called a \emph{composite refactoring}
184 \see{compositeRefactorings} or not? The answer is not obvious. First, there is
185 no way to describe \emph{the} mechanics of software obfuscation, beacause there
186 are infinitely many ways to do that. Second, \emph{obfuscation} can be thought
187 of as \emph{one operation}: Either the code is obfuscated, or it is not. Third,
188 it makes no sense to call software obfuscation \emph{a} refactoring, since it
189 holds different meaning to different people. The last point is important, since
190 one of the motivations behind defining different refactorings is to build up a
191 vocabulary for software professionals to reason and discuss about programs,
192 similar to the motivation behind design patterns\citing{designPatterns}. So for
193 describing \emph{software obfuscation}, it might be more appropriate to define
194 what you do when performing it rather than precisely defining its mechanics in
195 terms of other refactorings.
197 \section{The etymology of 'refactoring'}
198 It is a little difficult to pinpoint the exact origin of the word
199 ``refactoring'', as it seems to have evolved as part of a colloquial
200 terminology, more than a scientific term. There is no authoritative source for a
201 formal definition of it.
203 According to Martin Fowler\citing{etymology-refactoring}, there may also be more
204 than one origin of the word. The most well-known source, when it comes to the
205 origin of \emph{refactoring}, is the Smalltalk\footnote{\emph{Smalltalk},
206 object-oriented, dynamically typed, reflective programming language. See
207 \url{http://www.smalltalk.org}} community and their infamous \emph{Refactoring
208 Browser}\footnote{\url{http://st-www.cs.illinois.edu/users/brant/Refactory/RefactoringBrowser.html}}
209 described in the article \emph{A Refactoring Tool for
210 Smalltalk}\citing{refactoringBrowser1997}, published in 1997.
211 Allegedly\citing{etymology-refactoring}, the metaphor of factoring programs was
212 also present in the Forth\footnote{\emph{Forth} -- stack-based, extensible
213 programming language, without type-checking. See \url{http://www.forth.org}}
214 community, and the word ``refactoring'' is mentioned in a book by Leo Brodie,
215 called \emph{Thinking Forth}\citing{brodie1984}, first published in
216 1984\footnote{\emph{Thinking Forth} was first published in 1984 by the
217 \emph{Forth Interest Group}. Then it was reprinted in 1994 with minor
218 typographical corrections, before it was transcribed into an electronic edition
219 typeset in \LaTeX\ and published under a Creative Commons licence in 2004. The
220 edition cited here is the 2004 edition, but the content should essentially be as
221 in 1984.}. The exact word is only printed one place~\cite[p.~232]{brodie1984},
222 but the term \emph{factoring} is prominent in the book, that also contains a
223 whole chapter dedicated to (re)factoring, and how to keep the (Forth) code clean
227 \ldots good factoring technique is perhaps the most important skill for a
228 Forth programmer.~\cite[p.~172]{brodie1984}
231 \noindent Brodie also express what \emph{factoring} means to him:
234 Factoring means organizing code into useful fragments. To make a fragment
235 useful, you often must separate reusable parts from non-reusable parts. The
236 reusable parts become new definitions. The non-reusable parts become arguments
237 or parameters to the definitions.~\cite[p.~172]{brodie1984}
240 Fowler claims that the usage of the word \emph{refactoring} did not pass between
241 the \emph{Forth} and \emph{Smalltalk} communities, but that it emerged
242 independently in each of the communities.
244 \section{Motivation -- Why people refactor}
245 There are many reasons why people want to refactor their programs. They can for
246 instance do it to remove duplication, break up long methods or to introduce
247 design patterns\citing{designPatterns} into their software systems. The shared
248 trait for all these are that peoples intentions are to make their programs
249 \emph{better}, in some sense. But what aspects of their programs are becoming
252 As already mentioned, people often refactor to get rid of duplication. Moving
253 identical or similar code into methods, and maybe pushing methods up or down in
254 their class hierarchies. Making template methods for overlapping
255 algorithms/functionality and so on. It is all about gathering what belongs
256 together and putting it all in one place. The resulting code is then easier to
257 maintain. When removing the implicit coupling\footnote{When duplicating code,
258 the code might not be coupled in other ways than that it is supposed to
259 represent the same functionality. So if this functionality is going to change,
260 it might need to change in more than one place, thus creating an implicit
261 coupling between the multiple pieces of code.} between code snippets, the
262 location of a bug is limited to only one place, and new functionality need only
263 to be added to this one place, instead of a number of places people might not
266 A problem you often encounter when programming, is that a program contains a lot
267 of long and hard-to-grasp methods. It can then help to break the methods into
268 smaller ones, using the \ExtractMethod refactoring\citing{refactoring}. Then you
269 may discover something about a program that you were not aware of before;
270 revealing bugs you did not know about or could not find due to the complex
271 structure of your program. \todo{Proof?} Making the methods smaller and giving
272 good names to the new ones clarifies the algorithms and enhances the
273 \emph{understandability} of the program \see{magic_number_seven}. This makes
274 refactoring an excellent method for exploring unknown program code, or code that
275 you had forgotten that you wrote.
277 Most primitive refactorings are simple. Their true power is first revealed when
278 they are combined into larger --- higher level --- refactorings, called
279 \emph{composite refactorings} \see{compositeRefactorings}. Often the goal of
280 such a series of refactorings is a design pattern. Thus the \emph{design} can be
281 evolved throughout the lifetime of a program, as opposed to designing up-front.
282 It is all about being structured and taking small steps to improve a program's
285 Many software design pattern are aimed at lowering the coupling between
286 different classes and different layers of logic. One of the most famous is
287 perhaps the \emph{Model-View-Controller}\citing{designPatterns} pattern. It is
288 aimed at lowering the coupling between the user interface and the business logic
289 and data representation of a program. This also has the added benefit that the
290 business logic could much easier be the target of automated tests, increasing
291 the productivity in the software development process. Refactoring is an
292 important tool on the way to something greater.
294 Another effect of refactoring is that with the increased separation of concerns
295 coming out of many refactorings, the \emph{performance} can be improved. When
296 profiling programs, the problematic parts are narrowed down to smaller parts of
297 the code, which are easier to tune, and optimization can be performed only where
298 needed and in a more effective way.
300 Last, but not least, and this should probably be the best reason to refactor, is
301 to refactor to \emph{facilitate a program change}. If one has managed to keep
302 one's code clean and tidy, and the code is not bloated with design patterns that
303 are not ever going to be needed, then some refactoring might be needed to
304 introduce a design pattern that is appropriate for the change that is going to
307 Refactoring program code --- with a goal in mind --- can give the code itself
308 more value. That is in the form of robustness to bugs, understandability and
309 maintainability. Having robust code is an obvious advantage, but
310 understandability and maintainability are both very important aspects of
311 software development. By incorporating refactoring in the development process,
312 bugs are found faster, new functionality is added more easily and code is easier
313 to understand by the next person exposed to it, which might as well be the
314 person who wrote it. The consequence of this, is that refactoring can increase
315 the average productivity of the development process, and thus also add to the
316 monetary value of a business in the long run. The perspective on productivity
317 and money should also be able to open the eyes of the many nearsighted managers
318 that seldom see beyond the next milestone.
320 \section{The magical number seven}\label{magic_number_seven}
321 The article \emph{The magical number seven, plus or minus two: some limits on
322 our capacity for processing information}\citing{miller1956} by George A.
323 Miller, was published in the journal \emph{Psychological Review} in 1956. It
324 presents evidence that support that the capacity of the number of objects a
325 human being can hold in its working memory is roughly seven, plus or minus two
326 objects. This number varies a bit depending on the nature and complexity of the
327 objects, but is according to Miller ``\ldots never changing so much as to be
330 Miller's article culminates in the section called \emph{Recoding}, a term he
331 borrows from communication theory. The central result in this section is that by
332 recoding information, the capacity of the amount of information that a human can
333 process at a time is increased. By \emph{recoding}, Miller means to group
334 objects together in chunks and give each chunk a new name that it can be
335 remembered by. By organizing objects into patterns of ever growing depth, one
336 can memorize and process a much larger amount of data than if it were to be
337 represented as its basic pieces. This grouping and renaming is analogous to how
338 many refactorings work, by grouping pieces of code and give them a new name.
339 Examples are the fundamental \ExtractMethod and \refactoring{Extract Class}
340 refactorings\citing{refactoring}.
343 \ldots recoding is an extremely powerful weapon for increasing the amount of
344 information that we can deal with.~\cite[p.~95]{miller1956}
347 An example from the article addresses the problem of memorizing a sequence of
348 binary digits. Let us say we have the following sequence\footnote{The example
349 presented here is slightly modified (and shortened) from what is presented in
350 the original article\citing{miller1956}, but it is essentially the same.} of
351 16 binary digits: ``1010001001110011''. Most of us will have a hard time
352 memorizing this sequence by only reading it once or twice. Imagine if we instead
353 translate it to this sequence: ``A273''. If you have a background from computer
354 science, it will be obvious that the latest sequence is the first sequence
355 recoded to be represented by digits with base 16. Most people should be able to
356 memorize this last sequence by only looking at it once.
358 Another result from the Miller article is that when the amount of information a
359 human must interpret increases, it is crucial that the translation from one code
360 to another must be almost automatic for the subject to be able to remember the
361 translation, before \heshe is presented with new information to recode. Thus
362 learning and understanding how to best organize certain kinds of data is
363 essential to efficiently handle that kind of data in the future. This is much
364 like when humans learn to read. First they must learn how to recognize letters.
365 Then they can learn distinct words, and later read sequences of words that form
366 whole sentences. Eventually, most of them will be able to read whole books and
367 briefly retell the important parts of its content. This suggest that the use of
368 design patterns\citing{designPatterns} is a good idea when reasoning about
369 computer programs. With extensive use of design patterns when creating complex
370 program structures, one does not always have to read whole classes of code to
371 comprehend how they function, it may be sufficient to only see the name of a
372 class to almost fully understand its responsibilities.
375 Our language is tremendously useful for repackaging material into a few chunks
376 rich in information.~\cite[p.~95]{miller1956}
379 Without further evidence, these results at least indicate that refactoring
380 source code into smaller units with higher cohesion and, when needed,
381 introducing appropriate design patterns, should aid in the cause of creating
382 computer programs that are easier to maintain and has code that is easier (and
385 \section{Notable contributions to the refactoring literature}
386 \todoin{Update with more contributions}
389 \item[1992] William F. Opdyke submits his doctoral dissertation called
390 \emph{Refactoring Object-Oriented Frameworks}\citing{opdyke1992}. This
391 work defines a set of refactorings, that are behavior preserving given that
392 their preconditions are met. The dissertation is focused on the automation
394 \item[1999] Martin Fowler et al.: \emph{Refactoring: Improving the Design of
395 Existing Code}\citing{refactoring}. This is maybe the most influential text
396 on refactoring. It bares similarities with Opdykes thesis\citing{opdyke1992}
397 in the way that it provides a catalog of refactorings. But Fowler's book is
398 more about the craft of refactoring, as he focuses on establishing a
399 vocabulary for refactoring, together with the mechanics of different
400 refactorings and when to perform them. His methodology is also founded on
401 the principles of test-driven development.
402 \item[2005] Joshua Kerievsky: \emph{Refactoring to
403 Patterns}\citing{kerievsky2005}. This book is heavily influenced by Fowler's
404 \emph{Refactoring}\citing{refactoring} and the ``Gang of Four'' \emph{Design
405 Patterns}\citing{designPatterns}. It is building on the refactoring
406 catalogue from Fowler's book, but is trying to bridge the gap between
407 \emph{refactoring} and \emph{design patterns} by providing a series of
408 higher-level composite refactorings, that makes code evolve toward or away
409 from certain design patterns. The book is trying to build up the readers
410 intuition around \emph{why} one would want to use a particular design
411 pattern, and not just \emph{how}. The book is encouraging evolutionary
412 design. \See{relationToDesignPatterns}
415 \section{Tool support (for Java)}\label{toolSupport}
416 This section will briefly compare the refatoring support of the three IDEs
417 \emph{Eclipse}\footnote{\url{http://www.eclipse.org/}}, \emph{IntelliJ
418 IDEA}\footnote{The IDE under comparison is the \emph{Community Edition},
419 \url{http://www.jetbrains.com/idea/}} and
420 \emph{NetBeans}\footnote{\url{https://netbeans.org/}}. These are the most
421 popular Java IDEs\citing{javaReport2011}.
423 All three IDEs provide support for the most useful refactorings, like the
424 different extract, move and rename refactorings. In fact, Java-targeted IDEs are
425 known for their good refactoring support, so this did not appear as a big
428 The IDEs seem to have excellent support for the \ExtractMethod refactoring, so
429 at least they have all passed the first refactoring
430 rubicon\citing{fowlerRubicon2001,secondRubicon2012}.
432 Regarding the \MoveMethod refactoring, the \emph{Eclipse} and \emph{IntelliJ}
433 IDEs do the job in very similar manners. In most situations they both do a
434 satisfying job by producing the expected outcome. But they do nothing to check
435 that the result does not break the semantics of the program \see{correctness}.
436 The \emph{NetBeans} IDE implements this refactoring in a somewhat
437 unsophisticated way. For starters, its default destination for the move is
438 itself, although it refuses to perform the refactoring if chosen. But the worst
439 part is, that if moving the method \method{f} of the class \type{C} to the class
440 \type{X}, it will break the code. The result is shown in
441 \myref{lst:moveMethod_NetBeans}.
445 \begin{minted}[samepage]{java}
458 \begin{minted}[samepage]{java}
468 \caption{Moving method \method{f} from \type{C} to \type{X}.}
469 \label{lst:moveMethod_NetBeans}
472 NetBeans will try to make code that call the methods \method{m} and \method{n}
473 of \type{X} by accessing them through \var{c.x}, where \var{c} is a parameter of
474 type \type{C} that is added the method \method{f} when it is moved. (This is
475 seldom the desired outcome of this refactoring, but ironically, this ``feature''
476 keeps NetBeans from breaking the code in the example from \myref{correctness}.)
477 If \var{c.x} for some reason is inaccessible to \type{X}, as in this case, the
478 refactoring breaks the code, and it will not compile. NetBeans presents a
479 preview of the refactoring outcome, but the preview does not catch it if the IDE
480 is about break the program.
482 The IDEs under investigation seems to have fairly good support for primitive
483 refactorings, but what about more complex ones, such as the \refactoring{Extract
484 Class}\citing{refactoring}? The \refactoring{Extract Class} refactoring works by
485 creating a class, for then to move members to that class and access them from
486 the old class via a reference to the new class. \emph{IntelliJ} handles this in
487 a fairly good manner, although, in the case of private methods, it leaves unused
488 methods behind. These are methods that delegate to a field with the type of the
489 new class, but are not used anywhere. \emph{Eclipse} has added (or withdrawn)
490 its own quirk to the Extract Class refactoring, and only allows for
491 \emph{fields} to be moved to a new class, \emph{not methods}. This makes it
492 effectively only extracting a data structure, and calling it
493 \refactoring{Extract Class} is a little misleading. One would often be better
494 off with textual extract and paste than using the Extract Class refactoring in
495 Eclipse. When it comes to \emph{NetBeans}, it does not even seem to have made an
496 attempt on providing this refactoring. (Well, it probably has, but it does not
499 \todoin{Visual Studio (C++/C\#), Smalltalk refactoring browser?,
500 second refactoring rubicon?}
502 \section{The relation to design patterns}\label{relationToDesignPatterns}
504 \emph{Refactoring} and \emph{design patterns} have at least one thing in common,
505 they are both promoted by advocates of \emph{clean code}\citing{cleanCode} as
506 fundamental tools on the road to more maintanable and extendable source code.
509 Design patterns help you determine how to reorganize a design, and they can
510 reduce the amount of refactoring you need to do
511 later.~\cite[p.~353]{designPatterns}
514 Although sometimes associated with
515 over-engineering\citing{kerievsky2005,refactoring}, design patterns are in
516 general assumed to be good for maintainability of source code. That may be
517 because many of them are designed to support the \emph{open/closed principle} of
518 object-oriented programming. The principle was first formulated by Bertrand
519 Meyer, the creator of the Eiffel programming language, like this: ``Modules
520 should be both open and closed.''\citing{meyer1988} It has been popularized,
521 with this as a common version:
524 Software entities (classes, modules, functions, etc.) should be open for
525 extension, but closed for modification.\footnote{See
526 \url{http://c2.com/cgi/wiki?OpenClosedPrinciple} or
527 \url{https://en.wikipedia.org/wiki/Open/closed_principle}}
530 Maintainability is often thought of as the ability to be able to introduce new
531 functionality without having to change too much of the old code. When
532 refactoring, the motivation is often to facilitate adding new functionality. It
533 is about factoring the old code in a way that makes the new functionality being
534 able to benefit from the functionality already residing in a software system,
535 without having to copy old code into new. Then, next time someone shall add new
536 functionality, it is less likely that the old code has to change. Assuming that
537 a design pattern is the best way to get rid of duplication and assist in
538 implementing new functionality, it is reasonable to conclude that a design
539 pattern often is the target of a series of refactorings. Having a repertoire of
540 design patterns can also help in knowing when and how to refactor a program to
541 make it reflect certain desired characteristics.
544 There is a natural relation between patterns and refactorings. Patterns are
545 where you want to be; refactorings are ways to get there from somewhere
546 else.~\cite[p.~107]{refactoring}
549 This quote is wise in many contexts, but it is not always appropriate to say
550 ``Patterns are where you want to be\ldots''. \emph{Sometimes}, patterns are
551 where you want to be, but only because it will benefit your design. It is not
552 true that one should always try to incorporate as many design patterns as
553 possible into a program. It is not like they have intrinsic value. They only add
554 value to a system when they support its design. Otherwise, the use of design
555 patterns may only lead to a program that is more complex than necessary.
558 The overuse of patterns tends to result from being patterns happy. We are
559 \emph{patterns happy} when we become so enamored of patterns that we simply
560 must use them in our code.~\cite[p.~24]{kerievsky2005}
563 This can easily happen when relying largely on up-front design. Then it is
564 natural, in the very beginning, to try to build in all the flexibility that one
565 believes will be necessary throughout the lifetime of a software system.
566 According to Joshua Kerievsky ``That sounds reasonable --- if you happen to be
567 psychic.''~\cite[p.~1]{kerievsky2005} He is advocating what he believes is a
568 better approach: To let software continually evolve. To start with a simple
569 design that meets today's needs, and tackle future needs by refactoring to
570 satisfy them. He believes that this is a more economic approach than investing
571 time and money into a design that inevitably is going to change. By relying on
572 continuously refactoring a system, its design can be made simpler without
573 sacrificing flexibility. To be able to fully rely on this approach, it is of
574 utter importance to have a reliable suit of tests to lean on. \See{testing} This
575 makes the design process more natural and less characterized by difficult
576 decisions that has to be made before proceeding in the process, and that is
577 going to define a project for all of its unforeseeable future.
581 \section{Classification of refactorings}
582 % only interesting refactorings
583 % with 2 detailed examples? One for structured and one for intra-method?
584 % Is replacing Bubblesort with Quick Sort considered a refactoring?
586 \subsection{Structural refactorings}
588 \subsubsection{Primitive refactorings}
591 \explanation{Extract Method}{You have a code fragment that can be grouped
592 together.}{Turn the fragment into a method whose name explains the purpose of
595 \explanation{Inline Method}{A method's body is just as clear as its name.}{Put
596 the method's body into the body of its callers and remove the method.}
598 \explanation{Inline Temp}{You have a temp that is assigned to once with a simple
599 expression, and the temp is getting in the way of other refactorings.}{Replace
600 all references to that temp with the expression}
602 % Moving Features Between Objects
603 \explanation{Move Method}{A method is, or will be, using or used by more
604 features of another class than the class on which it is defined.}{Create a new
605 method with a similar body in the class it uses most. Either turn the old method
606 into a simple delegation, or remove it altogether.}
608 \explanation{Move Field}{A field is, or will be, used by another class more than
609 the class on which it is defined}{Create a new field in the target class, and
610 change all its users.}
613 \explanation{Replace Magic Number with Symbolic Constant}{You have a literal
614 number with a particular meaning.}{Create a constant, name it after the meaning,
615 and replace the number with it.}
617 \explanation{Encapsulate Field}{There is a public field.}{Make it private and
620 \explanation{Replace Type Code with Class}{A class has a numeric type code that
621 does not affect its behavior.}{Replace the number with a new class.}
623 \explanation{Replace Type Code with Subclasses}{You have an immutable type code
624 that affects the behavior of a class.}{Replace the type code with subclasses.}
626 \explanation{Replace Type Code with State/Strategy}{You have a type code that
627 affects the behavior of a class, but you cannot use subclassing.}{Replace the
628 type code with a state object.}
630 % Simplifying Conditional Expressions
631 \explanation{Consolidate Duplicate Conditional Fragments}{The same fragment of
632 code is in all branches of a conditional expression.}{Move it outside of the
635 \explanation{Remove Control Flag}{You have a variable that is acting as a
636 control flag fro a series of boolean expressions.}{Use a break or return
639 \explanation{Replace Nested Conditional with Guard Clauses}{A method has
640 conditional behavior that does not make clear the normal path of
641 execution.}{Use guard clauses for all special cases.}
643 \explanation{Introduce Null Object}{You have repeated checks for a null
644 value.}{Replace the null value with a null object.}
646 \explanation{Introduce Assertion}{A section of code assumes something about the
647 state of the program.}{Make the assumption explicit with an assertion.}
649 % Making Method Calls Simpler
650 \explanation{Rename Method}{The name of a method does not reveal its
651 purpose.}{Change the name of the method}
653 \explanation{Add Parameter}{A method needs more information from its
654 caller.}{Add a parameter for an object that can pass on this information.}
656 \explanation{Remove Parameter}{A parameter is no longer used by the method
659 %\explanation{Parameterize Method}{Several methods do similar things but with
660 %different values contained in the method.}{Create one method that uses a
661 %parameter for the different values.}
663 \explanation{Preserve Whole Object}{You are getting several values from an
664 object and passing these values as parameters in a method call.}{Send the whole
667 \explanation{Remove Setting Method}{A field should be set at creation time and
668 never altered.}{Remove any setting method for that field.}
670 \explanation{Hide Method}{A method is not used by any other class.}{Make the
673 \explanation{Replace Constructor with Factory Method}{You want to do more than
674 simple construction when you create an object}{Replace the constructor with a
677 % Dealing with Generalization
678 \explanation{Pull Up Field}{Two subclasses have the same field.}{Move the field
681 \explanation{Pull Up Method}{You have methods with identical results on
682 subclasses.}{Move them to the superclass.}
684 \explanation{Push Down Method}{Behavior on a superclass is relevant only for
685 some of its subclasses.}{Move it to those subclasses.}
687 \explanation{Push Down Field}{A field is used only by some subclasses.}{Move the
688 field to those subclasses}
690 \explanation{Extract Interface}{Several clients use the same subset of a class's
691 interface, or two classes have part of their interfaces in common.}{Extract the
692 subset into an interface.}
694 \explanation{Replace Inheritance with Delegation}{A subclass uses only part of a
695 superclasses interface or does not want to inherit data.}{Create a field for the
696 superclass, adjust methods to delegate to the superclass, and remove the
699 \explanation{Replace Delegation with Inheritance}{You're using delegation and
700 are often writing many simple delegations for the entire interface}{Make the
701 delegating class a subclass of the delegate.}
703 \subsubsection{Composite refactorings}
706 % \explanation{Replace Method with Method Object}{}{}
708 % Moving Features Between Objects
709 \explanation{Extract Class}{You have one class doing work that should be done by
710 two}{Create a new class and move the relevant fields and methods from the old
711 class into the new class.}
713 \explanation{Inline Class}{A class isn't doing very much.}{Move all its features
714 into another class and delete it.}
716 \explanation{Hide Delegate}{A client is calling a delegate class of an
717 object.}{Create Methods on the server to hide the delegate.}
719 \explanation{Remove Middle Man}{A class is doing to much simple delegation.}{Get
720 the client to call the delegate directly.}
723 \explanation{Replace Data Value with Object}{You have a data item that needs
724 additional data or behavior.}{Turn the data item into an object.}
726 \explanation{Change Value to Reference}{You have a class with many equal
727 instances that you want to replace with a single object.}{Turn the object into a
730 \explanation{Encapsulate Collection}{A method returns a collection}{Make it
731 return a read-only view and provide add/remove methods.}
733 % \explanation{Replace Array with Object}{}{}
735 \explanation{Replace Subclass with Fields}{You have subclasses that vary only in
736 methods that return constant data.}{Change the methods to superclass fields and
737 eliminate the subclasses.}
739 % Simplifying Conditional Expressions
740 \explanation{Decompose Conditional}{You have a complicated conditional
741 (if-then-else) statement.}{Extract methods from the condition, then part, an
744 \explanation{Consolidate Conditional Expression}{You have a sequence of
745 conditional tests with the same result.}{Combine them into a single conditional
746 expression and extract it.}
748 \explanation{Replace Conditional with Polymorphism}{You have a conditional that
749 chooses different behavior depending on the type of an object.}{Move each leg
750 of the conditional to an overriding method in a subclass. Make the original
753 % Making Method Calls Simpler
754 \explanation{Replace Parameter with Method}{An object invokes a method, then
755 passes the result as a parameter for a method. The receiver can also invoke this
756 method.}{Remove the parameter and let the receiver invoke the method.}
758 \explanation{Introduce Parameter Object}{You have a group of parameters that
759 naturally go together.}{Replace them with an object.}
761 % Dealing with Generalization
762 \explanation{Extract Subclass}{A class has features that are used only in some
763 instances.}{Create a subclass for that subset of features.}
765 \explanation{Extract Superclass}{You have two classes with similar
766 features.}{Create a superclass and move the common features to the
769 \explanation{Collapse Hierarchy}{A superclass and subclass are not very
770 different.}{Merge them together.}
772 \explanation{Form Template Method}{You have two methods in subclasses that
773 perform similar steps in the same order, yet the steps are different.}{Get the
774 steps into methods with the same signature, so that the original methods become
775 the same. Then you can pull them up.}
778 \subsection{Functional refactorings}
780 \explanation{Substitute Algorithm}{You want to replace an algorithm with one
781 that is clearer.}{Replace the body of the method with the new algorithm.}
785 \section{The impact on software quality}
787 \subsection{What is software quality?}
788 The term \emph{software quality} has many meanings. It all depends on the
789 context we put it in. If we look at it with the eyes of a software developer, it
790 usually means that the software is easily maintainable and testable, or in other
791 words, that it is \emph{well designed}. This often correlates with the
792 management scale, where \emph{keeping the schedule} and \emph{customer
793 satisfaction} is at the center. From the customers point of view, in addition to
794 good usability, \emph{performance} and \emph{lack of bugs} is always
795 appreciated, measurements that are also shared by the software developer. (In
796 addition, such things as good documentation could be measured, but this is out
797 of the scope of this document.)
799 \subsection{The impact on performance}
801 Refactoring certainly will make software go more slowly\footnote{With todays
802 compiler optimization techniques and performance tuning of e.g. the Java
803 virtual machine, the penalties of object creation and method calls are
804 debatable.}, but it also makes the software more amenable to performance
805 tuning.~\cite[p.~69]{refactoring}
808 \noindent There is a common belief that refactoring compromises performance, due
809 to increased degree of indirection and that polymorphism is slower than
812 In a survey, Demeyer\citing{demeyer2002} disproves this view in the case of
813 polymorphism. He did an experiment on, what he calls, ``Transform Self Type
814 Checks'' where you introduce a new polymorphic method and a new class hierarchy
815 to get rid of a class' type checking of a ``type attribute``. He uses this kind
816 of transformation to represent other ways of replacing conditionals with
817 polymorphism as well. The experiment is performed on the C++ programming
818 language and with three different compilers and platforms. Demeyer concludes
819 that, with compiler optimization turned on, polymorphism beats middle to large
820 sized if-statements and does as well as case-statements. (In accordance with
821 his hypothesis, due to similarities between the way C++ handles polymorphism and
825 The interesting thing about performance is that if you analyze most programs,
826 you find that they waste most of their time in a small fraction of the
827 code.~\cite[p.~70]{refactoring}
830 \noindent So, although an increased amount of method calls could potentially
831 slow down programs, one should avoid premature optimization and sacrificing good
832 design, leaving the performance tuning until after profiling\footnote{For and
833 example of a Java profiler, check out VisualVM:
834 \url{http://visualvm.java.net/}} the software and having isolated the actual
837 \section{Composite refactorings}\label{compositeRefactorings}
838 \todo{motivation, examples, manual vs automated?, what about refactoring in a
839 very large code base?}
840 Generally, when thinking about refactoring, at the mechanical level, there are
841 essentially two kinds of refactorings. There are the \emph{primitive}
842 refactorings, and the \emph{composite} refactorings.
844 \definition{A \emph{primitive refactoring} is a refactoring that cannot be
845 expressed in terms of other refactorings.}
847 \noindent Examples are the \refactoring{Pull Up Field} and \refactoring{Pull Up
848 Method} refactorings\citing{refactoring}, that move members up in their class
851 \definition{A \emph{composite refactoring} is a refactoring that can be
852 expressed in terms of two or more other refactorings.}
854 \noindent An example of a composite refactoring is the \refactoring{Extract
855 Superclass} refactoring\citing{refactoring}. In its simplest form, it is composed
856 of the previously described primitive refactorings, in addition to the
857 \refactoring{Pull Up Constructor Body} refactoring\citing{refactoring}. It works
858 by creating an abstract superclass that the target class(es) inherits from, then
859 by applying \refactoring{Pull Up Field}, \refactoring{Pull Up Method} and
860 \refactoring{Pull Up Constructor Body} on the members that are to be members of
861 the new superclass. For an overview of the \refactoring{Extract Superclass}
862 refactoring, see \myref{fig:extractSuperclass}.
866 \includegraphics[angle=270,width=\linewidth]{extractSuperclassItalic.pdf}
867 \caption{The Extract Superclass refactoring}
868 \label{fig:extractSuperclass}
871 \section{Manual vs. automated refactorings}
872 Refactoring is something every programmer does, even if \heshe does not known
873 the term \emph{refactoring}. Every refinement of source code that does not alter
874 the program's behavior is a refactoring. For small refactorings, such as
875 \ExtractMethod, executing it manually is a manageable task, but is still prone
876 to errors. Getting it right the first time is not easy, considering the method
877 signature and all the other aspects of the refactoring that has to be in place.
879 Take for instance the renaming of classes, methods and fields. For complex
880 programs these refactorings are almost impossible to get right. Attacking them
881 with textual search and replace, or even regular expressions, will fall short on
882 these tasks. Then it is crucial to have proper tool support that can perform
883 them automatically. Tools that can parse source code and thus have semantic
884 knowledge about which occurrences of which names belong to what construct in the
885 program. For even trying to perform one of these complex task manually, one
886 would have to be very confident on the existing test suite \see{testing}.
888 \section{Correctness of refactorings}\label{correctness}
889 For automated refactorings to be truly useful, they must show a high degree of
890 behavior preservation. This last sentence might seem obvious, but there are
891 examples of refactorings in existing tools that break programs. I will now
892 present an example of an \ExtractMethod refactoring followed by a \MoveMethod
893 refactoring that breaks a program in both the \emph{Eclipse} and \emph{IntelliJ}
894 IDEs\footnote{The NetBeans IDE handles this particular situation without
895 altering the program's beavior, mainly because its Move Method refactoring
896 implementation is a bit flawed in other ways \see{toolSupport}.}. The
897 following piece of code shows the target for the composed refactoring:
899 \begin{minted}[linenos,samepage]{java}
901 public X x = new X();
910 \noindent The next piece of code shows the destination of the refactoring. Note
911 that the method \method{m(C c)} of class \type{C} assigns to the field \var{x}
912 of the argument \var{c} that has type \type{C}:
914 \begin{minted}[samepage]{java}
923 The refactoring sequence works by extracting line 5 and 6 from the original
924 class \type{C} into a method \method{f} with the statements from those lines as
925 its method body. The method is then moved to the class \type{X}. The result is
926 shown in the following two pieces of code:
928 \begin{minted}[linenos,samepage]{java}
930 public X x = new X();
938 \begin{minted}[linenos,samepage]{java}
951 After the refactoring, the method \method{f} of class \type{C} is calling the
952 method \method{f} of class \type{X}, and the program now behaves different than
953 before. (See line 5 of the version of class \type{C} after the refactoring.)
954 Before the refactoring, the methods \method{m} and \method{n} of class \type{X}
955 are called on different object instances (see line 5 and 6 of the original class
956 \type{C}). After, they are called on the same object, and the statement on line
957 3 of class \type{X} (the version after the refactoring) no longer have any
958 effect in our example.
960 The bug introduced in the previous example is of such a nature\footnote{Caused
961 by aliasing. See \url{https://en.wikipedia.org/wiki/Aliasing_(computing)}}
962 that it is very difficult to spot if the refactored code is not covered by
963 tests. It does not generate compilation errors, and will thus only result in
964 a runtime error or corrupted data, which might be hard to detect.
966 \section{Refactoring and the importance of testing}\label{testing}
968 If you want to refactor, the essential precondition is having solid
969 tests.\citing{refactoring}
972 When refactoring, there are roughly three classes of errors that can be made.
973 The first class of errors are the ones that make the code unable to compile.
974 These \emph{compile-time} errors are of the nicer kind. They flash up at the
975 moment they are made (at least when using an IDE), and are usually easy to fix.
976 The second class are the \emph{runtime} errors. Although they take a bit longer
977 to surface, they usually manifest after some time in an illegal argument
978 exception, null pointer exception or similar during the program execution.
979 These kind of errors are a bit harder to handle, but at least they will show,
980 eventually. Then there are the \emph{behavior-changing} errors. These errors are
981 of the worst kind. They do not show up during compilation and they do not turn
982 on a blinking red light during runtime either. The program can seem to work
983 perfectly fine with them in play, but the business logic can be damaged in ways
984 that will only show up over time.
986 For discovering runtime errors and behavior changes when refactoring, it is
987 essential to have good test coverage. Testing in this context means writing
988 automated tests. Manual testing may have its uses, but when refactoring, it is
989 automated unit testing that dominate. For discovering behavior changes it is
990 especially important to have tests that cover potential problems, since these
991 kind of errors does not reveal themselves.
993 Unit testing is not a way to \emph{prove} that a program is correct, but it is a
994 way to make you confindent that it \emph{probably} works as desired. In the
995 context of test driven development (commonly known as TDD), the tests are even a
996 way to define how the program is \emph{supposed} to work. It is then, by
997 definition, working if the tests are passing.
999 If the test coverage for a code base is perfect, then it should, theoretically,
1000 be risk-free to perform refactorings on it. This is why automated tests and
1001 refactoring are such a great match.
1003 \subsection{Testing the code from correctness section}
1004 The worst thing that can happen when refactoring is to introduce changes to the
1005 behavior of a program, as in the example on \myref{correctness}. This example
1006 may be trivial, but the essence is clear. The only problem with the example is
1007 that it is not clear how to create automated tests for it, without changing it
1010 Unit tests, as they are known from the different xUnit frameworks around, are
1011 only suitable to test the \emph{result} of isolated operations. They can not
1012 easily (if at all) observe the \emph{history} of a program.
1014 This problem is still open.
1019 Assuming a sequential (non-concurrent) program:
1021 \begin{minted}{java}
1022 tracematch (C c, X x) {
1024 call(* X.m(C)) && args(c) && cflow(within(C));
1026 call(* X.n()) && target(x) && cflow(within(C));
1028 set(C.x) && target(c) && !cflow(m);
1032 { assert x == c.x; }
1036 %\begin{minted}{java}
1037 %tracematch (X x1, X x2) {
1039 % call(* X.m(C)) && target(x1);
1041 % call(* X.n()) && target(x2);
1043 % set(C.x) && !cflow(m) && !cflow(n);
1047 % { assert x1 != x2; }
1052 \section{The project}
1053 The aim of this master project will be to investigate the relationship between a
1054 composite refactoring composed of the \ExtractMethod and \MoveMethod
1055 refactorings, and its impact on one or more software metrics.
1057 The composition of the \ExtractMethod and \MoveMethod refactorings springs
1058 naturally out of the need to move procedures closer to the data they manipulate.
1059 This composed refactoring is not well described in the literature, but it is
1060 implemented in at least one tool called
1061 \emph{CodeRush}\footnote{\url{https://help.devexpress.com/\#CodeRush/CustomDocument3519}},
1062 that is an extension for \emph{MS Visual
1063 Studio}\footnote{\url{http://www.visualstudio.com/}}. In CodeRush it is called
1064 \emph{Extract Method to
1065 Type}\footnote{\url{https://help.devexpress.com/\#CodeRush/CustomDocument6710}},
1066 but I choose to call it \ExtractAndMoveMethod, since I feel it better
1067 communicates which primitive refactorings it is composed of.
1069 For the metrics, I will at least measure the \emph{Coupling between object
1070 classes} (CBO) metric that is described by Chidamber and Kemerer in their
1071 article \emph{A Metrics Suite for Object Oriented
1072 Design}\citing{metricsSuite1994}.
1074 The project will then consist in implementing the \ExtractAndMoveMethod
1075 refactoring, as well as executing it over a larger code base. Then the effect of
1076 the change must be measured by calculating the chosen software metrics both
1077 before and after the execution. To be able to execute the refactoring
1078 automatically I have to make it analyze code to determine the best selections to
1079 extract into new methods.
1081 \section{Software metrics}
1082 \todoin{Is this the appropriate place to have this section?}
1085 %\chapter{Planning the project}
1093 \section{The problem statement}
1094 \section{Choosing the target language}
1095 Choosing which programming language to use as the target for manipulation is not
1096 a very difficult task. The language has to be an object-oriented programming
1097 language, and it must have existing tool support for refactoring. The
1098 \emph{Java} programming language\footnote{\url{https://www.java.com/}} is the
1099 dominating language when it comes to examples in the literature of refactoring,
1100 and is thus a natural choice. Java is perhaps, currently the most influential
1101 programming language in the world, with its \emph{Java Virtual Machine} that
1102 runs on all of the most popular architectures and also supports\footnote{They
1103 compile to java bytecode.} dozens of other programming languages, with
1104 \emph{Scala}, \emph{Clojure} and \emph{Groovy} as the most prominent ones. Java
1105 is currently the language that every other programming language is compared
1106 against. It is also the primary language of the author of this thesis.
1108 \section{Choosing the tools}
1109 When choosing a tool for manipulating Java, there are certain criterias that
1110 have to be met. First of all, the tool should have some existing refactoring
1111 support that this thesis can build upon. Secondly it should provide some kind of
1112 framework for parsing and analyzing Java source code. Third, it should itself be
1113 open source. This is both because of the need to be able to browse the code for
1114 the existing refactorings that is contained in the tool, and also because open
1115 source projects hold value in them selves. Another important aspect to consider
1116 is that open source projects of a certain size, usually has large communities of
1117 people connected to them, that are commited to answering questions regarding the
1118 use and misuse of the products, that to a large degree is made by the cummunity
1121 There is a certain class of tools that meet these criterias, namely the class of
1122 \emph{IDEs}\footnote{\emph{Integrated Development Environment}}. These are
1123 proagrams that is ment to support the whole production cycle of a cumputer
1124 program, and the most popular IDEs that support Java, generally have quite good
1125 refactoring support.
1127 The main contenders for this thesis is the \emph{Eclipse IDE}, with the
1128 \emph{Java development tools} (JDT), the \emph{IntelliJ IDEA Community Edition}
1129 and the \emph{NetBeans IDE}. \See{toolSupport} Eclipse and NetBeans are both
1130 free, open source and community driven, while the IntelliJ IDEA has an open
1131 sourced community edition that is free of charge, but also offer an
1132 \emph{Ultimate Edition} with an extended set of features, at additional cost.
1133 All three IDEs supports adding plugins to extend their functionality and tools
1134 that can be used to parse and analyze Java source code. But one of the IDEs
1135 stand out as a favorite, and that is the \emph{Eclipse IDE}. This is the most
1136 popular\citing{javaReport2011} among them and seems to be de facto standard IDE
1137 for Java development regardless of platform.
1139 \section{Organizing the project}
1140 All the parts of this master project is under version control with
1141 \emph{Git}\footnote{\url{http://git-scm.com/}}.
1143 The software written is organized as some Eclipse plugins. Writing a plugin is
1144 the natural way to utilize the API of Eclipse. This also makes it possible to
1145 provide a user interface to manually run operations on selections in program
1146 source code or whole projects/packages.
1148 When writing a plugin in Eclipse, one has access to resources such as the
1149 current workspace, the open editor and the current selection.
1151 \section{Continuous integration}
1152 The continuous integration server
1153 \emph{Jenkins}\footnote{\url{http://jenkins-ci.org/}} has been set up for the
1154 project\footnote{A work mostly done by the supervisor.}. It is used as a way to
1155 run tests and perform code coverage analysis.
1157 To be able to build the Eclipse plugins and run tests for them with Jenkins, the
1158 component assembly project
1159 \emph{Buckminster}\footnote{\url{http://www.eclipse.org/buckminster/}} is used,
1160 through its plugin for Jenkins. Buckminster provides for a way to specify the
1161 resources needed for building a project and where and how to find them.
1162 Buckminster also handles the setup of a target environment to run the tests in.
1163 All this is needed because the code to build depends on an Eclipse installation
1164 with various plugins.
1166 \subsection{Problems with AspectJ}
1167 The Buckminster build worked fine until introducing AspectJ into the project.
1168 When building projects using AspectJ, there are some additional steps that needs
1169 to be performed. First of all, the aspects themselves must be compiled. Then the
1170 aspects needs to be woven with the classes they affect. This demands a process
1171 that does multiple passes over the source code.
1173 When using AspectJ with Eclipse, the specialized compilation and the weaving can
1174 be handled by the \emph{AspectJ Development
1175 Tools}\footnote{\url{https://www.eclipse.org/ajdt/}}. This works all fine, but
1176 it complicates things when trying to build a project depending on Eclipse
1177 plugins outside of Eclipse. There is supposed to be a way to specify a compiler
1178 adapter for javac, together with the file extensions for the file types it shall
1179 operate. The AspectJ compiler adapter is called
1180 \typewithref{org.aspectj.tools.ant.taskdefs}{Ajc11CompilerAdapter}, and it works
1181 with files that has the extensions \code{*.java} and \code{*.aj}. I tried to
1182 setup this in the build properties file for the project containing the aspects,
1183 but to no avail. The project containing the aspects does not seem to be built at
1184 all, and the projects that depends on it complains that they cannot find certain
1187 I then managed to write an \emph{Ant}\footnote{\url{https://ant.apache.org/}}
1188 build file that utilizes the AspectJ compiler adapter, for the
1189 \code{no.uio.ifi.refaktor} plugin. The problem was then that it could no longer
1190 take advantage of the environment set up by Buckminster. The solution to this
1191 particular problem was of a ``hacky'' nature. It involves exporting the plugin
1192 dependencies for the project to an Ant build file, and copy the exported path
1193 into the existing build script. But then the Ant script needs to know where the
1194 local Eclipse installation is located. This is no problem when building on a
1195 local machine, but to utilize the setup done by Buckminster is a problem still
1196 unsolved. To get the classpath for the build setup correctly, and here comes the
1197 most ``hacky'' part of the solution, the Ant script has a target for copying the
1198 classpath elements into a directory relative to the project directory and
1199 checking it into Git. When no \code{ECLIPSE\_HOME} property is set while running
1200 Ant, the script uses the copied plugins instead of the ones provided by the
1201 Eclipse installation when building the project. This obviously creates some
1202 problems with maintaining the list of dependencies in the Ant file, as well as
1203 remembering to copy the plugins every time the list of dependencies change.
1205 The Ant script described above is run by Jenkins before the Buckminster setup
1206 and build. When setup like this, the Buckminster build succeeds for the projects
1207 not using AspectJ, and the tests are run as normal. This is all good, but it
1208 feels a little scary, since the reason for Buckminster not working with AspectJ
1211 The problems with building with AspectJ on the Jenkins server lasted for a
1212 while, before they were solved. This is reflected in the ``Test Result Trend''
1213 and ``Code Coverage Trend'' reported by Jenkins.
1216 \chapter{Refactorings in Eclipse JDT: Design, Shortcomings and Wishful
1217 Thinking}\label{ch:jdt_refactorings}
1219 This chapter will deal with some of the design behind refactoring support in
1220 Eclipse, and the JDT in specific. After which it will follow a section about
1221 shortcomings of the refactoring API in terms of composition of refactorings. The
1222 chapter will be concluded with a section telling some of the ways the
1223 implementation of refactorings in the JDT could have worked to facilitate
1224 composition of refactorings.
1227 The refactoring world of Eclipse can in general be separated into two parts: The
1228 language independent part and the part written for a specific programming
1229 language -- the language that is the target of the supported refactorings.
1230 \todo{What about the language specific part?}
1232 \subsection{The Language Toolkit}
1233 The Language Toolkit, or LTK for short, is the framework that is used to
1234 implement refactorings in Eclipse. It is language independent and provides the
1235 abstractions of a refactoring and the change it generates, in the form of the
1236 classes \typewithref{org.eclipse.ltk.core.refactoring}{Refactoring} and
1237 \typewithref{org.eclipse.ltk.core.refactoring}{Change}. (There is also parts of
1238 the LTK that is concerned with user interaction, but they will not be discussed
1239 here, since they are of little value to us and our use of the framework.)
1241 \subsubsection{The Refactoring Class}
1242 The abstract class \type{Refactoring} is the core of the LTK framework. Every
1243 refactoring that is going to be supported by the LTK have to end up creating an
1244 instance of one of its subclasses. The main responsibilities of subclasses of
1245 \type{Refactoring} is to implement template methods for condition checking
1246 (\methodwithref{org.eclipse.ltk.core.refactoring.Refactoring}{checkInitialConditions}
1248 \methodwithref{org.eclipse.ltk.core.refactoring.Refactoring}{checkFinalConditions}),
1250 \methodwithref{org.eclipse.ltk.core.refactoring.Refactoring}{createChange}
1251 method that creates and returns an instance of the \type{Change} class.
1253 If the refactoring shall support that others participate in it when it is
1254 executed, the refactoring has to be a processor-based
1255 refactoring\typeref{org.eclipse.ltk.core.refactoring.participants.ProcessorBasedRefactoring}.
1256 It then delegates to its given
1257 \typewithref{org.eclipse.ltk.core.refactoring.participants}{RefactoringProcessor}
1258 for condition checking and change creation.
1260 \subsubsection{The Change Class}
1261 This class is the base class for objects that is responsible for performing the
1262 actual workspace transformations in a refactoring. The main responsibilities for
1263 its subclasses is to implement the
1264 \methodwithref{org.eclipse.ltk.core.refactoring.Change}{perform} and
1265 \methodwithref{org.eclipse.ltk.core.refactoring.Change}{isValid} methods. The
1266 \method{isValid} method verifies that the change object is valid and thus can be
1267 executed by calling its \method{perform} method. The \method{perform} method
1268 performs the desired change and returns an undo change that can be executed to
1269 reverse the effect of the transformation done by its originating change object.
1271 \subsubsection{Executing a Refactoring}\label{executing_refactoring}
1272 The life cycle of a refactoring generally follows two steps after creation:
1273 condition checking and change creation. By letting the refactoring object be
1275 \typewithref{org.eclipse.ltk.core.refactoring}{CheckConditionsOperation} that
1276 in turn is handled by a
1277 \typewithref{org.eclipse.ltk.core.refactoring}{CreateChangeOperation}, it is
1278 assured that the change creation process is managed in a proper manner.
1280 The actual execution of a change object has to follow a detailed life cycle.
1281 This life cycle is honored if the \type{CreateChangeOperation} is handled by a
1282 \typewithref{org.eclipse.ltk.core.refactoring}{PerformChangeOperation}. If also
1283 an undo manager\typeref{org.eclipse.ltk.core.refactoring.IUndoManager} is set
1284 for the \type{PerformChangeOperation}, the undo change is added into the undo
1287 \section{Shortcomings}
1288 This section is introduced naturally with a conclusion: The JDT refactoring
1289 implementation does not facilitate composition of refactorings.
1290 \todo{refine}This section will try to explain why, and also identify other
1291 shortcomings of both the usability and the readability of the JDT refactoring
1294 I will begin at the end and work my way toward the composition part of this
1297 \subsection{Absence of Generics in Eclipse Source Code}
1298 This section is not only concerning the JDT refactoring API, but also large
1299 quantities of the Eclipse source code. The code shows a striking absence of the
1300 Java language feature of generics. It is hard to read a class' interface when
1301 methods return objects or takes parameters of raw types such as \type{List} or
1302 \type{Map}. This sometimes results in having to read a lot of source code to
1303 understand what is going on, instead of relying on the available interfaces. In
1304 addition, it results in a lot of ugly code, making the use of typecasting more
1305 of a rule than an exception.
1307 \subsection{Composite Refactorings Will Not Appear as Atomic Actions}
1309 \subsubsection{Missing Flexibility from JDT Refactorings}
1310 The JDT refactorings are not made with composition of refactorings in mind. When
1311 a JDT refactoring is executed, it assumes that all conditions for it to be
1312 applied successfully can be found by reading source files that has been
1313 persisted to disk. They can only operate on the actual source material, and not
1314 (in-memory) copies thereof. This constitutes a major disadvantage when trying to
1315 compose refactorings, since if an exception occur in the middle of a sequence of
1316 refactorings, it can leave the project in a state where the composite
1317 refactoring was executed only partly. It makes it hard to discard the changes
1318 done without monitoring and consulting the undo manager, an approach that is not
1321 \subsubsection{Broken Undo History}
1322 When designing a composed refactoring that is to be performed as a sequence of
1323 refactorings, you would like it to appear as a single change to the workspace.
1324 This implies that you would also like to be able to undo all the changes done by
1325 the refactoring in a single step. This is not the way it appears when a sequence
1326 of JDT refactorings is executed. It leaves the undo history filled up with
1327 individual undo actions corresponding to every single JDT refactoring in the
1328 sequence. This problem is not trivial to handle in Eclipse.
1329 \See{hacking_undo_history}
1331 \section{Wishful Thinking}
1334 \chapter{Composite Refactorings in Eclipse}
1336 \section{A Simple Ad Hoc Model}
1337 As pointed out in \myref{ch:jdt_refactorings}, the Eclipse JDT refactoring model
1338 is not very well suited for making composite refactorings. Therefore a simple
1339 model using changer objects (of type \type{RefaktorChanger}) is used as an
1340 abstraction layer on top of the existing Eclipse refactorings, instead of
1341 extending the \typewithref{org.eclipse.ltk.core.refactoring}{Refactoring} class.
1343 The use of an additional abstraction layer is a deliberate choice. It is due to
1344 the problem of creating a composite
1345 \typewithref{org.eclipse.ltk.core.refactoring}{Change} that can handle text
1346 changes that interfere with each other. Thus, a \type{RefaktorChanger} may, or
1347 may not, take advantage of one or more existing refactorings, but it is always
1348 intended to make a change to the workspace.
1350 \subsection{A typical \type{RefaktorChanger}}
1351 The typical refaktor changer class has two responsibilities, checking
1352 preconditions and executing the requested changes. This is not too different
1353 from the responsibilities of an LTK refactoring, with the distinction that a
1354 refaktor changer also executes the change, while an LTK refactoring is only
1355 responsible for creating the object that can later be used to do the job.
1357 Checking of preconditions is typically done by an
1358 \typewithref{no.uio.ifi.refaktor.analyze.analyzers}{Analyzer}. If the
1359 preconditions validate, the upcoming changes are executed by an
1360 \typewithref{no.uio.ifi.refaktor.change.executors}{Executor}.
1362 \section{The Extract and Move Method Refactoring}
1363 %The Extract and Move Method Refactoring is implemented mainly using these
1366 % \item \type{ExtractAndMoveMethodChanger}
1367 % \item \type{ExtractAndMoveMethodPrefixesExtractor}
1368 % \item \type{Prefix}
1369 % \item \type{PrefixSet}
1372 \subsection{The Building Blocks}
1373 This is a composite refactoring, and hence is built up using several primitive
1374 refactorings. These basic building blocks are, as its name implies, the
1375 \ExtractMethod refactoring\citing{refactoring} and the \MoveMethod
1376 refactoring\citing{refactoring}. In Eclipse, the implementations of these
1377 refactorings are found in the classes
1378 \typewithref{org.eclipse.jdt.internal.corext.refactoring.code}{ExtractMethodRefactoring}
1380 \typewithref{org.eclipse.jdt.internal.corext.refactoring.structure}{MoveInstanceMethodProcessor},
1381 where the last class is designed to be used together with the processor-based
1382 \typewithref{org.eclipse.ltk.core.refactoring.participants}{MoveRefactoring}.
1384 \subsubsection{The ExtractMethodRefactoring Class}
1385 This class is quite simple in its use. The only parameters it requires for
1386 construction is a compilation
1387 unit\typeref{org.eclipse.jdt.core.ICompilationUnit}, the offset into the source
1388 code where the extraction shall start, and the length of the source to be
1389 extracted. Then you have to set the method name for the new method together with
1390 its visibility and some not so interesting parameters.
1392 \subsubsection{The MoveInstanceMethodProcessor Class}
1393 For the Move Method, the processor requires a little more advanced input than
1394 the class for the Extract Method. For construction it requires a method
1395 handle\typeref{org.eclipse.jdt.core.IMethod} for the method that is to be moved.
1396 Then the target for the move have to be supplied as the variable binding from a
1397 chosen variable declaration. In addition to this, one have to set some
1398 parameters regarding setters/getters, as well as delegation.
1400 To make a working refactoring from the processor, one have to create a
1401 \type{MoveRefactoring} with it.
1403 \subsection{The ExtractAndMoveMethodChanger}
1405 The \typewithref{no.uio.ifi.refaktor.changers}{ExtractAndMoveMethodChanger}
1406 class is a subclass of the class
1407 \typewithref{no.uio.ifi.refaktor.changers}{RefaktorChanger}. It is responsible
1408 for analyzing and finding the best target for, and also executing, a composition
1409 of the Extract Method and Move Method refactorings. This particular changer is
1410 the one of my changers that is closest to being a true LTK refactoring. It can
1411 be reworked to be one if the problems with overlapping changes are resolved. The
1412 changer requires a text selection and the name of the new method, or else a
1413 method name will be generated. The selection has to be of the type
1414 \typewithref{no.uio.ifi.refaktor.utils}{CompilationUnitTextSelection}. This
1415 class is a custom extension to
1416 \typewithref{org.eclipse.jface.text}{TextSelection}, that in addition to the
1417 basic offset, length and similar methods, also carry an instance of the
1418 underlying compilation unit handle for the selection.
1420 \subsubsection{The \type{ExtractAndMoveMethodAnalyzer}}
1421 The analysis and precondition checking is done by the
1422 \typewithref{no.uio.ifi.refaktor.analyze.analyzers}{ExtractAnd\-MoveMethodAnalyzer}.
1423 First is check whether the selection is a valid selection or not, with respect
1424 to statement boundaries and that it actually contains any selections. Then it
1425 checks the legality of both extracting the selection and also moving it to
1426 another class. This checking of is performed by a range of checkers
1427 \see{checkers}. If the selection is approved as legal, it is analyzed to find
1428 the presumably best target to move the extracted method to.
1430 For finding the best suitable target the analyzer is using a
1431 \typewithref{no.uio.ifi.refaktor.analyze.collectors}{PrefixesCollector} that
1432 collects all the possible candidates for the refactoring. All the non-candidates
1434 \typewithref{no.uio.ifi.refaktor.analyze.collectors}{UnfixesCollector} that
1435 collects all the targets that will give some kind of error if used. (For
1436 details about the property collectors, se \myref{propertyCollectors}.) All
1437 prefixes (and unfixes) are represented by a
1438 \typewithref{no.uio.ifi.refaktor.extractors}{Prefix}, and they are collected
1439 into sets of prefixes. The safe prefixes is found by subtracting from the set of
1440 candidate prefixes the prefixes that is enclosing any of the unfixes. A prefix
1441 is enclosing an unfix if the unfix is in the set of its sub-prefixes. As an
1442 example, \texttt{``a.b''} is enclosing \texttt{``a''}, as is \texttt{``a''}. The
1443 safe prefixes is unified in a \type{PrefixSet}. If a prefix has only one
1444 occurrence, and is a simple expression, it is considered unsuitable as a move
1445 target. This occurs in statements such as \texttt{``a.foo()''}. For such
1446 statements it bares no meaning to extract and move them. It only generates an
1447 extra method and the calling of it.
1449 The most suitable target for the refactoring is found by finding the prefix with
1450 the most occurrences. If two prefixes have the same occurrence count, but they
1451 differ in length, the longest of them is chosen.
1453 \todoin{Clean up sections/subsections.}
1455 \subsubsection{The \type{ExtractAndMoveMethodExecutor}}
1456 If the analysis finds a possible target for the composite refactoring, it is
1458 \typewithref{no.uio.ifi.refaktor.change.executors}{ExtractAndMoveMethodExecutor}.
1459 It is composed of the two executors known as
1460 \typewithref{no.uio.ifi.refaktor.change.executors}{ExtractMethodRefactoringExecutor}
1462 \typewithref{no.uio.ifi.refaktor.change.executors}{MoveMethodRefactoringExecutor}.
1463 The \type{ExtractAndMoveMethodExecutor} is responsible for gluing the two
1464 together by feeding the \type{MoveMethod\-RefactoringExecutor} with the
1465 resources needed after executing the extract method refactoring.
1466 \See{postExtractExecution}
1468 \subsubsection{The \type{ExtractMethodRefactoringExecutor}}
1469 This executor is responsible for creating and executing an instance of the
1470 \type{ExtractMethodRefactoring} class. It is also responsible for collecting
1471 some post execution resources that can be used to find the method handle for the
1472 extracted method, as well as information about its parameters, including the
1473 variable they originated from.
1475 \subsubsection{The \type{MoveMethodRefactoringExecutor}}
1476 This executor is responsible for creating and executing an instance of the
1477 \type{MoveRefactoring}. The move refactoring is a processor-based refactoring,
1478 and for the Move Method refactoring it is the \type{MoveInstanceMethodProcessor}
1481 The handle for the method to be moved is found on the basis of the information
1482 gathered after the execution of the Extract Method refactoring. The only
1483 information the \type{ExtractMethodRefactoring} is sharing after its execution,
1484 regarding find the method handle, is the textual representation of the new
1485 method signature. Therefore it must be parsed, the strings for types of the
1486 parameters must be found and translated to a form that can be used to look up
1487 the method handle from its type handle. They have to be on the unresolved
1488 form.\todo{Elaborate?} The name for the type is found from the original
1489 selection, since an extracted method must end up in the same type as the
1492 When analyzing a selection prior to performing the Extract Method refactoring, a
1493 target is chosen. It has to be a variable binding, so it is either a field or a
1494 local variable/parameter. If the target is a field, it can be used with the
1495 \type{MoveInstanceMethodProcessor} as it is, since the extracted method still is
1496 in its scope. But if the target is local to the originating method, the target
1497 that is to be used for the processor must be among its parameters. Thus the
1498 target must be found among the extracted method's parameters. This is done by
1499 finding the parameter information object that corresponds to the parameter that
1500 was declared on basis of the original target's variable when the method was
1501 extracted. (The extracted method must take one such parameter for each local
1502 variable that is declared outside the selection that is extracted.) To match the
1503 original target with the correct parameter information object, the key for the
1504 information object is compared to the key from the original target's binding.
1505 The source code must then be parsed to find the method declaration for the
1506 extracted method. The new target must be found by searching through the
1507 parameters of the declaration and choose the one that has the same type as the
1508 old binding from the parameter information object, as well as the same name that
1509 is provided by the parameter information object.
1513 SearchBasedExtractAndMoveMethodChanger}\label{searchBasedExtractAndMoveMethodChanger}
1514 \todoin{Write\ldots}
1516 \subsection{Finding the IMethod}\label{postExtractExecution}
1517 \todoin{Rename section. Write??}
1520 \subsection{The Prefix Class}
1521 This class exists mainly for holding data about a prefix, such as the expression
1522 that the prefix represents and the occurrence count of the prefix within a
1523 selection. In addition to this, it has some functionality such as calculating
1524 its sub-prefixes and intersecting it with another prefix. The definition of the
1525 intersection between two prefixes is a prefix representing the longest common
1526 expression between the two.
1528 \subsection{The PrefixSet Class}
1529 A prefix set holds elements of type \type{Prefix}. It is implemented with the
1530 help of a \typewithref{java.util}{HashMap} and contains some typical set
1531 operations, but it does not implement the \typewithref{java.util}{Set}
1532 interface, since the prefix set does not need all of the functionality a
1533 \type{Set} requires to be implemented. In addition It needs some other
1534 functionality not found in the \type{Set} interface. So due to the relatively
1535 limited use of prefix sets, and that it almost always needs to be referenced as
1536 such, and not a \type{Set<Prefix>}, it remains as an ad hoc solution to a
1539 There are two ways adding prefixes to a \type{PrefixSet}. The first is through
1540 its \method{add} method. This works like one would expect from a set. It adds
1541 the prefix to the set if it does not already contain the prefix. The other way
1542 is to \emph{register} the prefix with the set. When registering a prefix, if the
1543 set does not contain the prefix, it is just added. If the set contains the
1544 prefix, its count gets incremented. This is how the occurrence count is handled.
1546 The prefix set also computes the set of prefixes that is not enclosing any
1547 prefixes of another set. This is kind of a set difference operation only for
1550 \subsection{Hacking the Refactoring Undo
1551 History}\label{hacking_undo_history}
1552 \todoin{Where to put this section?}
1554 As an attempt to make multiple subsequent changes to the workspace appear as a
1555 single action (i.e. make the undo changes appear as such), I tried to alter
1556 the undo changes\typeref{org.eclipse.ltk.core.refactoring.Change} in the history
1557 of the refactorings.
1559 My first impulse was to remove the, in this case, last two undo changes from the
1560 undo manager\typeref{org.eclipse.ltk.core.refactoring.IUndoManager} for the
1561 Eclipse refactorings, and then add them to a composite
1562 change\typeref{org.eclipse.ltk.core.refactoring.CompositeChange} that could be
1563 added back to the manager. The interface of the undo manager does not offer a
1564 way to remove/pop the last added undo change, so a possible solution could be to
1565 decorate\citing{designPatterns} the undo manager, to intercept and collect the
1566 undo changes before delegating to the \method{addUndo}
1567 method\methodref{org.eclipse.ltk.core.refactoring.IUndoManager}{addUndo} of the
1568 manager. Instead of giving it the intended undo change, a null change could be
1569 given to prevent it from making any changes if run. Then one could let the
1570 collected undo changes form a composite change to be added to the manager.
1572 There is a technical challenge with this approach, and it relates to the undo
1573 manager, and the concrete implementation
1574 UndoManager2\typeref{org.eclipse.ltk.internal.core.refactoring.UndoManager2}.
1575 This implementation is designed in a way that it is not possible to just add an
1576 undo change, you have to do it in the context of an active
1577 operation\typeref{org.eclipse.core.commands.operations.TriggeredOperations}.
1578 One could imagine that it might be possible to trick the undo manager into
1579 believing that you are doing a real change, by executing a refactoring that is
1580 returning a kind of null change that is returning our composite change of undo
1581 refactorings when it is performed.
1583 Apart from the technical problems with this solution, there is a functional
1584 problem: If it all had worked out as planned, this would leave the undo history
1585 in a dirty state, with multiple empty undo operations corresponding to each of
1586 the sequentially executed refactoring operations, followed by a composite undo
1587 change corresponding to an empty change of the workspace for rounding of our
1588 composite refactoring. The solution to this particular problem could be to
1589 intercept the registration of the intermediate changes in the undo manager, and
1590 only register the last empty change.
1592 Unfortunately, not everything works as desired with this solution. The grouping
1593 of the undo changes into the composite change does not make the undo operation
1594 appear as an atomic operation. The undo operation is still split up into
1595 separate undo actions, corresponding to the change done by its originating
1596 refactoring. And in addition, the undo actions has to be performed separate in
1597 all the editors involved. This makes it no solution at all, but a step toward
1600 There might be a solution to this problem, but it remains to be found. The
1601 design of the refactoring undo management is partly to be blamed for this, as it
1602 it is to complex to be easily manipulated.
1607 \chapter{Analyzing Source Code in Eclipse}
1609 \section{The Java model}\label{javaModel}
1610 The Java model of Eclipse is its internal representation of a Java project. It
1611 is light-weight, and has only limited possibilities for manipulating source
1612 code. It is typically used as a basis for the Package Explorer in Eclipse.
1614 The elements of the Java model is only handles to the underlying elements. This
1615 means that the underlying element of a handle does not need to actually exist.
1616 Hence the user of a handle must always check that it exist by calling the
1617 \method{exists} method of the handle.
1619 The handles with descriptions is listed in \myref{tab:javaModel}.
1624 \newcolumntype{L}[1]{>{\hsize=#1\hsize\raggedright\arraybackslash}X}%
1625 % sum must equal number of columns (3)
1626 \begin{tabularx}{\textwidth}{| L{0.7} | L{1.1} | L{1.2} |}
1628 \textbf{Project Element} & \textbf{Java Model element} &
1629 \textbf{Description} \\
1631 Java project & \type{IJavaProject} & The Java project which contains all other objects. \\
1633 Source folder /\linebreak[2] binary folder /\linebreak[3] external library &
1634 \type{IPackageFragmentRoot} & Hold source or binary files, can be a folder
1635 or a library (zip / jar file). \\
1637 Each package & \type{IPackageFragment} & Each package is below the
1638 \type{IPackageFragmentRoot}, sub-packages are not leaves of the package,
1639 they are listed directed under \type{IPackageFragmentRoot}. \\
1641 Java Source file & \type{ICompilationUnit} & The Source file is always below
1642 the package node. \\
1644 Types /\linebreak[2] Fields /\linebreak[3] Methods & \type{IType} /
1646 \type{IField} /\linebreak[3] \type{IMethod} & Types, fields and methods. \\
1649 \caption{The elements of the Java Model. {\footnotesize Taken from
1650 \url{http://www.vogella.com/tutorials/EclipseJDT/article.html}}}
1651 \label{tab:javaModel}
1654 The hierarchy of the Java Model is shown in \myref{fig:javaModel}.
1658 \begin{tikzpicture}[%
1659 grow via three points={one child at (0,-0.7) and
1660 two children at (0,-0.7) and (0,-1.4)},
1661 edge from parent path={(\tikzparentnode.south west)+(0.5,0) |-
1662 (\tikzchildnode.west)}]
1663 \tikzstyle{every node}=[draw=black,thick,anchor=west]
1664 \tikzstyle{selected}=[draw=red,fill=red!30]
1665 \tikzstyle{optional}=[dashed,fill=gray!50]
1666 \node {\type{IJavaProject}}
1667 child { node {\type{IPackageFragmentRoot}}
1668 child { node {\type{IPackageFragment}}
1669 child { node {\type{ICompilationUnit}}
1670 child { node {\type{IType}}
1671 child { node {\type{\{ IType \}*}}
1672 child { node {\type{\ldots}}}
1675 child { node {\type{\{ IField \}*}}}
1676 child { node {\type{IMethod}}
1677 child { node {\type{\{ IType \}*}}
1678 child { node {\type{\ldots}}}
1683 child { node {\type{\{ IMethod \}*}}}
1692 child { node {\type{\{ IType \}*}}}
1703 child { node {\type{\{ ICompilationUnit \}*}}}
1716 child { node {\type{\{ IPackageFragment \}*}}}
1731 child { node {\type{\{ IPackageFragmentRoot \}*}}}
1734 \caption{The Java model of Eclipse. ``\type{\{ SomeElement \}*}'' means
1735 \type{SomeElement} zero or more times. For recursive structures,
1736 ``\type{\ldots}'' is used.}
1737 \label{fig:javaModel}
1740 \section{The Abstract Synax Tree}
1741 Eclipse is following the common paradigm of using an abstract syntaxt tree for
1742 source code analysis and manipulation.
1744 When parsing program source code into something that can be used as a foundation
1745 for analysis, the start of the process follows the same steps as in a compiler.
1746 This is all natural, because the way a compiler anayzes code is no different
1747 from how source manipulation programs would do it, except for some properties of
1748 code that is analyzed in the parser, and that they may be differing in what
1749 kinds of properties they analyze. Thus the process of translation source code
1750 into a structure that is suitable for analyzing, can be seen as a kind of
1751 interrupted compilation process \see{fig:interruptedCompilationProcess}.
1756 base/.style={anchor=north, align=center, rectangle, minimum height=1.4cm},
1757 basewithshadow/.style={base, drop shadow, fill=white},
1758 outlined/.style={basewithshadow, draw, rounded corners, minimum
1760 primary/.style={outlined, font=\bfseries},
1761 dashedbox/.style={outlined, dashed},
1762 arrowpath/.style={black, align=center, font=\small},
1763 processarrow/.style={arrowpath, ->, >=angle 90, shorten >=1pt},
1765 \begin{tikzpicture}[node distance=1.3cm and 3cm, scale=1, every
1766 node/.style={transform shape}]
1767 \node[base](AuxNode1){\small source code};
1768 \node[primary, right=of AuxNode1, xshift=-2.5cm](Scanner){Scanner};
1769 \node[primary, right=of Scanner, xshift=0.5cm](Parser){Parser};
1770 \node[dashedbox, below=of Parser](SemanticAnalyzer){Semantic\\Analyzer};
1771 \node[dashedbox, left=of SemanticAnalyzer](SourceCodeOptimizer){Source
1773 \node[dashedbox, below=of SourceCodeOptimizer
1774 ](CodeGenerator){Code\\Generator};
1775 \node[dashedbox, right=of CodeGenerator](TargetCodeOptimizer){Target
1777 \node[base, right=of TargetCodeOptimizer](AuxNode2){};
1779 \draw[processarrow](AuxNode1) -- (Scanner);
1781 \path[arrowpath] (Scanner) -- node [sloped](tokens){tokens}(Parser);
1782 \draw[processarrow](Scanner) -- (tokens) -- (Parser);
1784 \path[arrowpath] (Parser) -- node (syntax){syntax
1785 tree}(SemanticAnalyzer);
1786 \draw[processarrow](Parser) -- (syntax) -- (SemanticAnalyzer);
1788 \path[arrowpath] (SemanticAnalyzer) -- node
1789 [sloped](annotated){annotated\\tree}(SourceCodeOptimizer);
1790 \draw[processarrow, dashed](SemanticAnalyzer) -- (annotated) --
1791 (SourceCodeOptimizer);
1793 \path[arrowpath] (SourceCodeOptimizer) -- node
1794 (intermediate){intermediate code}(CodeGenerator);
1795 \draw[processarrow, dashed](SourceCodeOptimizer) -- (intermediate) --
1798 \path[arrowpath] (CodeGenerator) -- node [sloped](target1){target
1799 code}(TargetCodeOptimizer);
1800 \draw[processarrow, dashed](CodeGenerator) -- (target1) --
1801 (TargetCodeOptimizer);
1803 \path[arrowpath](TargetCodeOptimizer) -- node [sloped](target2){target
1805 \draw[processarrow, dashed](TargetCodeOptimizer) -- (target2) (AuxNode2);
1807 \caption{Interrupted compilation process. {\footnotesize (Full compilation
1808 process borrowed from \emph{Compiler construction: principles and practice}
1809 by Kenneth C. Louden\citing{louden1997}.)}}
1810 \label{fig:interruptedCompilationProcess}
1813 The process starts with a \emph{scanner}, or lexer. The job of the scanner is to
1814 read the source code and divide it into tokens for the parser. Therefore, it is
1815 also sometimes called a tokenizer. A token is a logical unit, defined in the
1816 language specification, consisting of one or more consecutive characters. In
1817 the java language the tokens can for instance be the \var{this} keyword, a curly
1818 bracket \var{\{} or a \var{nameToken}. It is recognized by the scanner on the
1819 basis of something eqivalent of a regular expression. This part of the process
1820 is often implemented with the use of a finite automata. In fact, it is common to
1821 specify the tokens in regular expressions, that in turn is translated into a
1822 finite automata lexer. This process can be automated.
1824 The program component used to translate a a stream of tokens into something
1825 meaningful, is called a parser. A parser is fed tokens from the scanner and
1826 performs an analysis of the structure of a program. It verifies that the syntax
1827 is correct according to the grammar rules of a language, that is usually
1828 specified in a context-free grammar, and often in a variant of the
1830 Form}\footnote{\url{https://en.wikipedia.org/wiki/Backus-Naur\_Form}}. The
1831 result coming from the parser is in the form of an \emph{Abstract Syntax Tree},
1832 AST for short. It is called \emph{abstract}, because the structure does not
1833 contain all of the tokens produced by the scanner. It only contain logical
1834 constructs, and because it forms a tree, all kinds of parentheses and brackets
1835 are implicit in the structure. It is this AST that is used when performing the
1836 semantic analysis of the code.
1838 As an example we can think of the expression \code{(5 + 7) * 2}. The root of
1839 this tree would in Eclipse be an \type{InfixExpression} with the operator
1840 \var{TIMES}, and a left operand that is also an \type{InfixExpression} with the
1841 operator \var{PLUS}. The left operand \type{InfixExpression}, has in turn a left
1842 operand of type \type{NumberLiteral} with the value \var{``5''} and a right
1843 operand \type{NumberLiteral} with the value \var{``7''}. The root will have a
1844 right operand of type \type{NumberLiteral} and value \var{``2''}. The AST for
1845 this expression is illustrated in \myref{fig:astInfixExpression}.
1847 Contrary to the Java Model, an abstract syntaxt tree is a heavy-weight
1848 representation of source code. It contains information about propertes like type
1849 bindings for variables and variable bindings for names.
1854 \begin{tikzpicture}[scale=0.8]
1855 \tikzset{level distance=40pt}
1856 \tikzset{sibling distance=5pt}
1857 \tikzstyle{thescale}=[scale=0.8]
1858 \tikzset{every tree node/.style={align=center}}
1859 \tikzset{edge from parent/.append style={thick}}
1860 \tikzstyle{inode}=[rectangle,rounded corners,draw,fill=lightgray,drop
1861 shadow,align=center]
1862 \tikzset{every internal node/.style={inode}}
1863 \tikzset{every leaf node/.style={draw=none,fill=none}}
1865 \Tree [.\type{InfixExpression} [.\type{InfixExpression}
1866 [.\type{NumberLiteral} \var{``5''} ] [.\type{Operator} \var{PLUS} ]
1867 [.\type{NumberLiteral} \var{``7''} ] ]
1868 [.\type{Operator} \var{TIMES} ]
1869 [.\type{NumberLiteral} \var{``2''} ]
1872 \caption{The abstract syntax tree for the expression \code{(5 + 7) * 2}.}
1873 \label{fig:astInfixExpression}
1876 \subsection{The AST in Eclipse}
1877 In Eclipse, every node in the AST is a child of the abstract superclass
1878 \typewithref{org.eclipse.jdt.core.dom}{ASTNode}. Every \type{ASTNode}, among a
1879 lot of other things, provides information about its position and length in the
1880 source code, as well as a reference to its parent and to the root of the tree.
1882 The root of the AST is always of type \type{CompilationUnit}. It is not the same
1883 as an instance of an \type{ICompilationUnit}, which is the compilation unit
1884 handle of the Java model. The children of a \type{CompilationUnit} is an
1885 optional \type{PackageDeclaration}, zero or more nodes of type
1886 \type{ImportDecaration} and all its top-level type declarations that has node
1887 types \type{AbstractTypeDeclaration}.
1889 An \type{AbstractType\-Declaration} can be one of the types
1890 \type{AnnotationType\-Declaration}, \type{Enum\-Declaration} or
1891 \type{Type\-Declaration}. The children of an \type{AbstractType\-Declaration}
1892 must be a subtype of a \type{BodyDeclaration}. These subtypes are:
1893 \type{AnnotationTypeMember\-Declaration}, \type{EnumConstant\-Declaration},
1894 \type{Field\-Declaration}, \type{Initializer} and \type{Method\-Declaration}.
1896 Of the body declarations, the \type{Method\-Declaration} is the most interesting
1897 one. Its children include lists of modifiers, type parameters, parameters and
1898 exceptions. It has a return type node and a body node. The body, if present, is
1899 of type \type{Block}. A \type{Block} is itself a \type{Statement}, and its
1900 children is a list of \type{Statement} nodes.
1902 There are too many types of the abstract type \type{Statement} to list up, but
1903 there exists a subtype of \type{Statement} for every statement type of Java, as
1904 one would expect. This also applies to the abstract type \type{Expression}.
1905 However, the expression \type{Name} is a little special, since it is both used
1906 as an operand in compound expressions, as well as for names in type declarations
1909 There is an overview of some of the structure of an Eclipse AST in
1910 \myref{fig:astEclipse}.
1914 \begin{tikzpicture}[scale=0.8]
1915 \tikzset{level distance=50pt}
1916 \tikzset{sibling distance=5pt}
1917 \tikzstyle{thescale}=[scale=0.8]
1918 \tikzset{every tree node/.style={align=center}}
1919 \tikzset{edge from parent/.append style={thick}}
1920 \tikzstyle{inode}=[rectangle,rounded corners,draw,fill=lightgray,drop
1921 shadow,align=center]
1922 \tikzset{every internal node/.style={inode}}
1923 \tikzset{every leaf node/.style={draw=none,fill=none}}
1925 \Tree [.\type{CompilationUnit} [.\type{[ PackageDeclaration ]} [.\type{Name} ]
1926 [.\type{\{ Annotation \}*} ] ]
1927 [.\type{\{ ImportDeclaration \}*} [.\type{Name} ] ]
1928 [.\type{\{ AbstractTypeDeclaration \}+} [.\node(site){\type{\{
1929 BodyDeclaration \}*}}; ] [.\type{SimpleName} ] ]
1931 \begin{scope}[shift={(0.5,-6)}]
1932 \node[inode,thescale](root){\type{MethodDeclaration}};
1933 \node[inode,thescale](modifiers) at (4.5,-5){\type{\{ IExtendedModifier \}*}
1934 \\ {\footnotesize (Of type \type{Modifier} or \type{Annotation})}};
1935 \node[inode,thescale](typeParameters) at (-6,-3.5){\type{\{ TypeParameter
1937 \node[inode,thescale](parameters) at (-5,-5){\type{\{
1938 SingleVariableDeclaration \}*} \\ {\footnotesize (Parameters)}};
1939 \node[inode,thescale](exceptions) at (5,-3){\type{\{ Name \}*} \\
1940 {\footnotesize (Exceptions)}};
1941 \node[inode,thescale](return) at (-6.5,-2){\type{Type} \\ {\footnotesize
1943 \begin{scope}[shift={(0,-5)}]
1944 \Tree [.\node(body){\type{[ Block ]} \\ {\footnotesize (Body)}};
1945 [.\type{\{ Statement \}*} [.\type{\{ Expression \}*} ]
1946 [.\type{\{ Statement \}*} [.\type{\ldots} ]]
1951 \draw[->,>=triangle 90,shorten >=1pt](root.east)..controls +(east:2) and
1952 +(south:1)..(site.south);
1954 \draw (root.south) -- (modifiers);
1955 \draw (root.south) -- (typeParameters);
1956 \draw (root.south) -- ($ (parameters.north) + (2,0) $);
1957 \draw (root.south) -- (exceptions);
1958 \draw (root.south) -- (return);
1959 \draw (root.south) -- (body);
1962 \caption{The format of the abstract syntax tree in Eclipse.}
1963 \label{fig:astEclipse}
1965 \todoin{Add more to the AST format tree? \myref{fig:astEclipse}}
1967 \section{The ASTVisitor}\label{astVisitor}
1968 So far, the only thing that has been adressed is how the the data that is going
1969 to be the basis for our analysis is structured. Another aspect of it is how we
1970 are going to traverse the AST to gather the information we need, so we can
1971 conclude about the properties we are analysing. It is of course possible to
1972 start at the top of the tree, and manually search through its nodes for the ones
1973 we are looking for, but that is a bit inconvenient. To be able to efficiently
1974 utilize such an approach, we would need to make our own framework for traversing
1975 the tree and visiting only the types of nodes we are after. Luckily, this
1976 functionality is already provided in Eclipse, by its
1977 \typewithref{org.eclipse.jdt.core.dom}{ASTVisitor}.
1979 The Eclipse AST, together with its \type{ASTVisitor}, follows the \emph{Visitor}
1980 pattern\citing{designPatterns}. The intent of this design pattern is to
1981 facilitate extending the functionality of classes without touching the classes
1984 Let us say that there is a class hierarchy of \emph{Elements}. These elements
1985 all have a method \method{accept(Visitor visitor)}. In its simplest form, the
1986 \method{accept} method just calls the \method{visit} method of the visitor with
1987 itself as an argument, like this: \code{visitor.visit(this)}. For the visitors
1988 to be able to extend the functionality of all the classes in the elements
1989 hierarchy, each \type{Visitor} must have one visit method for each concrete
1990 class in the hierarchy. Say the hierarchy consists of the concrete classes
1991 \type{ConcreteElementA} and \type{ConcreteElementB}. Then each visitor must have
1992 the (possibly empty) methods \method{visit(ConcreteElementA element)} and
1993 \method{visit(ConcreteElementB element)}. This scenario is depicted in
1994 \myref{fig:visitorPattern}.
1998 \tikzstyle{abstract}=[rectangle, draw=black, fill=white, drop shadow, text
1999 centered, anchor=north, text=black, text width=6cm, every one node
2000 part/.style={align=center, font=\bfseries\itshape}]
2001 \tikzstyle{concrete}=[rectangle, draw=black, fill=white, drop shadow, text
2002 centered, anchor=north, text=black, text width=6cm]
2003 \tikzstyle{inheritarrow}=[->, >=open triangle 90, thick]
2004 \tikzstyle{commentarrow}=[->, >=angle 90, dashed]
2005 \tikzstyle{line}=[-, thick]
2006 \tikzset{every one node part/.style={align=center, font=\bfseries}}
2007 \tikzset{every second node part/.style={align=center, font=\ttfamily}}
2009 \begin{tikzpicture}[node distance=1cm, scale=0.8, every node/.style={transform
2011 \node (Element) [abstract, rectangle split, rectangle split parts=2]
2013 \nodepart{one}{Element}
2014 \nodepart{second}{+accept(visitor: Visitor)}
2016 \node (AuxNode01) [text width=0, minimum height=2cm, below=of Element] {};
2017 \node (ConcreteElementA) [concrete, rectangle split, rectangle split
2018 parts=2, left=of AuxNode01]
2020 \nodepart{one}{ConcreteElementA}
2021 \nodepart{second}{+accept(visitor: Visitor)}
2023 \node (ConcreteElementB) [concrete, rectangle split, rectangle split
2024 parts=2, right=of AuxNode01]
2026 \nodepart{one}{ConcreteElementB}
2027 \nodepart{second}{+accept(visitor: Visitor)}
2030 \node[comment, below=of ConcreteElementA] (CommentA) {visitor.visit(this)};
2032 \node[comment, below=of ConcreteElementB] (CommentB) {visitor.visit(this)};
2034 \node (AuxNodeX) [text width=0, minimum height=1cm, below=of AuxNode01] {};
2036 \node (Visitor) [abstract, rectangle split, rectangle split parts=2,
2039 \nodepart{one}{Visitor}
2040 \nodepart{second}{+visit(ConcreteElementA)\\+visit(ConcreteElementB)}
2042 \node (AuxNode02) [text width=0, minimum height=2cm, below=of Visitor] {};
2043 \node (ConcreteVisitor1) [concrete, rectangle split, rectangle split
2044 parts=2, left=of AuxNode02]
2046 \nodepart{one}{ConcreteVisitor1}
2047 \nodepart{second}{+visit(ConcreteElementA)\\+visit(ConcreteElementB)}
2049 \node (ConcreteVisitor2) [concrete, rectangle split, rectangle split
2050 parts=2, right=of AuxNode02]
2052 \nodepart{one}{ConcreteVisitor2}
2053 \nodepart{second}{+visit(ConcreteElementA)\\+visit(ConcreteElementB)}
2057 \draw[inheritarrow] (ConcreteElementA.north) -- ++(0,0.7) -|
2059 \draw[line] (ConcreteElementA.north) -- ++(0,0.7) -|
2060 (ConcreteElementB.north);
2062 \draw[inheritarrow] (ConcreteVisitor1.north) -- ++(0,0.7) -|
2064 \draw[line] (ConcreteVisitor1.north) -- ++(0,0.7) -|
2065 (ConcreteVisitor2.north);
2067 \draw[commentarrow] (CommentA.north) -- (ConcreteElementA.south);
2068 \draw[commentarrow] (CommentB.north) -- (ConcreteElementB.south);
2072 \caption{The Visitor Pattern.}
2073 \label{fig:visitorPattern}
2076 The use of the visitor pattern can be appropriate when the hierarchy of elements
2077 is mostly stable, but the family of operations over its elements is constantly
2078 growing. This is clearly the cas for the Eclipse AST, since the hierarchy of
2079 type \type{ASTNode} is very stable, but the functionality of its elements is
2080 extended every time someone needs to operate on the AST. Another aspect of the
2081 Eclipse implementation is that it is a public API, and the visitor pattern is an
2082 easy way to provide access to the nodes in the tree.
2084 The version of the visitor pattern implemented for the AST nodes in Eclipse also
2085 provides an elegant way to traverse the tree. It does so by following the
2086 convention that every node in the tree first let the visitor visit itself,
2087 before it also makes all its children accept the visitor. The children are only
2088 visited if the visit method of their parent returns \var{true}. This pattern
2089 then makes for a prefix traversal of the AST. If postfix traversal is desired,
2090 the visitors also has \method{endVisit} methods for each node type, that is
2091 called after the \method{visit} method for a node. In addition to these visit
2092 methods, there are also the methods \method{preVisit(ASTNode)},
2093 \method{postVisit(ASTNode)} and \method{preVisit2(ASTNode)}. The
2094 \method{preVisit} method is called before the type-specific \method{visit}
2095 method. The \method{postVisit} method is called after the type-specific
2096 \method{endVisit}. The type specific \method{visit} is only called if
2097 \method{preVisit2} returns \var{true}. Overriding the \method{preVisit2} is also
2098 altering the behavior of \method{preVisit}, since the default implementation is
2099 responsible for calling it.
2101 An example of a trivial \type{ASTVisitor} is shown in
2102 \myref{lst:astVisitorExample}.
2105 \begin{minted}{java}
2106 public class CollectNamesVisitor extends ASTVisitor {
2107 Collection<Name> names = new LinkedList<Name>();
2110 public boolean visit(QualifiedName node) {
2116 public boolean visit(SimpleName node) {
2122 \caption{An \type{ASTVisitor} that visits all the names in a subtree and adds
2123 them to a collection, except those names that are children of any
2124 \type{QualifiedName}.}
2125 \label{lst:astVisitorExample}
2128 \section{Property collectors}\label{propertyCollectors}
2129 The prefixes and unfixes are found by property
2130 collectors\typeref{no.uio.ifi.refaktor.extractors.collectors.PropertyCollector}.
2131 A property collector is of the \type{ASTVisitor} type, and thus visits nodes of
2132 type \type{ASTNode} of the abstract syntax tree \see{astVisitor}.
2134 \subsection{The PrefixesCollector}
2135 The \typewithref{no.uio.ifi.refaktor.extractors.collectors}{PrefixesCollector}
2136 finds prefixes that makes up the basis for calculating move targets for the
2137 Extract and Move Method refactoring. It visits expression
2138 statements\typeref{org.eclipse.jdt.core.dom.ExpressionStatement} and creates
2139 prefixes from its expressions in the case of method invocations. The prefixes
2140 found is registered with a prefix set, together with all its sub-prefixes.
2142 \subsection{The UnfixesCollector}\label{unfixes}
2143 The \typewithref{no.uio.ifi.refaktor.extractors.collectors}{UnfixesCollector}
2144 finds unfixes within a selection. That is prefixes that cannot be used as a
2145 basis for finding a move target in a refactoring.
2147 An unfix can be a name that is assigned to within a selection. The reason that
2148 this cannot be allowed, is that the result would be an assignment to the
2149 \type{this} keyword, which is not valid in Java \see{eclipse_bug_420726}.
2151 Prefixes that originates from variable declarations within the same selection
2152 are also considered unfixes. This is because when a method is moved, it needs to
2153 be called through a variable. If this variable is also within the method that is
2154 to be moved, this obviously cannot be done.
2156 Also considered as unfixes are variable references that are of types that is not
2157 suitable for moving a methods to. This can be either because it is not
2158 physically possible to move the method to the desired class or that it will
2159 cause compilation errors by doing so.
2161 If the type binding for a name is not resolved it is considered and unfix. The
2162 same applies to types that is only found in compiled code, so they have no
2163 underlying source that is accessible to us. (E.g. the \type{java.lang.String}
2166 Interfaces types are not suitable as targets. This is simply because interfaces
2167 in java cannot contain methods with bodies. (This thesis does not deal with
2168 features of Java versions later than Java 7. Java 8 has interfaces with default
2169 implementations of methods.) Neither are local types allowed. This accounts for
2170 both local and anonymous classes. Anonymous classes are effectively the same as
2171 interface types with respect to unfixes. Local classes could in theory be used
2172 as targets, but this is not possible due to limitations of the implementation of
2173 the Extract and Move Method refactoring. The problem is that the refactoring is
2174 done in two steps, so the intermediate state between the two refactorings would
2175 not be legal Java code. In the case of local classes, the problem is that, in
2176 the intermediate step, a selection referencing a local class would need to take
2177 the local class as a parameter if it were to be extracted to a new method. This
2178 new method would need to live in the scope of the declaring class of the
2179 originating method. The local class would then not be in the scope of the
2180 extracted method, thus bringing the source code into an illegal state. One could
2181 imagine that the method was extracted and moved in one operation, without an
2182 intermediate state. Then it would make sense to include variables with types of
2183 local classes in the set of legal targets, since the local classes would then be
2184 in the scopes of the method calls. If this makes any difference for software
2185 metrics that measure coupling would be a different discussion.
2188 \begin{multicols}{2}
2189 \begin{minted}[]{java}
2191 void declaresLocalClass() {
2206 \begin{minted}[]{java}
2207 // After Extract Method
2208 void declaresLocalClass() {
2219 // Intermediate step
2220 void fooBar(LocalClass inst) {
2226 \caption{When Extract and Move Method tries to use a variable with a local type
2227 as the move target, an intermediate step is taken that is not allowed. Here:
2228 \type{LocalClass} is not in the scope of \method{fooBar} in its intermediate
2230 \label{lst:extractMethod_LocalClass}
2233 The last class of names that are considered unfixes is names used in null tests.
2234 These are tests that reads like this: if \texttt{<name>} equals \var{null} then
2235 do something. If allowing variables used in those kinds of expressions as
2236 targets for moving methods, we would end up with code containing boolean
2237 expressions like \texttt{this == null}, which would not be meaningful, since
2238 \var{this} would never be \var{null}.
2241 \subsection{The ContainsReturnStatementCollector}
2243 \typewithref{no.uio.ifi.refaktor.analyze.collectors}{ContainsReturnStatementCollector}
2244 is a very simple property collector. It only visits the return statements within
2245 a selection, and can report whether it encountered a return statement or not.
2247 \subsection{The LastStatementCollector}
2248 The \typewithref{no.uio.ifi.refaktor.analyze.collectors}{LastStatementCollector}
2249 collects the last statement of a selection. It does so by only visiting the top
2250 level statements of the selection, and compares the textual end offset of each
2251 encuntered statement with the end offset of the previous statement found.
2253 \section{Checkers}\label{checkers}
2254 The checkers are a range of classes that checks that selections complies with
2255 certian criterias. If a
2256 \typewithref{no.uio.ifi.refaktor.analyze.analyzers}{Checker} fails, it throws a
2257 \type{CheckerException}. The checkers are managed by the
2258 \type{LegalStatementsChecker}, which does not, in fact, implement the
2259 \type{Checker} interface. It does, however, run all the checkers registered with
2260 it, and reports that all statements are considered legal if no
2261 \type{CheckerException} is thrown. Many of the checkers either extends the
2262 \type{PropertyCollector} or utilizes one or more property collectors to verify
2263 some criterias. The checkers registered with the \type{LegalStatementsChecker}
2264 are described next. They are run in the order presented below.
2266 \subsection{The EnclosingInstanceReferenceChecker}
2267 The purpose of this checker is to verify that the names in a selection is not
2268 referencing any enclosing instances. This is for making sure that all references
2269 is legal in a method that is to be moved. Theoretically, some situations could
2270 be easily solved my passing a reference to the referenced class with the moved
2271 method (e.g. when calling public methods), but the dependency on the
2272 \type{MoveInstanceMethodProcessor} prevents this.
2275 \typewithref{no.uio.ifi.refaktor.analyze.analyzers}{EnclosingInstanceReferenceChecker}
2276 is a modified version of the
2277 \typewithref{org.eclipse.jdt.internal.corext.refactoring.structure.MoveInstanceMethodProcessor}{EnclosingInstanceReferenceFinder}
2278 from the \type{MoveInstanceMethodProcessor}. Wherever the
2279 \type{EnclosingInstanceReferenceFinder} would create a fatal error status, the
2280 checker throws a \type{CheckerException}.
2282 It works by first finding all of the enclosing types of a selection. Thereafter
2283 it visits all its simple names to check that they are not references to
2284 variables or methods declared in any of the enclosing types. In addition the
2285 checker visits \var{this}-expressions to verify that no such expressions is
2286 qualified with any name.
2288 \subsection{The ReturnStatementsChecker}\label{returnStatementsChecker}
2289 \todoin{Write\ldots/change implementation/use control flow graph?}
2291 \subsection{The AmbiguousReturnValueChecker}
2292 This checker verifies that there are no \emph{ambiguous return statements} in a
2293 selection. The problem with ambiguous return statements arise when a selection
2294 is chosen to be extracted into a new method, but it needs to return more than
2295 one value from that method. This problem occurs in two situations. The first
2296 situation arise when there is more than one local variable that is both assigned
2297 to within a selection and also referenced after the selection. The other
2298 situation occur when there is only one such assignment, but there is also one or
2299 more return statements in the selection.
2301 First the checker needs to collect some data. Those data are the binding keys
2302 for all simple names that are assigned to within the selection, including
2303 variable declarations, but excluding fields. The checker also collects whether
2304 there exists a return statement in the selection or not. No further checks of
2305 return statements are needed, since, at this point, the selection is already
2306 checked for illegal return statements \see{returnStatementsChecker}.
2308 After the binding keys of the assignees are collected, the checker searches the
2309 part of the enclosing method that is after the selection for references whose
2310 binding keys are among the the collected keys. If more than one unique referral
2311 is found, or only one referral is found, but the selection also contains a
2312 return statement, we have a situation with an ambiguous return value, and an
2313 exception is thrown.
2315 %\todoin{Explain why we do not need to consider variables assigned inside
2316 %local/anonymous classes. (The referenced variables need to be final and so
2319 \subsection{The IllegalStatementsChecker}
2320 This checker is designed to check for illegal statements.
2322 Any use of the \var{super} keyword is prohibited, since its meaning is altered
2323 when moving a method to another class.
2325 For a \emph{break} statement, there is two situations to consider: A break
2326 statement with or without a label. If the break statement has a label, it is
2327 checked that whole of the labeled statement is inside the selection. Since a
2328 label does not have any binding information, we have to search upwards in the
2329 AST to find the \type{LabeledStatement} that corresponds to the label from the
2330 break statement, and check that it is contained in the selection. If the break
2331 statement does not have a label attached to it, it is checked that its innermost
2332 enclosing loop or switch statement also is inside the selection.
2334 The situation for a \emph{continue} statement is the same as for a break
2335 statement, except that it is not allowed inside switch statements.
2337 Regarding \emph{assignments}, two types of assignments is allowed: Assignment to
2338 a non-final variable and assignment to an array access. All other assignments is
2341 \todoin{Finish\ldots}
2344 \chapter{Benchmarking}
2345 \todoin{Better name than ``benchmarking''?}
2346 This part of the master project is located in the Eclipse project
2347 \code{no.uio.ifi.refaktor.benchmark}. The purpose of it is to run the equivalent
2348 of the \type{SearchBasedExtractAndMoveMethodChanger}
2349 \see{searchBasedExtractAndMoveMethodChanger} over a larger software project,
2350 both to test its roubustness but also its effect on different software metrics.
2352 \section{The benchmark setup}
2353 The benchmark itself is set up as a \emph{JUnit} test case. This is a convenient
2354 setup, and utilizes the \emph{JUnit Plugin Test Launcher}. This provides us a
2355 with a fully functional Eclipse workbench. Most importantly, this gives us
2356 access to the Java Model of Eclipse \see{javaModel}.
2358 \subsection{The ProjectImporter}
2359 The Java project that is going to be used as the data for the benchmark, must be
2360 imported into the JUnit workspace. This is done by the
2361 \typewithref{no.uio.ifi.refaktor.benchmark}{ProjectImporter}. The importer
2362 require the absolute path to the project description file. It is named
2363 \code{.project} and is located at the root of the project directory.
2365 The project description is loaded to find the name of the project to be
2366 imported. The project that shall be the destination for the import is created in
2367 the workspace, on the base of the name from the description. Then an import
2368 operation is created, based on both the source and destination information. The
2369 import operation is run to perform the import.
2371 I have found no simple API call to accomplish what the importer does, which
2372 tells me that it may not be too many people performing this particular action.
2373 The solution to the problem was found on \emph{Stack
2374 Overflow}\footnote{\url{https://stackoverflow.com/questions/12401297}}. It
2375 contains enough dirty details to be considered unconvenient to use, if not
2376 wrapping it in a class like my \type{ProjectImporter}. One would probably have
2377 to delve into the source code for the import wizard to find out how the import
2378 operation works, if no one had already done it.
2380 \section{Statistics}
2381 Statistics for the analysis and changes is captured by the
2382 \typewithref{no.uio.ifi.refaktor.aspects}{StatisticsAspect}. This an
2383 \emph{aspect} written in \emph{AspectJ}.
2385 \subsection{AspectJ}
2386 \emph{AspectJ}\footnote{\url{http://eclipse.org/aspectj/}} is an extension to
2387 the Java language, and facilitates combining aspect-oriented programming with
2388 the object-oriented programming in Java.
2390 Aspect-oriented programming is a programming paradigm that is meant to isolate
2391 so-called \emph{cross-cutting concerns} into their own modules. These
2392 cross-cutting concerns are functionalities that spans over multiple classes, and
2393 thus does not belong naturally in any of them. It can also be functionality that
2394 does not concern the business logic of an application, and thus may be a burden
2395 when entangled in parts of the source code it does not really belong. Examples
2396 include logging, debugging, optimizations and security.
2398 Aspects is interacting with other modules by defining advices. An \emph{advice}
2399 in AspectJ is somewhat similar to a method in Java. It is meant to alter the
2400 behavior of other methods, and contains a body that is executed when it is
2403 An advice can be applied at a defined \emph{pointcut}. A pointcut picks out one
2404 or more \emph{join points}. A join point is a well-defined point in the
2405 execution of a program. It can occur when calling a method defined for a
2406 particular class, when calling all methods with the same name,
2407 accessing/assigning to a particular field of a given class and so on. An advice
2408 can be declared to run both before, after returning from a pointcut or when
2409 there is thrown an exception in the pointcut. In addition to picking out join
2410 points, a pointcut can also bind variables from its context, so they can be
2411 accessed in the body of an advice. An example of a pointcut and an advice is
2412 found in \myref{lst:aspectjExample}.
2415 \begin{minted}{java}
2416 pointcut methodAnalyze(
2417 SearchBasedExtractAndMoveMethodAnalyzer analyzer) :
2418 call(* SearchBasedExtractAndMoveMethodAnalyzer.analyze())
2419 && target(analyzer);
2421 after(SearchBasedExtractAndMoveMethodAnalyzer analyzer) :
2422 methodAnalyze(analyzer) {
2423 statistics.methodCount++;
2424 debugPrintMethodAnalysisProgress(analyzer.method);
2427 \caption{An example of a pointcut named \method{methodAnalyze},
2428 and an advice defined to be applied after it has occurred.}
2429 \label{lst:aspectjExample}
2432 \section{Optimizations}
2434 \subsection{Caching}
2436 \subsection{Memento}
2438 \chapter{Eclipse Bugs Found}
2439 \todoin{Add other things and change headline?}
2441 \section{Eclipse bug 420726: Code is broken when moving a method that is
2442 assigning to the parameter that is also the move
2443 destination}\label{eclipse_bug_420726}
2444 This bug\footnote{\url{https://bugs.eclipse.org/bugs/show\_bug.cgi?id=420726}}
2445 was found when analyzing what kinds of names that was to be considered as
2446 \emph{unfixes} \see{unfixes}.
2448 \subsection{The bug}
2449 The bug emerges when trying to move a method from one class to another, and when
2450 the target for the move (must be a variable, local or field) is both a parameter
2451 variable and also is assigned to within the method body. Eclipse allows this to
2452 happen, although it is the sure path to a compilation error. This is because we
2453 would then have an assignment to a \var{this} expression, which is not allowed
2456 \subsection{The solution}
2457 The solution to this problem is to add all simple names that are assigned to in
2458 a method body to the set of unfixes.
2460 \section{Eclipse bug 429416: IAE when moving method from anonymous class}
2462 discovered\footnote{\url{https://bugs.eclipse.org/bugs/show\_bug.cgi?id=429416}}
2463 this bug during a batch change on the \type{org.eclipse.jdt.ui} project.
2465 \subsection{The bug}
2466 This bug surfaces when trying to use the Move Method refactoring to move a
2467 method from an anonymous class to another class. This happens both for my
2468 simulation as well as in Eclipse, through the user interface. It only occurs
2469 when Eclipse analyzes the program and finds it necessary to pass an instance of
2470 the originating class as a parameter to the moved method. I.e. it want to pass a
2471 \var{this} expression. The execution ends in an
2472 \typewithref{java.lang}{IllegalArgumentException} in
2473 \typewithref{org.eclipse.jdt.core.dom}{SimpleName} and its
2474 \method{setIdentifier(String)} method. The simple name is attempted created in
2476 \methodwithref{org.eclipse.jdt.internal.corext.refactoring.structure.\\MoveInstanceMethodProcessor}{createInlinedMethodInvocation}
2477 so the \type{MoveInstanceMethodProcessor} was early a clear suspect.
2479 The \method{createInlinedMethodInvocation} is the method that creates a method
2480 invocation where the previous invocation to the method that was moved was. From
2481 its code it can be read that when a \var{this} expression is going to be passed
2482 in to the invocation, it shall be qualified with the name of the original
2483 method's declaring class, if the declaring class is either an anonymous clas or
2484 a member class. The problem with this, is that an anonymous class does not have
2485 a name, hence the term \emph{anonymous} class! Therefore, when its name, an
2486 empty string, is passed into
2487 \methodwithref{org.eclipse.jdt.core.dom.AST}{newSimpleName} it all ends in an
2488 \type{IllegalArgumentException}.
2490 \subsection{How I solved the problem}
2491 Since the \type{MoveInstanceMethodProcessor} is instantiated in the
2492 \typewithref{no.uio.ifi.refaktor.change.executors}{MoveMethod\-RefactoringExecutor},
2493 and only need to be a
2494 \typewithref{org.eclipse.ltk.core.refactoring.participants}{MoveProcessor}, I
2495 was able to copy the code for the original move processor and modify it so that
2496 it works better for me. It is now called
2497 \typewithref{no.uio.ifi.refaktor.refactorings.processors}{ModifiedMoveInstanceMethodProcessor}.
2498 The only modification done (in addition to some imports and suppression of
2499 warnings), is in the \method{createInlinedMethodInvocation}. When the declaring
2500 class of the method to move is anonymous, the \var{this} expression in the
2501 parameter list is not qualified with the declaring class' (empty) name.
2503 \section{Eclipse bug 429954: Extracting statement with reference to local type
2504 breaks code}\label{eclipse_bug_429954}
2505 The bug\footnote{\url{https://bugs.eclipse.org/bugs/show\_bug.cgi?id=429954}}
2506 was discovered when doing some changes to the way unfixes is computed.
2508 \subsection{The bug}
2509 The problem is that Eclipse is allowing selections that references variables of
2510 local types to be extracted. When this happens the code is broken, since the
2511 extracted method must take a parameter of a local type that is not in the
2512 methods scope. The problem is illustrated in
2513 \myref{lst:extractMethod_LocalClass}, but there in another setting.
2515 \subsection{Actions taken}
2516 There are no actions directly springing out of this bug, since the Extract
2517 Method refactoring cannot be meant to be this way. This is handled on the
2518 analysis stage of our Extract and Move Method refactoring. So names representing
2519 variables of local types is considered unfixes \see{unfixes}.
2520 \todoin{write more when fixing this in legal statements checker}
2522 \chapter{Related Work}
2524 \section{The compositional paradigm of refactoring}
2525 This paradigm builds upon the observation of Vakilian et
2526 al.\citing{vakilian2012}, that of the many automated refactorings existing in
2527 modern IDEs, the simplest ones are dominating the usage statistics. The report
2528 mainly focuses on \emph{Eclipse} as the tool under investigation.
2530 The paradigm is described almost as the opposite of automated composition of
2531 refactorings \see{compositeRefactorings}. It works by providing the programmer
2532 with easily accessible primitive refactorings. These refactorings shall be
2533 accessed via keyboard shortcuts or quick-assist menus\footnote{Think
2534 quick-assist with Ctrl+1 in Eclipse} and be promptly executed, opposed to in the
2535 currently dominating wizard-based refactoring paradigm. They are ment to
2536 stimulate composing smaller refactorings into more complex changes, rather than
2537 doing a large upfront configuration of a wizard-based refactoring, before
2538 previewing and executing it. The compositional paradigm of refactoring is
2539 supposed to give control back to the programmer, by supporting \himher with an
2540 option of performing small rapid changes instead of large changes with a lesser
2541 degree of control. The report authors hope this will lead to fewer unsuccessful
2542 refactorings. It also could lower the bar for understanding the steps of a
2543 larger composite refactoring and thus also help in figuring out what goes wrong
2544 if one should choose to op in on a wizard-based refactoring.
2546 Vakilian and his associates have performed a survey of the effectiveness of the
2547 compositional paradigm versus the wizard-based one. They claim to have found
2548 evidence of that the \emph{compositional paradigm} outperforms the
2549 \emph{wizard-based}. It does so by reducing automation, which seem
2550 counterintuitive. Therefore they ask the question ``What is an appropriate level
2551 of automation?'', and thus questions what they feel is a rush toward more
2552 automation in the software engineering community.