The document discusses profiling and debugging dynamic object-oriented programs. It describes how traditional profilers that use execution sampling do not provide enough information, such as which specific objects are causing performance issues. New techniques are proposed that track object identities and message passing to better pinpoint problems. These include domain-specific profilers for visualizations, back-in-time debuggers using object histories, and meta-level tools that can evolve and reconfigure objects and classes at runtime. The goal is to "let Smalltalk loose" by making its object model and meta-level more flexible and evolution-friendly to support advanced debugging and profiling.
18. Domain-Sp
CPU time profiling
Mondrian [9] is an open and agile visualization engine.
visualization using a graph of (possibly nested) nodes an
Profile
a serious performance issue was raised1 . Tracking down
performance was not trivial. We first used a standard sam
Execution sampling approximates the time spent in an
by periodically stopping a program and recording the cu
under executions. Such a profiling technique is relatively
little impact on the overall execution. This sampling techn
all mainstream profilers, such as JProfiler, YourKit, xprof
MessageTally, the standard sampling-based profiler in P
tually describes the execution in terms of CPU consumpt
each method of Mondrian:
54.8% {11501ms} MOCanvas>>drawOn:
54.8% {11501ms} MORoot(MONode)>>displayOn:
30.9% {6485ms} MONode>>displayOn:
{ { | 18.1% {3799ms} MOEdge>>displayOn:
{ { ...
} | 8.4% {1763ms} MOEdge>>displayOn:
}
}
| | 8.0% {1679ms} MOStraightLineShape>>display:on:
| | 2.6% {546ms} FormCanvas>>line:to:width:color:
} { } ...
23.4% {4911ms} MOEdge>>displayOn:
...
We can observe that the virtual machine spent abou
the method displayOn: defined in the class MORoot. A ro
nested node that contains all the nodes of the edges of t
general profiling information says that rendering nodes a
great share of the CPU time, but it does not help in pin
and edges are responsible for the time spent. Not all grap
consume resources.
Traditional execution sampling profilers center their r
the execution stack and completely ignore the identity of th
the method call and its arguments. As a consequence, it
which objects cause the slowdown. For the example above,
says that we spent 30.9% in MONode>>displayOn: withou
were actually refreshed too often.
Coverage
PetitParser is a parsing framework combining ideas from
parser combinators, parsing expression grammars and pac
grammars and parsers as objects that can be reconfigured
19. CPU time profiling
Mondrian [9] is an open and agile visualization engine.
Profile
visualization using a graph of (possibly nested) nodes an
a serious performance issue was raised1 . Tracking down
performance was not trivial. We first used a standard sam
Execution sampling approximates the time spent in an
by periodically stopping a program and recording the cu
under executions. Such a profiling technique is relatively
little impact on the overall execution. This sampling techn
all mainstream profilers, such as JProfiler, YourKit, xprof
MessageTally, the standard sampling-based profiler in P
tually describes the execution in terms of CPU consumpt
each method of Mondrian:
54.8% {11501ms} MOCanvas>>drawOn:
54.8% {11501ms} MORoot(MONode)>>displayOn:
{ { 30.9% {6485ms} MONode>>displayOn:
{ { | 18.1% {3799ms} MOEdge>>displayOn:
} ...
}
} | 8.4% {1763ms} MOEdge>>displayOn:
| | 8.0% {1679ms} MOStraightLineShape>>display:on:
} { } | | 2.6% {546ms} FormCanvas>>line:to:width:color:
...
23.4% {4911ms} MOEdge>>displayOn:
...
We can observe that the virtual machine spent abou
the method displayOn: defined in the class MORoot. A ro
nested node that contains all the nodes of the edges of t
general profiling information says that rendering nodes a
great share of the CPU time, but it does not help in pin
and edges are responsible for the time spent. Not all grap
consume resources.
Traditional execution sampling profilers center their r
the execution stack and completely ignore the identity of th
the method call and its arguments. As a consequence, it
which objects cause the slowdown. For the example above,
says that we spent 30.9% in MONode>>displayOn: withou
were actually refreshed too often.
Domain
Coverage
PetitParser is a parsing framework combining ideas from
parser combinators, parsing expression grammars and pac
grammars and parsers as objects that can be reconfigured
1
http://forum.world.st/Mondrian-is-slow-next-step-tc
a2261116
2
http://www.pharo-project.org/
23. little impact on the overall execution. This sampling technique is u
all mainstream profilers, such as JProfiler, YourKit, xprof [10], an
MessageTally, the standard sampling-based profiler in Pharo Sm
tually describes the execution in terms of CPU consumption and i
each method of Mondrian:
54.8% {11501ms} MOCanvas>>drawOn:
54.8% {11501ms} MORoot(MONode)>>displayOn:
30.9% {6485ms} MONode>>displayOn:
| 18.1% {3799ms} MOEdge>>displayOn:
...
| 8.4% {1763ms} MOEdge>>displayOn:
| | 8.0% {1679ms} MOStraightLineShape>>display:on:
| | 2.6% {546ms} FormCanvas>>line:to:width:color:
...
23.4% {4911ms} MOEdge>>displayOn:
...
We can observe that the virtual machine spent about 54% o
the method displayOn: defined in the class MORoot. A root is the
nested node that contains all the nodes of the edges of the visua
general profiling information says that rendering nodes and edge
24. Domain-Specific Profiling 3
CPU time profiling
Which is the relationship?
Mondrian [9] is an open and agile visualization engine. Mondrian describes a
visualization using a graph of (possibly nested) nodes and edges. In June 2010
a serious performance issue was raised1 . Tracking down the cause of the poor
performance was not trivial. We first used a standard sample-based profiler.
Execution sampling approximates the time spent in an application’s methods
by periodically stopping a program and recording the current set of methods
under executions. Such a profiling technique is relatively accurate since it has
little impact on the overall execution. This sampling technique is used by almost
all mainstream profilers, such as JProfiler, YourKit, xprof [10], and hprof.
MessageTally, the standard sampling-based profiler in Pharo Smalltalk2 , tex-
tually describes the execution in terms of CPU consumption and invocation for
each method of Mondrian:
54.8% {11501ms} MOCanvas>>drawOn:
54.8% {11501ms} MORoot(MONode)>>displayOn:
30.9% {6485ms} MONode>>displayOn:
?
| 18.1% {3799ms} MOEdge>>displayOn:
...
| 8.4% {1763ms} MOEdge>>displayOn:
| | 8.0% {1679ms} MOStraightLineShape>>display:on:
| | 2.6% {546ms} FormCanvas>>line:to:width:color:
...
23.4% {4911ms} MOEdge>>displayOn:
...
We can observe that the virtual machine spent about 54% of its time in
the method displayOn: defined in the class MORoot. A root is the unique non-
nested node that contains all the nodes of the edges of the visualization. This
general profiling information says that rendering nodes and edges consumes a
great share of the CPU time, but it does not help in pinpointing which nodes
and edges are responsible for the time spent. Not all graphical elements equally
consume resources.
Traditional execution sampling profilers center their result on the frames of
the execution stack and completely ignore the identity of the object that received
the method call and its arguments. As a consequence, it is hard to track down
which objects cause the slowdown. For the example above, the traditional profiler
says that we spent 30.9% in MONode>>displayOn: without saying which nodes
were actually refreshed too often.
Coverage
PetitParser is a parsing framework combining ideas from scannerless parsing,
71. name value
init@t1 null
predecessor
name value
:Person field-write@t2 'Doe'
predecessor
name
value
field-write@t3 'Smith'
person := Person new t1
...
name := 'Doe' t2
...
name := 'Smith' t3
repeated at 40th anniversary of “Mother of all demos”\nDoug Engelbart sketchpad\nhe meant that we are using computers to enhanced previous ways of thinking. Not to have new ways of thinking.\n
\n
\n
Smalltalk is a very good example of this programming perspective.\n\nDealing with objects is good, and modifying them live is even better.\n
\n
We still regard our systems as a whole or part of them as static. We still go back to the code to analyze and understand.\nWe still are thinking in a reading paradigm\n
\n
Smalltalk is a very good example of this programming perspective\n
We still regard our systems as a whole or part of them as static. We still go back to the code to analyze and understand.\nWe still are thinking in a reading paradigm\n
We still regard our systems as a whole or part of them as static. We still go back to the code to analyze and understand.\nWe still are thinking in a reading paradigm\n
We still regard our systems as a whole or part of them as static. We still go back to the code to analyze and understand.\nWe still are thinking in a reading paradigm\n
\n
We have to go back to the code\n
We have to go back to the code\n
We have to go back to the code\n
We have to go back to the code\n
We have to go back to the code\n
We have to go back to the code\n
\n
Code profilers commonly employ execution sampling as the way to obtain dynamic run-time information\n
\n
is a framework for drawing graphs\n
\n
\n
What is the relationship between this and the domain? picture again\n
\n
\n
\n
Fixed the way we think it frames our mind set\n
\n
\n
\n
\n
This is what we missed from the cell metaphor.\nWe took the structure and communication between cells but not the evolution part.\nCells are capable of creating a human being because they can evolve.\nViruses, cures, medicines, drugs, etc.\n
\n
This is what we missed from the cell metaphor.\nWe took the structure and communication between cells but not the evolution part.\nCells are capable of creating a human being because they can evolve.\nViruses, cures, medicines, drugs, etc.\n
I am going to talk about 4 applications that were conceived by breaking loose from the object model.\n
\n
We have to go back to the code\n
We have to go back to the code\n
\n
\n
Between the questions that we ask ourselves and the solutions that our tools provide.\nAvoid going to the code. (going static)\nremain dynamic, interacting with the objects and if necessary make them evolve.\n
\n
\n
\n
\n
\n
Clicking and drag-and-dropping nodes refreshes the visualization, thus increasing the progress bar of the corresponding nodes. This profile helps identifying unnecessary rendering. We identified a situation in which nodes were refreshing without receiving user actions.\n
\n
\n
\n
\n
We do not know what to evolve or who should evolve.\nWe need some spreading of the evolution like a disease or cure.\n\nThe adaptation cannot be seen by other objects which are in a different execution.\nThe adaptation is dynamically set.\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
\n
The impact to the system is bearable \n
\n
We have not forgotten about structural changes.\n
\n
that it is a cool, large and open source platform for data and software analysis that is being increasingly used in industrial projects\n
\n
\n
\n
\n
\n
How do we solve this?\n
\n
We see that there are many different ways of doing reflection, adaptation, instrumentation, many are low level.\nAnd the ones that are highly flexible cannot break free from the limitations of the language.\n
Adaptation semantic abstraction for composing meta-level structure and behavior.\n
\n
\n
\n
\n
\n
\n
We have a way of setting free from the assumptions and limitations of the object model.\nWe can experiment and build new abstractions.\nLike the object debugger, talents, meta spy, prisma, back in time debugging, etc.\n
We built a tool for breaking the object model and we ended up trying different new things.\n
We are not going to be able to find the next “new” thing by fixing more and more the abstractions that we use to think.\nI am not saying that nothing should be fixed.\nWhat I am saying is that sometimes is good to think out of the box and see what are we missing by embracing the advantages of having a fixed world.\nHaving a different point of view.\nBTW the world and its problems are not fixed at all.\n\nProviding a simple and unifying way of evolving objects allowed us to produce all these ideas and tools.\n
We are not going to be able to find the next “new” thing by fixing more and more the abstractions that we use to think.\nI am not saying that nothing should be fixed.\nWhat I am saying is that sometimes is good to think out of the box and see what are we missing by embracing the advantages of having a fixed world.\nHaving a different point of view.\nBTW the world and its problems are not fixed at all.\n\nProviding a simple and unifying way of evolving objects allowed us to produce all these ideas and tools.\n
works on any pharo version, you can load it now an use any of these tools right away.\n