Go Execution Tracer

NECST Lab @ Politecnico di Milano

Slides for my talk at Gophercon Brazil 2017 on the Go execution tracer.

Software

Go execution tracer
Gophercon Brazil 2017
André Carvalho

$ whoami
• Developer @ globo.com /
tsuru
• Interested in all things
performance, tracing and
systems programming
• @andresantostc
• https://andrestc.com

Agenda
• The tool basics
• What is the Go execution tracer
• How to collect trace data
• How to analyze trace data
• Using the tracer
• to improve working code
• to investigate a strange behavior

Go execution tracer
• Gives insight into the execution of a Go program
• What are my goroutines doing when not in CPU?
• Instruments the go runtime
• Captures events in nanosecond precision
• Data is not aggregated/sampled!
• Available since go 1.5

Go execution tracer
• Events
• Goroutines creation/start/end/block/unblock
• Network
• Syscalls
• Memory allocation
• Garbage collection

Collecting traces
• Three ways to collect traces
• trace.Start / trace.Stop
• go test -trace=trace.out
• debug/pprof/trace handler

Collecting traces
• Writes the tracing output to
os.Stderr
• go run main.go 2> trace.out
• go tool trace trace.out

View Trace
1. Timeline
2. Heap usage
3. goroutines
1
2
3
4
5
4. OS threads
5. Virtual Processors
6. goroutine + events
6

Tracing web applications
https://github.com/andrestc/go-tracing/tree/master/07-web

Using the tracer to
improve working code

Mandelbrot
CPU intensive calculations to
ﬁgure out each pixel’s color
https://github.com/campoy/
mandelbrot/

Planb
• github.com/tsuru/planb
• reverse proxy based of hipache
• One of tsuru’s key components
• Used extensively on globo.com

Planb
Planb
Host: app.cloud.com
Backend
Backend
Backend

https://github.com/golang/go/issues/21204

Workaround
https://github.com/tsuru/planb/pull/35

Conclusions
• Go execution tracer helps understand concurrency
• Complements other tools (eg memory/cpu
proﬁle)
• Not much documentation available
• Opportunity for contributions

$Reference • Using the go tracer to speed up fractal rendering • Just for func #22 • Go Execution Tracer (Design Doc)$

Slides and notes in english
will be available at
https://andrestc.com
Obrigado!

Más contenido relacionado

Destacado

numPYNQ @ NGCLE@e-Novia 15.11.2017

The Linux Foundation has over 500 corporate members involved in over 70 member-sponsored projects. In 2016, the Linux Foundation convened over 20,000 people from 85 countries and over 4000 companies at 150 events around the world. Over 800,000 students from 215 countries have enrolled in Linux Foundation training programs. Who is driving this growth? Why do companies invest valuable resources in collaborative development? What have we learned along the way?

What in the World is Going on at The Linux Foundation?

Black Duck by Synopsys

Dive deep into an actual enterprise Linux migration by walking through the planning and execution of the process as seen by our customers. Our enterprise architects will break down the key migration steps to explain the available options, decisions made, and demonstrate actions on a live system. This episode gives you a representative migration experience before you actually migrate, illustrating: Side-by-side comparisons between Red Hat Enterprise Linux and CentOS; steps to consider for the operating system; and steps to consider for common application stacks and packages.

Walk through an enterprise Linux migration

Rogue Wave Software

Graduating To Go - A Jumpstart into the Go Programming Language

Kaylyn Gibilterra

[若渴計畫] Challenges and Solutions of Window Remote Shellcode

Aj MaChInE

Communication hardware

Hans Mallen

Virtualization

Server virtualization

In-depth forensic analysis of Windows registry files

Maxim Suhanov

SDN Architecture & Ecosystem

OpenFlow

Deep dive into Coroutines on JVM @ KotlinConf 2017

Roman Elizarov

Network Virtualization

Introduction to OpenFlow, SDN and NFV

The United States of America the world in need The United States is the world’s superpower. The US president is referred to as the most powerful person in the world. But is all that enough to hold a global leadership? In many parts of the world, notably Russia, the Middle East and big parts of Asia, the US has a big reputation problem. Which America does the world in need? United States of America America US U.S. USA U.S.A. Future World Great Powers Smart Planet Great superpowers Smart America Green America Innovation America Sustainable America i-USA, Intelligent, Innovative, Interconnected and Instrumented America What is needed to become a smart superpower Digital Influence (Leading the Future Internet, digital MNCs, developing Intelligent Digital National Infrastructure and Smart Governance Platform, as i-America, i-Europe, i-China or i-Russia) Geographic Influence (large territory, space/sea area, large population, large natural resources, large renewables) Economic Influence (leading GDP, sustainable economic growth, income equality, lhigh quality of life, arge MNCs and innovative start-ups), economic self-sufficiency, largest circular economy, leading smart economy globalization) Military Influence (nuclear power, large land, sea and air armies, capacity to extend military power over the globe) Political influence (controlling major global political institutions and intergovernmental organizations, as the UN, G7, G20, OECD, NATO) Financial influence (controlling the world currency, global financial institutions, as World Bank and the IMF, international trading blocs, as NAFTA) Cultural Influence (intelligent Americanization, strong cultural influence over the world, controlling social networks and world digital media)

Scaling and Transaction Futures

MongoDB

2018 State of the Union Address: Rediscovering the American way: USA XXI: Fut...

Azamat Abdoullaev

Blockchain demystification

Bellaj Badr

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...

Chris Fregly

The current craze of Docker has everyone sticking their processes inside a container… but do you really understand cgroups and how they work? Do you understand the difference between CPU Sets and CPU Shares? Spark is a Scala application that lives inside a Java Runtime, do you understand the consequence of what impact the cgroup constraints have on the JRE? This talk starts with a deep understand of Java’s memory management and GC characteristics and how JRE characteristics change based on core count. We will continue the talk looking at containers and how resource isolation works.

Jörg Schad - NO ONE PUTS Java IN THE CONTAINER - Codemotion Milan 2017

Codemotion

As in the Star Trek Beyond movie, which the title of this talk tries to recall, we will present how Kubernetes can be extended beyond containers using Custom Resource Definitions (CRD) to schedule custom tasks and resources or bring Kubernetes automation to the next level. During the presentation we will go deep into the concept of Operator and provide some useful examples of application of this pattern to, i.e., the automated scaling of Services.

Andrea Tosatto - Kubernetes Beyond - Codemotion Milan 2017

Codemotion

Destacado (20)

numPYNQ @ NGCLE@e-Novia 15.11.2017

What in the World is Going on at The Linux Foundation?

Walk through an enterprise Linux migration

Graduating To Go - A Jumpstart into the Go Programming Language

[若渴計畫] Challenges and Solutions of Window Remote Shellcode

Communication hardware

Virtualization

Server virtualization

In-depth forensic analysis of Windows registry files

SDN Architecture & Ecosystem

OpenFlow

Deep dive into Coroutines on JVM @ KotlinConf 2017

Network Virtualization

Introduction to OpenFlow, SDN and NFV

Scaling and Transaction Futures

2018 State of the Union Address: Rediscovering the American way: USA XXI: Fut...

Blockchain demystification

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...

Jörg Schad - NO ONE PUTS Java IN THE CONTAINER - Codemotion Milan 2017

Andrea Tosatto - Kubernetes Beyond - Codemotion Milan 2017

Similar a Go Execution Tracer

Tracer

Siddharth Singhal

A Taste of Monitoring and Post Mortem Debugging with Node

ibmwebspheresoftware

Reproducibility and automation of machine learning process

Denis Dus

Что нам стоіт таск манагер построіт. Ігор Лущик. LvivPy #6

Serhii Ruskykh

Silicon Valley Code Camp 2016 - MongoDB in production

Daniel Coupal

Monitoring your API

Andrés F Vargas

PyCon AU 2012 - Debugging Live Python Web Applications

Graham Dumpleton

Campus days 2013 - Instrumentation

Anders Lybecker

Start guide to web scraping with Scrapy, one of best python modules to do web scraping, with Scrapy everything is more easy. This presentation covers the key concepts of scrapy and the process of criation of spiders. It's the first draft version and will be other versions, until the last version, if you see something that you want to be improved, give feedback and I will take that in consideration. I also talk about some alternatives to scrapy like lxml, newspapers and others. In the final i give you acess to the code used on this presentation, so you cant test easy and fast the concepts talked on this presentation. I hope you like it :D

Scrapy

Francisco Sousa

Forensics WS Consolidated

Karter Rohrer

MW_Arch Fastest_way_to_hunt_on_Windows_v1.01

Michael Gough

Introducing ArTHIR - ATT&CK Remote Threat Hunting Incident Response Windows tool

Michael Gough

Cloud Foundry Monitoring How-To: Collecting Metrics and Logs

Altoros

Operating System Forensics

ArunJS5

2_Big Data Sources part3-Day 1-B Tools.pptx

ssuser87a462

Keep Calm and Distributed Tracing

Angelo Simone Scotto

When Security Tools Fail You

Michael Gough

Pekka_Aho_Complementing GUI Testing Scripts - Testing Assembly 2022.pdf

FiSTB

Hands-on Go profiling What is Go profiling? When and how to use it? and how to utilize Go build-in tools to search for bottlenecks and optimize our code. In this live demo session, we'll go over multiple examples and learn how to read the pprof output. We'll share some tips and ticks, as well as an overview of multiple open source Go profiling tools. OpsTalk presentation "Let's talk about debugging" held at January 21, 2018 in Here Mobility office, Ra'anana, Israel.

Hands-on go profiling

Daniel Ammar

Greg Hoglund explained at BlackHat 2010 that the development environments that malware authors use leaves traces in the code which can be used to attribute malware to a individual or a group of individuals. Not with the precision of name, date of birth and address but with evidence that a arrested suspects computer can be analysed and compared with the "tool marks" on the collected malware sample.

DEEPSEC 2013: Malware Datamining And Attribution

Michael Boman

Similar a Go Execution Tracer (20)

Tracer

A Taste of Monitoring and Post Mortem Debugging with Node

Reproducibility and automation of machine learning process

Что нам стоіт таск манагер построіт. Ігор Лущик. LvivPy #6

Silicon Valley Code Camp 2016 - MongoDB in production

Monitoring your API

PyCon AU 2012 - Debugging Live Python Web Applications

Campus days 2013 - Instrumentation

Scrapy

Forensics WS Consolidated

MW_Arch Fastest_way_to_hunt_on_Windows_v1.01

Introducing ArTHIR - ATT&CK Remote Threat Hunting Incident Response Windows tool

Cloud Foundry Monitoring How-To: Collecting Metrics and Logs

Operating System Forensics

2_Big Data Sources part3-Day 1-B Tools.pptx

Keep Calm and Distributed Tracing

When Security Tools Fail You

Pekka_Aho_Complementing GUI Testing Scripts - Testing Assembly 2022.pdf

Hands-on go profiling

DEEPSEC 2013: Malware Datamining And Attribution

Más de André Carvalho

Containers na Globo.com - Passado, Presente e Futuro

O Tsuru é um PaaS open-source desenvolvido pela Globo.com e utilizado há 4 anos em produção. Com o principal objetivo de simplificar o deploy de aplicações, é responsável por mais de 100 deploys por dia e por gerenciar a saúde de mais de 200 VMs. Nesta palestra serão abordadas as motivações por trás do projeto, seu funcionamento e como ele pode ser utilizado para trazer agilidade e segurança para sua cloud

Tsuru - Deploys Fáceis e Seguros

Classificação de séries temporais via divergente entre densidades de probabil...

Instrumentando aplicações Go com Prometheus

Um estudo sobre a aplicação de algoritmos genéticos no investimento em ações ...

Uma comparação do desempenho de SGBDS de grafos com armazenamento nativo e SG...

Clusterização de padrões de candlesticks utilizando Mapas de Kohonen

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal.

Más de André Carvalho (7)

Containers na Globo.com - Passado, Presente e Futuro

Tsuru - Deploys Fáceis e Seguros

Classificação de séries temporais via divergente entre densidades de probabil...

Instrumentando aplicações Go com Prometheus

Um estudo sobre a aplicação de algoritmos genéticos no investimento em ações ...

Uma comparação do desempenho de SGBDS de grafos com armazenamento nativo e SG...

Clusterização de padrões de candlesticks utilizando Mapas de Kohonen

Último

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...

This presentation covers the following topics: What is logging? The purpose of logging: Debugging The purpose of logging: Security The purpose of logging: Stats & analytics Traditional logging Traditional logging: Advantages Traditional logging: Disadvantages The solution: Large-scale logging Large-scale logging: Core principles Large-scale logging: Solution types Large-scale logging: Cloud vs on-prem Large-scale logging: Operational complexity Large-scale logging: Security Large-scale logging: Costs Large-scale logging: On-prem comparison - Elasticsearch - Grafana Loki - VictoriaLogs On-prem comparison: Setup and operation On-prem comparison: Costs On-prem comparison: Full-text search support On-prem comparison: How to efficiently query 100TB of logs? On-prem comparison: Integration with CLI tools VictoriaLogs for large-scale logging VictoriaLogs demo instance - Ingestion rate: 3600 messages / minute - The number of log messages: 1.1 billion - Uncompressed log messages’ size: 1.5TB - Compressed log messages’ size: 23GB - Compression ratio: 47x - Memory usage: 150MB VictoriaLogs CLI integration demo - Which errors have occurred in all the apps during the last hour? - How many errors have occurred during the last hour? - Which apps generated the most of errors during the last hour? - The number of per-minute errors for the last 10 minutes - Status codes for the last hour - Non-200 status codes for the last week - Top client IPs for the last 4 weeks with 404 and 500 response status codes - Per-month stats for the given IP across all the logs Large-scale logging solution MUST provide excellent CLI integration VictoriaLogs: (temporary) drawbacks VictoriaLogs: Recap - Easy to setup and operate - The lowest RAM usage and disk space usage (up to 30x less than Elasticsearch and Grafana Loki) - Fast full-text search - Excellent integration with traditional command-line tools for log analysis - Accepts logs from popular log shippers (Filebeat, Fluentbit, Logstash, Vector, Promtail, Grafana Agent) - Open source and free to use!

WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity

WSO2

Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024

VictoriaMetrics

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️

Delhi Call girls

WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...

WSO2

Looking for an efficient way to manage your finances? Look no further than our money management app. With easy-to-use features, you can track your expenses, create budgets, and monitor your savings goals all in one place. Our app provides real-time updates on your spending habits and helps you make smarter financial decisions. Take control of your finances today with our user-friendly money management app.

Right Money Management App For Your Financial Goals

Jhone kinadey

The fast-paced world of Agile development just got a turbo boost! Dive into this engaging talk on "Innovation at Speed: ChatGPT & the AI Transformation in Agile Development." Over the last few months, AI, including notable tools like Google Bard and Microsoft Co-Pilot, has been leveraged to supercharge Agile workflows. In this session, attendees will get an overview of the current AI landscape and its impact on development. They will learn why AI is the game-changer needed to embrace in the Agile lifecycle, offering that elusive X factor to multiply productivity. Real-world examples will be presented, and the challenges of implementing AI tools like ChatGPT within corporate environments will be discussed.

Harnessing ChatGPT - Elevating Productivity in Today's Agile Environment

VictorSzoltysek

Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...

Bert Jan Schrijver

%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain

%in Midrand+277-882-255-28 abortion pills for sale in midrand

%in Soweto+277-882-255-28 abortion pills for sale in soweto

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in Tembisa ● Abortion Pills For Sale in Tembisa ● Tembisa 🏥🚑!! Abortion Clinic Near Me Cost, Price, Women's Clinic Near Me, Abortion Clinic Near, Abortion Doctors Near me, Abortion Services Near Me, Abortion Pills Over The Counter, Abortion Pill Doctors' Offices, Abortion Clinics, Abortion Places Near Me, Cheap Abortion Places Near Me, Medical Abortion & Surgical Abortion, approved cyctotec pills and womb cleaning pills too plus all the instructions needed This Discrete women’s Termination Clinic offers same day services that are safe and pain free, we use approved pills and we clean the womb so that no side effects are present. Our main goal is that of preventing unintended pregnancies and unwanted births every day to enable more women to have children by choice, not chance. We offer Terminations by Pill and The Morning After Pill.” Our Private VIP Abortion Service offers the ultimate in privacy, efficiency and discretion. we do safe and same day termination and we do also womb cleaning as well its done from 1 week up to 28 weeks. We do delivery of our services world wide SAFE ABORTION CLINICS/PILLS ON SALE WE DO DELIVERY OF PILLS ALSO Abortion clinic at very low costs, 100% Guaranteed and it’s safe, pain free and a same day service. It Is A 45 Minutes Procedure, we use tested abortion pills and we do womb cleaning as well. Alternatively the medical abortion pill and womb cleansing !!!

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...

Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg

WSO2CON2024 - It's time to go Platformless

WSO2

Announcing Codolex 2.0 from GDK Software

Jim McKeeth

%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview

ADR, or Architecture Decision Record, is a valuable tool in software development for several reasons. It provides a centralized location for documenting and tracking architectural decisions, aiding both current and future team members. ADRs enhance communication among team members by documenting the rationale behind architectural decisions, especially beneficial during onboarding of new team members or when revisiting decisions. They serve as a knowledge base, enabling teams to learn from past decisions and refine their decision-making process. Additionally, ADRs contribute to transparency by helping stakeholders understand the reasons behind specific architectural choices. As with any other tool or process, introducing them into an organization can face several obstacles, and overcoming these challenges is crucial for successful implementation. In this talk I go through some common problems and our way of solving them.

Architecture decision records - How not to get lost in the past

Papp Krisztián

Model Call Girl Services in Delhi reach out to us at 🔝 9953056974 🔝✔️✔️ Our agency presents a selection of young, charming call girls available for bookings at Oyo Hotels. Experience high-class escort services at pocket-friendly rates, with our female escorts exuding both beauty and a delightful personality, ready to meet your desires. Whether it's Housewives, College girls, Russian girls, Muslim girls, or any other preference, we offer a diverse range of options to cater to your tastes. We provide both in-call and out-call services for your convenience. Our in-call location in Delhi ensures cleanliness, hygiene, and 100% safety, while our out-call services offer doorstep delivery for added ease. We value your time and money, hence we kindly request pic collectors, time-passers, and bargain hunters to refrain from contacting us. Our services feature various packages at competitive rates: One shot: ₹2000/in-call, ₹5000/out-call Two shots with one girl: ₹3500/in-call, ₹6000/out-call Body to body massage with sex: ₹3000/in-call Full night for one person: ₹7000/in-call, ₹10000/out-call Full night for more than 1 person: Contact us at 🔝 9953056974 🔝. for details Operating 24/7, we serve various locations in Delhi, including Green Park, Lajpat Nagar, Saket, and Hauz Khas near metro stations. For premium call girl services in Delhi 🔝 9953056974 🔝. Thank you for considering us!

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE

9953056974 Low Rate Call Girls In Saket, Delhi NCR

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...

%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein