Il game audio come processo ingegneristico - Davide Pensato - Codemotion Rome 2017

•

1 like•324 views

Mostrare come il game audio è a tutti gli effetti una professionalità che unisce ad aspetti artistico creativi, forti competenze tecnico informatiche. L'audio designer può a tutti gli effetti considerarsi un ingegnere del suono, che applica modelli, regole e metodi rigorosi per ottenere il risultato. Tutto questo all'interno del ciclo di produzione, integrandosi con grafici, designer e programmatori

Technology

Il Game Audio Come Processo Ingegneristico
Davide Pensato
ROME 24-25 MARCH 2017

Le origini: Davide Pensato
Chitarrista
Cantante
Songwriter
Compositore
Chitarrista
Cantante
Songwriter
Compositore
- Ingegnere delle Telecomunicazioni- Ingegnere delle Telecomunicazioni

Ruoli nella produzione audio
Audio Director
Sound Designer
Compositore
Voice Over
Audio Programmer

E' una figura importante ma difficile da reperire.
● Analisi della piattaforma
● Fornire elementi e limitazioni tecniche al design
● Realizzazione del sound engine (proprietario o
middleware)
● Integrazione e creazione tools
Audio Programmer

Skills Generiche
● Comprovata conoscenza dei linguaggi C, C++
● Laurea in discipline informatiche
● Conoscenze di trigonometria e algebra delle matrici
● Capacità di raggiungere gli obiettivi
● Passione per i videogiochi
Audio Programmer

Skills Audio
● Conoscenza approfondita dell'elaborazione del segnale audio
(mixaggio, frequenze di campionamento, formati di compressione,
filtraggi, riverberi, audio 3D posizionale, etc...) e della sintesi sonora
● Esperienza nell'uso di Audio API (XACT, SCREAM, FMOD o
Xaudio2)
● Esperienza nell'uso di strumenti di sound design e post-produzione
audio quali Pro Tools, Sound Forge, Waves, Sequencer MIDI etc.
● Un background musicale e competenze di composizione non sono
essenziali ma rappresentano un plus
● Intelligenza creativa nell'affrontare le problematiche
● Ottima capacità comunicativa e attitudine al lavoro di squadra in un
team eterogeneo
Audio Programmer

“Audio production is only half the final product.
How it is implemented is the other half.”

L'audio nel ciclo di produzione
Pre-Produzione
Produzione
Post-Produzione

L'audio nel ciclo di produzione
Pre-Produzione
● Core Team
● Game Design
● Prototipo
● Audio design
● Funzionalità audio (musica interattiva)
● Implementazione (api, formati, compressione, midi)
● Lista asset

Produzione
● Il team si completa
● Si creano i livelli di gioco
● Composer crea le musiche
● Sound designer crea gli effetti
● Si realizza il voice over
● Integrazione degli asset
L'audio nel ciclo di produzione

Post-Produzione
● Versione beta
● Inizio del testing
● Audio Mixing
● Audio test
L'audio nel ciclo di produzione

Audio API
● Interfaccia tra applicazione e driver del sistema audio
● Astrazione tra sistema audio e programmatore
● Funzioni che permettono all'ambiente di gioco di
comunicare con i dispositivi audio in tempo reale.

Funzionalità base dell'Audio API
● Inizializzazione
● Loading (static, streaming)
● Play, Pause
● Stop
● Suoni loop e one-shot
● Volume
● Pan
● Canali Audio

● Audio 3D
● Surround
● Fade
● Pitch
● Enviromental Audio
● Scripting
Funzionalità avanzate dell'Audio API

Audio API principali
Su PCMac la scelta è limitata a:
● Windows: Xaudio 2
● MacOS: Core Audio
Sulle console vi sono audio API proprietarie:
● Nintendo fornisce NITRO-Composer per DS e AX per
WII
● Microsoft fornisce Xaudio2 per Xbox 360 e Xbox ONE
● Sony fornisce Scream per PS4
● Iphone fornisce Core Audio

Audio Wrapper
● interfacce di programmazione che si appoggiano alle API
vere e proprie per creare una propria interfaccia di più alto
livello spesso crossplatform
● Façade pattern
● Tipicamente ogni videogioco ha un audio wrapper creato
internamente o acquistato come middleware
Game Engine
API PC
API WII
API PS3
Game Engine
API PC
API WII
API PS3
Wrapper

Audio Middleware
● GUI: applicazione indipendente, permette
all'audio designer di importare, configurare e
testare l'audio del gioco.
● API: audio wrapper

Engine IntegrationCross-Platform
Cross-Platform Engine Integration
Audio Middleware

Unity Audio System
● Master Audio
● Audio Toolkit
● Fabric
● Sound Manager Pro
Audio Middleware

Viewers also liked

Possiamo scrivere metodi asincroni anche in Java e con Spring, anche senza dover usare le ultime versioni della JVM o del framework. Si parlerà di thread bloccati e altri stati del thread. Le interfacce Executor della JDK ci aiutano a gestire le chiamate asincrone; vedremo come vengono implementate in Spring. Ci saranno esempi di configurazioni XML e con annotations. Si parlerà di callback hell e di come evitarlo usando la Completable Future.

Meetup Code Garden Roma e Java User Group Roma: metodi asincroni con Spring -...

Codemotion

The rise in AI, machine learning & data lakes is driving greater use of Functional Programming, so how well do you know the concepts? We will discuss immutable data, functional composition, polymorphism, higher-order functions, pattern matching & recursion. These concepts helps the developer create performant, complex system with simple building blocks, using parallelism to make applications & services more scalable. Using Clojure as live code examples, you will understand the important functional concepts & patterns that you can apply to your own preferred languages.

Thinking Functionally - John Stevenson - Codemotion Rome 2017

Codemotion

Una delle caratteristiche salienti di Unreal Engine 4 e' la possibilita' di essere programmato attraverso un linguaggio visuale a nodi denominato 'Blueprint'. Per molti programmatori si tratta di una vera e propria eresia, secondo Epic e' un ottimo modo per permettere agli artisti e i designer di iniziare a prototipizzare le loro creazioni. E' davvero cosi' ? Si puo' costruire un gioco utilizzando solo le Blueprint senza aver bisogno di un monitor da 2000 pollici? Le Blueprint possono davvero essere usate da un artista senza basi di programmazione?

Unreal Engine 4 Blueprints: Odio e amore Roberto De Ioris - Codemotion Rome 2017

Codemotion

Xamarin.Forms is a framework for building cross-platform applications that share most of the UI codebase among the UWP, iOS and Android platforms. Due to the higher level of abstraction compared to Xamarin.Native, Xamarin.Forms applications may suffer from memory leaks and slow rendering times at the expense of the final user experience. In the session, we will explore the mechanisms used by Xamarin.Forms to translate abstract UI components into native ones, highlight with demos what are the main bottlenecks met by developer, how to solve them and get close to native performances.

Xamarin.Forms Performance Tips & Tricks - Francesco Bonacci - Codemotion Rome...

Codemotion

There has been a surge in the development of virtual reality applications with the production of easily accessible and sophisticated VR devices such as Oculus Rift, HTC Vive and Samsung Gear. Frameworks like A-Frame developed by the MozVR team combined with cheap alternatives such as Google Cardboard allows the developers to leverage the power of the web. The attendees of this talk would learn about the WebVR API, using A-Frame to build virtual worlds, creating virtual worlds for modern content display (such as reddit posts, news feeds, Instagram photos) as well as game development.

Web Based Virtual Reality - Tanay Pant - Codemotion Rome 2017

Codemotion

Cyber security is one of the most challenging topics in the current era. Cyber attacks are becoming day by day more sophisticated and difficult to be detected by automated systems. People who understand cyber threats and act to block cyber attacks are defined as cyber analysts. But what do they really do? What difficulties do they meet and what background should they have before starting the "neverending" "cyber security" learning path? Why is not enough an automated system? Marco will talk about real experiences on the cyber analyst field.

Cyber Analysts: who they are, what they do, where they are - Marco Ramilli - ...

Codemotion

Vast volume of our processed data is Time Series data and once you start working with distributed systems, you start tackling many scale and performance problems: How to handle missing data?Should I handle both serving and backed process or separating them out? Best Performance for Money? In the talk we will tell the tale of all of the transformations we’ve made to our data model@Windward, some of the problems we’ve handled, review the multiple data persistency layers like: S3, MongoDB, Apache Cassandra, MySQL. And I’ll try my best NOT to answer the question “Which one of them is the Best?"

S3, Cassandra or Outer Space? Dumping Time Series Data using Spark - Demi Be...

Codemotion

Container orchestration: the cold war - Giulio De Donato - Codemotion Rome 2017

Codemotion

So you’ve already containerized the shit out of your code, broken down monoliths, microserviced the hell out of your app and have run some awesome workloads in your local, dev and test environments. It’s all looking good, but now what? Running Docker commands is one thing, but maintaining containers in production is a whole other ballgame. So, during this talk, I’ll show you the REAL wild world of Docker in production. With the added benefit of talking to and observing how over 900 of our customers have been using Docker in production.

Docker Inside/Out: the ‘real’ real-world of stacking containers in production...

Codemotion

Docker is all the rage these days and you are told all the time you need to use Docker to host your applications. But what is Docker and why has it become such a hot topic? Why is Microsoft updating Windows 2016 so be a Docker container host? What does using Docker mean for your application architecture or can you just take any application and host it using Docker? In this session Maurice de Beijer will explain the history of Docker as well as explain how you could use it with your applications. He will also explain what else, besides Docker, you will need to add to your architecture.

The busy developer guide to Docker - Maurice de Beijer - Codemotion Rome 2017

Codemotion

An Introduction to Apache Ignite - Mandhir Gidda - Codemotion Rome 2017

Codemotion

Cyber Security in Multi Cloud Architecture - Luca Di Bari - Codemotion Rome 2017

Codemotion

This talk will examine the tools, methods and data behind the DDoS attacks that are prevalent in the news headlines. Using information collected, I will demonstrate what the attackers are using to cause their mischief and mayhem and examine the timeline and progression of attackers as they move from the historical page defacers to the motivated DDoS attacker. I will look at the motivations and rationale that they have and try to share some sort of understanding as to what patterns to be aware of for their own protection.

Barbarians at the Gate(way) - Dave Lewis - Codemotion Rome 2017

Codemotion

Invader Studios: sviluppatori da “Incubo” - Tiziano Bucci - Codemotion Rome ...

Codemotion

Handle insane devices traffic using Google Cloud Platform - Andrea Ulisse - C...

Codemotion

Once you start working with Big Data systems, you discover a whole bunch of problems you won’t find in monolithic systems. Monitoring all of the components becomes a big data problem itself. In the talk, we’ll mention all of the aspects that you should take into consideration when monitoring a distributed system using tools like Web Services, Spark, Cassandra, MongoDB, AWS. Not only the tools, what should you monitor about the actual data that flows in the system? We’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.

Monitoring Big Data Systems Done "The Simple Way" - Demi Ben-Ari - Codemotion...

Codemotion

Most React-Redux applications store the work in progress as is in a database. It is fine to treat objects like this in a small application. But this is not optimal when applications are complex. Prefer the CQRS design pattern for more complex applications. Combining this with Event-Sourcing is an even more powerful solution. Event-Sourcing ensures that every action is stored as a separate domain event. These domain events are the CQRS write model. These events also project into a secondary database. This projection builds the CQRS read model for the application.

Event-Sourcing your React-Redux applications - Maurice de Beijer - Codemotion...

Codemotion

Microservice Plumbing - Glynn Bird - Codemotion Rome 2017

Codemotion

Today’s applications are expected to provide powerful full-text search. But how does that work in general and how do I implement it on my site or in my application? Actually, this is not as hard as it sounds at first. This talk covers: * How full-text search works in general and what the differences to databases are. * How the score or quality of a search result is calculated. * How to implement this with Elasticsearch. Attendees will learn how to add common search patterns to their applications without breaking a sweat.

Full-Text Search Explained - Philipp Krenn - Codemotion Rome 2017

Codemotion

There is no denying that machine learning is rapidly reshaping the technological horizon, fueled by increasing availability of data, computing power, and software (e.g., TensorFlow). Classical ML techniques are becoming a common tool for the everyday programmer, at the same time that sophisticated deep learning models are fueling driverless cars, advanced AI players, and more. This talk will survey the ways in which ML is impacting the programming world, as we try to answer the following questions: are we truly witnessing a new AI resurgence? If yes, what should any developer be aware of?

From a Developer's POV: is Machine Learning Reshaping the World? - Simone Sca...

Codemotion

Viewers also liked (20)